One way evolution explores is through random genetic mutation; optimization algorithms sometimes correspondingly use randomness in the search process. But randomness is not essential for exploration.