Isn't the 'we need gradients' a foregone conclusion?

Gradients can be calculated numerically, meaning that any method that samples the cost function and makes optimization decisions based on that can actually compute gradients if it needs to.