It is similar, but Hill Climbing moves one parameter at a time. While gradient descent moves along the steepest gradient adjusting multiple parameters at a time, but it requires the function to be differentiable

https://en.wikipedia.org/wiki/Hill_climbing#Mathematical_des...