Hill climbing optimization

Definition

Hill climbing optimization refers to a subcategory of local search where, in each iteration, we change only one attribute of our guess. Examples of hill-climbing optimization approaches include coordinate descent and gradient descent.