In this paper, we consider optimization problems with $L^0$-cost of the
controls. Here, we take the support of the control as independent optimization
variable. Topological derivatives of the corresponding value function with
respect to variations of the support are derived. These topological derivatives
are used in a novel gradient descent algorithm with Armijo line-search. Under
suitable assumptions, the algorithm produces a minimizing sequence.