Careful tuning is provided by the scaling laws, so you don't need to set the hyperparameters yourself. I am quite skeptical about setting alpha=-0.1 tbh, but I'm curious to see what happens too lol.
So something that ends up increasing the step size might actually help. But in practice you're probably better of doing something more orthodox like conjugate gradient or Newton's.