Does it matter that you're weaker? Perhaps if you felt dizzy or tired enough that you might injure yourself.
I found myself feeling a little weaker before I got into the habit of fasting until late afternoon, but once I got used to it - and corrected my water and salt intake - I felt normal, and then better than before, when I used to eat breakfast and lunch.