Here is a man who found Quality in his life. He didn't care about the market. He eschewed the call of mammon. This gentleman dug himself a glorious hole, and worshipped in the one way he knew how.
Building.
You can laugh or call him insane if you like. Here was a man who knew what he wanted and hew it from the earth itself.
Gaze in awe mortals. This man has truly exercised his free agency.
This reminds me of a recent talk on YouTube - 'the naive programmer' where Henri Rousseau is discussed:
https://www.youtube.com/watch?v=8bnlQW0BfZk
https://en.wikipedia.org/wiki/Henri_Rousseau
The naive programmer brings stuff to the table even if what they do is not best practice and even if they are not a 'team player'. A recommended watch.
AFAICT from the article, he felt drafted into this project from a voice in his dreams, which I'm guessing he reckoned to come from a different agent.
Anything else by definition requires omniscience on the part of the exerciser.
You seem to basically be arguing that we should define free will in a way that makes it entirely an illusion, yet treat it as meaningful.
Otherwise any definition trivially collapses under "Well how do you know that you're acting freely?"
Which makes other definitions functionally useless in terms of communicating an idea.
I'd rather have a meaningless definition that's useful than a philosophically pure one that's useless. But maybe that's why I'm an engineer. ;)
People have escaped from work camps or revolted. Others have resisted armed attackers. Some have used their god-given intelligence to question other's interpretations of scriptures. and so on...