Mine too. My initial (naive) thought on developing something like this would be to have advanced users perform the tasks that I wanted to automate, and recording the series of actions that they took to perform the task so I could analyze it and try to find the patterns.
How is something like this actually developed?