I was wondering if it is possible to drive Flash application programatically to provide some sort of automation for web Flash-based applications that demand user interactions? The naive approach would require taking screenshots and recognizing interactive areas based on some predefined patterns. Then we can emulate mouse clicks/keyboards by sending windows messages directly to the browser.
I’m wondering whether there is a simpler/more subtler way of achieving this.
Are you trying to play a game or run an application on someone else’s website which is why you can’t use an autohotkey program? In that case, you will have to take some type of screenshot and do pixel analysis to figure out what is happening on screen and what you want to do with that data.
Unfortunatley you won’t be able to pull data out of the Flash app that you don’t control unless you reverse engineer it and that’s pretty unlikely and possibly illegal. If it is your app, then you can simply pass commands to a service that interacts with the Flash app backend, but I’m guessing not.