Question

I have just started learning scrapy and i want to try some prasing with python and Scrapy.
I am thinking of getting the list of questions from specific tags, which i have posted, and then parse them on SO.

But i am not sure how can i log with open id and Scrapy.

Can some please guide me with this on which url i have to submit the data because when i will type the openid then site gets transfered to openid url so how can i enter password there

Answer 1

Use your RSS feed (basically xml).

One other way I can think of is to:

Login normally in browser
export cookies to file
use that file in script

I can think of a situation where fanatic badge would become less valued. Because, then people would simply schedule cron on their server to visit SO every day! So, I advice not doing anything of this sort.