Question

Is it possible to sign into a website (and allow that website to be visited with any browser without the user having to sign in) via a background process without user interaction and allow the user to browse the site without logging in from any browser?

I’d guess that I would need to register the created session with each web browser on the user’s system, but is there any other (possibly simpler) way of doing this?

Think of it like automatically signing into Gmail in the background and being able to browse it without ever seeing a login page.

Answer 1

yes is possible.I suggest two ways to solve your problem. Both of them uses HTTP requests. You should check more info about HTTP request.

1) the easiest way and recommended one for only login Requests: HTTP for Humans

2) python scrapy, but scrapy is for crawling or screen scraping.
check this example:

Login spider example

class LoginSpider(BaseSpider):
name = 'example.com'
start_urls = ['http://www.example.com/users/login.php']

def parse(self, response):
    return [FormRequest.from_response(response,
                formdata={'username': 'john', 'password': 'secret'},
                callback=self.after_login)]

def after_login(self, response):
    # check login succeed before going on
    if "authentication failed" in response.body:
        self.log("Login failed", level=log.ERROR)
        return

    # continue scraping with authenticated session...

more info here