Question

I am working on scrapy, i am scheduling a spider i had wrote with the following command

curl http://localhost:6800/schedule.json -d project=example -d spider=exampledotcom

I am using this by seeing in scrapy tutorial, but when i run above command i used to get the below error

curl: (7) couldn't connect to host

Why curl is unable to connect to host, is anything wrong in the command ? and also can anyone explain me the concept of why we are using "http://localhost:6800/schedule.json", because finally my intension is to run multiple spiders in a single project.

Answer 1

Scheduling a spider means telling scrapyd to run the spider when it can. Thus your have to run scrapyd, before trying to contact it:

scrapy server

or

twistd -ny extras/scrapyd.tac