Home/ Questions/Q 6096341
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-23T12:54:58+00:00

I have an application built with Django. Part of it relies on data that

  • 0

I have an application built with Django. Part of it relies on data that I aggregate from other websites. Wondering how I should approach building the scraper/aggregator.

The advantages I see of building it as a Django app is

  1. the ability to use Django’s models & database API
  2. the ability to use Django’s other methods

On the other hand I think the disadvantage would be scalability in the long run.

Should I build the scraper/aggregator as an app in my Django project or as a separate script that runs on its own?

Would love to hear your thoughts.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Neither of your points require it to run within Django. And since it will not be dependent on the web/HTTP interface, having it be a separate module is the only option that makes sense.

    • 0