Home/ Questions/Q 7442517
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-29T11:11:09+00:00

I have two sites running essentially the same codebase, with only slight differences in

  • 0

I have two sites running essentially the same codebase, with only slight differences in settings. Each site is built in Django, with a WordPress blog integrated.

Each site needs to import blog posts from WordPress and store them in the Django database. When a user publishes a post, WordPress hits a webhook URL on the Django side, which kicks off a Celery task that grabs the JSON version of the post and imports it.

My initial thought was that each site could run its own instance of manage.py celeryd, each is in its own virtualenv, and the two sites would stay out of each other’s way. Each is daemonized with a separate upstart script.

But it looks like they’re colliding somehow. I can run one at a time successfully, but if both are running, one instance won’t receive tasks, or tasks will run with the wrong settings (in this case, each has a WORDPRESS_BLOG_URL setting).

I’m using a Redis queue, if that makes a difference. What am I doing wrong here?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Have you specified the name of the default queue that celery should use? If you haven’t set CELERY_DEFAULT_QUEUE the both sites will be using the same queue and getting each other’s messages. You need to set this setting to a different value for each site to keep the message separate.

    Edit

    You’re right, CELERY_DEFAULT_QUEUE is only for backends like RabbitMQ. I think you need to set a different database number for each site, using a different number at the end of your broker url.

    • 0