Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I’m going to use Celery to manage tasks in cluster. There will be one master server and some worker servers. Master sends tasks to the worker servers (any number) and gets the result. Task state should be trackable. Backend is RabbitMQ.
Is using Celery in this case a good Idea? Or are there better solutions?
IMHO It’s a very good idea. I have used it few times in Amazon EC2 in this manner and it was great each time.
One of the big advantages is that it can handle failure of worker servers, so the dynamic nature of the infrastructure is not a problem and you still get things done.
I’m sorry that this answer is so brief, but I believe it answers OPs question. There’s not much more to it. Celery is great, does the job, has good docs. Go with it 🙂