Celery

Celery is a task queueing mechanism used to distribute workloads between work particles or machines. It supports asynchronous processing in distributed system architectures and can work integrated with various message intermediaries.

CE

celery · Queues & Streaming

STARS29.1K
FORKS5.3K
COMMITS—
CONTRIBUTORS1.5K
VERSIONv5.6.3
UPDATED2 days ago
pythontask-queueDistributedAsyncBSD-3-Clause

Common commercial products in this category: Confluent Cloud, Amazon SQS, Amazon Kinesis

What can it do?
  • You distribute workloads between different workpieces or machines
  • You manage background operations in an asynchronous structure
  • As a message tool, you use RabbitMQ, Redis, Amazon SQS, or Google Pub/Sub, storing task results in stores such as Redis, SQLAlchemy, or Django ORM.
Heads up
  • • High number of open issues (744)
User reviews
  • • NeutralHacker News

    Why do we need Flask, Celery, and Redis? (2019)

    “This is what I have used in the past. I think they're very convenient if you are just running one instance of uwsgi and want to share some state quickly without going through a persistent database. If you're worrying about tweaking Celery for performance, then I suspect your…”

  • • NeutralHacker News

    Why do we need Flask, Celery, and Redis? (2019)

    “I suspect they are using a single server. I found uwsgi's mules and cache2 very useful in that situation. If someone finds that Redis and Celery are more complication than they need for a given task, then I think they're probably not using an orchestration framework.”

Verified against README · Oct 26, 2026 · source

My note

Alternative pages

More in: Queues & Streaming