RQ (Redis Queue)
RQ is a library that queues and processes background tasks in Python applications using the Redis or Valkey infrastructure. Designed with a low entry barrier, it offers a scalable structure from simple applications to high volume systems. It supports basic queue management features such as task scheduling, repetitive jobs, and prioritization.
rq · Queues & Streaming
Common commercial products in this category: Confluent Cloud, Amazon SQS, Amazon Kinesis
- You queue Python functions to run asynchronously in the background.
- You prioritize tasks by defining multiple queues or adding things in front of the queue.
- You configure tasks that will be repeated on time or at certain intervals.
- • NeutralGitHub Issue
Suggestion: multi-job dependency
“I suggest extending the current dependency feature to allow a job to depend on multiple jobs, not just one, so that it can be run only when all those jobs it depends on have succeeded.”
- • NeutralGitHub Issue
Job queued but not run
“I have a job not run, in the log of worker: 2016-11-15 23:18:34,617 11894 {q}default: [job details] (e47b96dc-d0f8-48b4-bbc9-090e6443080a) 2016-11-15 23:18:34,618 11894 Sent heartbeat to prevent worker timeout. Next one should arrive within 420 seconds. 2016-11-15 23:18:34,621…”
My note
Alternative pages
More in: Queues & Streaming
- Apache Kafka★ 34,100 · today
- Celery★ 29,096 · 2 days ago
- NSQ★ 25,772 · 2 mo ago
- Temporal★ 24,096 · today
- NATS★ 20,973 · yesterday
- Apache Pulsar★ 15,353 · today