What is Hatchet?
Hatchet is a modern orchestration platform that helps engineering teams build low-latency and high-throughput data ingestion and agentic AI pipelines.
You write functions in Python, Typescript, Go, or Ruby and let Hatchet handle scheduling, retries, fault tolerance, and observability.
Customize your docs experience β choose your preferred language for code examples:
The core mental model has three parts:
- Tasks β the fundamental unit of work. A task wraps a single function and gives Hatchet everything it needs to schedule, execute, and observe it.
- Workers β long-running processes in your infrastructure that pick up and execute tasks.
- Durable Workflows β compose multiple tasks into durable pipelines with dependencies, retries, and checkpointing.
All tasks and workflows are defined as code, making them easy to version, test, and deploy.
Use cases
While Hatchet is a general-purpose orchestration platform, itβs particularly well-suited for:
- Real-time data processing β data ingestion for keeping LLM contexts up-to-date, ETL pipelines that require fast execution and high throughput.
- AI agents β features like webhooks, child spawning, and dynamic workflows are designed to support agentic patterns.
- Event-driven systems β Hatchetβs eventing features let you build event-driven architectures without additional infrastructure.
Why Hatchet?
β‘οΈ Low-Latency For Real-Time Workloads - Sub-25ms task dispatch for hot workers with thousands of concurrent tasks. Smart assignment rules handle rate-limits, fairness, and priorities without complex configuration.
πͺ¨ Durability for Long Running Jobs - Every task invocation is durably logged to PostgreSQL. With durable execution, when jobs fail your workflow will resume exactly where you left off β no lost work, no duplicate LLM calls, no engineer headaches.
π§ββοΈ Zen Developer Experience - Hatchet SDKs (Python, Typescript, and Go) are built with modern tooling and are designed to be easy to use. Hatchet has built-in observability and debugging tools for things like replays, logs, and alerts.
If you plan on self-hosting or have requirements for an on-premise deployment, there are some additional considerations:
π Minimal Infra Dependencies - Hatchet is built on top of PostgreSQL and for simple workloads, its all you need.
β¬οΈ Fully Featured Open Source - Hatchet is 100% MIT licensed, so you can run the same application code against Hatchet Cloud to get started quickly or self-host when you need more control.
Hatchet vs. Alternatives
Today, developers who need background task processing and workflow orchestration face two main options:
- Adopt external services like Temporal or Airflow, which are powerful but complex to run or introduce latency, or
- Use simple task queue libraries like Celery or BullMQ, which lack critical workflow features and become difficult to debug at scale.
| Feature | Hatchet | Celery | Airflow | Temporal |
|---|---|---|---|---|
| Task Start Latency | 25ms | 5-100ms+ | 5-30s | 25ms |
| Concurrent Tasks | 1000s | Variable* | Variable* | 10000 |
| Code-First Workflows | β | β | β | β |
| Cron Jobs and Scheduling | β | β | β | β |
| Priority Queues | β | β | β | β (beta) |
| Durable Sleep/Checkpoints | β | β | β | β |
| Sticky Assignment/Complex Routing Logic | β | β | β | β (limited) |
| Event-Based Triggering | β | β | β | β |
| Real-time Streaming | β | β | β | β |
| Global Rate Limits | β | β | β | β |
| Event Streaming | β | β | β | β |
*Requires careful configuration and infrastructure scaling
Production Readiness
Hatchet has been battle-tested in production environments, processing billions of tasks per month for scale-ups and enterprises across various industries. Our open source offering is deployed over 10k times per month, while Hatchet Cloud supports hundreds of companies running at scale.
βWith Hatchet, weβve scaled our indexing workflows effortlessly, reducing failed runs by 50% and doubling our user base in just two weeks!β β Soohoon, Co-Founder @ Greptile
βHatchet enables Aevy to process up to 50,000 documents in under an hour through optimized parallel execution, compared to nearly a week with our previous setup.β β Ymir, CTO @ Aevy
Ready to dive deeper?
Check out the Architecture & Guarantees page to learn how Hatchet is built, its guarantees, and when to use it.
Or get started with the Hatchet Cloud Quickstart or self-hosting.