cocoindex
CocoIndex is an incremental processing engine that keeps up-to-date data sources such as source codes, meeting notes, e-mails, and documents for AI agents and large language models. It provides efficiency by reprocessing only the changing data (delta) and can be configured declaratively with Python. This infrastructure, which can run parallel to the Petabyte scale, supports AI applications to access current data by creating vector directories.
cocoindex
100cocoindex-io · Data Pipelines & ETL
Common commercial products in this category: Fivetran, Informatica, Stitch
- You can keep data sources such as code bases and documents up to date for AI agents.
- You can define declarative data conversion pipelines using Python.
- You can synchronize database and vector directories by processing only changing data.
- • NeutralHacker News
Show HN: CocoIndex – Open-Source Data framework for AI, built for data freshness
“Absolutely! CocoIndex is an ETL framework not limited to RAG. You can use it to do transformation as you need, including parsing documents and extracting information you need using your model or code. We have a similar example, and welcome to checkout:”
- • NeutralHacker News
Show HN: CocoIndex – Open-Source Data framework for AI, built for data freshness
“Appreciate the feedback! we are adding more native built-ins, if there's anything i can help please feel free to open a ticket at our repo or shoot me a email [email protected]”
My note
Alternative pages
More in: Data Pipelines & ETL
- Apache Spark★ 44,376 · today
- Apache Flink★ 26,441 · today
- rocketride-server★ 19,018 · today
- Luigi★ 18,780 · 17 days ago
- OpenMetadata★ 15,637 · today
- ElectricSQL★ 10,420 · 24 days ago