dlt
dlt is an open-source data library that automates data loading processes and can be integrated into Python projects. It takes unstructured data from sources and transfers it to target databases by managing schema extraction and data types determination processes. It can operate in local environments, cloud functions, or workflows such as Airflow without any platform dependency.
dlt
95dlt-hub · Data Pipelines & ETL
Common commercial products in this category: Fivetran, Informatica, Stitch
- You transfer data from sources such as REST API or Python iterables to target databases.
- With automatic schema extraction and data type determination features, you configure data without requiring manual intervention.
- By incorporating the library into existing Python projects, you manage data uploading processes with a code-based workflow.
- • NeutralHacker News
Jepsen: Radix DLT 1.0-Beta.35.1
“But they wrote it in the present tense, said it was a world record even ! And how can you say an earlier iteration will come in the future, that seems like a crypto-truth bending like we see a lot :s Admit it, they exaggerated and removed the statement to instead put it in a…”
- • NeutralHacker News
Show HN: Dlt – Python library to automate the creation of datasets
“All of this sounds very appealing, both as a standalone tool and as a complement to some thing like Dbt. However the following seems like kind of an anti-feature, which I at least would want the option to disable: > You do not need to worry about the structure of a database or…”
My note
Alternative pages
More in: Data Pipelines & ETL
- Apache Spark★ 44,376 · today
- Apache Flink★ 26,441 · today
- rocketride-server★ 19,018 · today
- Luigi★ 18,780 · 17 days ago
- OpenMetadata★ 15,637 · today
- cocoindex★ 11,788 · today