aws-sdk-pandas
AWS SDK for pandas (awswrangler) is an open-source library that provides integration between Pandas data structures and Amazon Web Services (AWS) services. S3 facilitates data reading and writing with various AWS components, such as Athena, Redshift, Glue, and Timestream. With Modin and Ray integration, you can run large data workloads on a worker cluster on a scale.
AW
aws · Data Pipelines & ETL
STARS4.1K
FORKS754
COMMITS0
CONTRIBUTORS0
VERSION3.17.1
UPDATED3 days ago
PythonAWSPandasData LakeApache-2.0
Common commercial products in this category: Fivetran, Informatica, Stitch
What can it do?
- You can store Pandas data frames in Parquet, CSV, JSON and EXCEL formats on Amazon S3.
- Using Amazon Athena, you can run SQL queries directly and get the results as a data frame.
- Using the Modin and Ray infrastructure, you can run data processing workflows on a scale.
My note
Alternative pages
More in: Data Pipelines & ETL
- Apache Spark★ 44,376 · today
- Apache Flink★ 26,441 · today
- rocketride-server★ 19,018 · today
- Luigi★ 18,780 · 17 days ago
- OpenMetadata★ 15,637 · today
- cocoindex★ 11,788 · today