ETL (Extract Transform Load) & Data Integration & Data Replication
Lists & Resources
- https://github.com/pawl/awesome-etl
- https://github.com/johnberrydev/awesome-data-integration
- informatica etl - Brave Search
- cybersecurity etl b2b data integration - Brave Search
- Data Integration Tools Reviews 2022 | Gartner Peer Insights
- Informatica
- Live Data Integration vs. Data Replication
- 2020 Gartner Magic Quadrant for Data Integration Tools – BMC Software | Blogs
- 5 Strategic Technologies On The Gartner Hype Cycle For Midsize Enterprises 2018
- data ops - Brave Search
- data fabric - Brave Search
- Using Data Fabric Architecture to Modernize Data Integration
No-Code Integration & Automation Tools
- https://onlizer.com/
- https://pipedream.com/
- https://n8n.io/
- https://www.make.com/
- https://zapier.com/
Opinionated Data Integration & ETL Tools
- WayScript - way to avoid setting up a server yourself. Run code and interact with APIs.
- Airbyte | Open-Source Data Integration Platform | ELT tool - Free by self-hosting with Docker. Cheap cloud options.
- Jitsu : Open Source Data Integration Platform - Open-source alternative to Segment. Free by self-hosting with Docker.
Opinionated ETL Workflows
Connecting Two Databases for Complex Transformations
Cloud-Hosted
- Data Sources → ( Cloud Server [ Digital Ocean, AWS, Azure ] → ( Airbyte ) ) → Data Targets
- Data Sources → ( n8n.io , Pipedream, Make) → Data Targets
Self-Hosted
- Data Sources → Airbyte ( docker container ) OR Jitsu (docker container) → Data Targets
- Data Sources → ( n8n.io , Pipedream) → Data Targets