Awesome Data Engineering

A curated list of data engineering tools for software developers Awesome

List of content

  1. Databases
  2. Ingestion
  3. File System
  4. Serialization format
  5. Stream Processing
  6. Batch Processing
  7. Charts and Dashboards
  8. Workflow
  9. Data Lake Management
  10. ELK Elastic Logstash Kibana
  11. Docker
  12. Datasets
  13. Monitoring
  14. Community

Databases

Data Ingestion

File System

Serialization format

Stream Processing

Batch Processing

Charts and Dashboards

Workflow

Data Lake Management

ELK Elastic Logstash Kibana

Docker

Datasets

Realtime

Data Dumps

Monitoring

Prometheus

Community

Forums

Conferences

Podcasts

Cheers to The Data Engineering Ecosystem: An Interactive Map

Inspired by the awesome list. Created by Insight Data Engineering fellows.

License

CC0

To the extent possible under law, Igor Barinov has waived all copyright and related or neighboring rights to this work.