A quick reference guide for the main ideas behind common data engineering and software engineering terms.
Data engineers build the platforms, tools, and logic that enable data scientists to do their magic and end users to recieve insights.
- ETL
- Extract Transform Load
- Kafka
- Hadoop
- Spark
- Firebase
- Airflow
- Docker
- Kubernetes
- nginx
- CI/CD
- batch and stream processing
- data lake
- data warehouse
- postgreSQL
- CircleCI
- datadog
- React
- Node
- ES6
- SSH
- Angular
- Vue
- serverless
- Flask
- bash
- zsh
- MVC
- REST
- GraphQL
- Bayesian
- prior
- neural networks
- deep learning
- hypothesis testing