Data Engineering
Properties
tags
cscs/data_eng
created
06.10.2024, 10:19
modified
21.07.2026, 08:42
published
Empty
sources
Empty
topics
Data Engineering, Modern Data Stack, Data Platforms, Data Pipelines
authors
Jakub
ai-assisted
No
- By data engineering I mean a broad field of Processing and analysis of large-scale data which consists of multiple disciplines and was the specialization of my Master’s degree.
# Topics
- Modern Data Stack
- Layered architecture: orchestration (Airflow), transformation (dbt), compute (warehouse/Spark)
- Data Storage Architectures
- Data Platforms
- Distributed Data Processing
- Data Pipelines
- Data Streams
# Learning Resources
# Data Science vs. Data Engineering
- Data Science != Data Engineering
- Data Science
- Scientific
- Art
- Business problems
- Model mathematically
- Optimize performance
- Data Engineering
- Reliability
- Scalability
- Maintainability
- SLAs