SQL
Importance: Essential (5 of 5)
Queries and transforms relational data effectively.
Course coverage
- SQL Fundamentals
- Advanced SQL for Analytics (planned)
← All career guides7 of 7 skills23 of 29 courses
Data and AI
Data Engineer
Builds reliable data ingestion, transformation, storage, orchestration, and governance systems.
Skill coverage
100%
Course coverage
79%
Skill coverage shows how much of the role's capability map already has a published course. Course coverage shows how much of the mapped course pipeline for this role has shipped.
- Role skills
- 7
- Published coverage
- 7
- Relevant courses
- 23
Capability map
Skills
Importance describes how central each capability is to the role. Course coverage shows where you can build the skill in the current OpenSkills catalog.
01
Data foundations
4 capabilities
Data modeling
Importance: Essential (5 of 5)
Designs models aligned with operational and analytical workloads.
Course coverage
Warehouses and lakes
Importance: Essential (5 of 5)
Selects and structures analytical storage platforms.
Course coverage
Data wrangling
Importance: Essential (5 of 5)
Cleans, reshapes, and validates heterogeneous data.
Course coverage
02
Data platforms
3 capabilities
Batch and stream processing
Importance: Essential (5 of 5)
Builds scalable bounded and unbounded data pipelines.
Course coverage
- Batch Data ProcessingFree
- ETL and ELT
- Stream Processing
- Apache Kafka Fundamentals
- Apache Kafka Operations
- Apache Pulsar Fundamentals
- Event Streaming
- Apache Flink Fundamentals
- Apache Spark Fundamentals
- Databricks Fundamentals
- Batch Inference and Offline Scoring, Feature Stores with Feast, Streaming Feature Engineering (planned)
Data orchestration
Importance: Essential (5 of 5)
Schedules, coordinates, retries, and observes pipeline work.
Course coverage
- Apache Airflow Fundamentals
- Dagster Fundamentals (planned)
Data quality and governance
Importance: Essential (5 of 5)
Makes data trustworthy, discoverable, traceable, and controlled.
Course coverage
- Data Quality
- Data Governance
- Data Lineage
- Data Retention
- Master Data Management
- Data and Model Versioning with DVC (planned)
Learning path
Relevant courses
Core foundations
The concepts this role is built on.
Supporting knowledge
Adjacent knowledge that improves day-to-day judgment.
- Apache Airflow Fundamentals
- Apache Kafka Fundamentals
- Apache Kafka Operations
- Apache Pulsar Fundamentals
- Data Governance
- Data Lineage
- Data Retention
- Event Streaming
- Master Data Management
- Python for Analysis
- Advanced SQL for Analytics, Batch Inference and Offline Scoring, Dagster Fundamentals, Data and Model Versioning with DVC, Feature Stores with Feast, Streaming Feature Engineering (planned)
Specializations
Deeper paths for particular environments or directions.
Put the map to work
Find Data Engineer roles.
Search multiple job sources at once with queries tailored to this career, then use the skill map above to evaluate what each role actually asks for.