The pathway
How you actually get there, here
How you become one varies far more by country than what one does. This is the UK route. Most people take one of these ways in; the right one depends on where you're starting from.
- 1
Junior Data Engineer / Associate Data Engineer
1-2 yearsSkills to master
- Mastering SQL and Python for data manipulation, understanding basic cloud services (S3, EC2), learning our internal data models and pipeline frameworks (like dbt and Airflow).
You're ready to move on when
- Can independently fix minor pipeline issues with minimal supervision.
- Consistently delivers clean, well-tested code for assigned tasks.
- Understands the full lifecycle of a simple data pipeline from ingestion to consumption.
- Actively participates in code reviews and asks thoughtful questions.
- 2
Software Developer (with data interest)
2-3 years of transitionSkills to master
- Shifting from application development to data-centric programming (Spark, dbt), learning data modelling principles, understanding distributed systems, and getting to grips with cloud data platforms.
You're ready to move on when
- Has built personal projects involving data ingestion and transformation.
- Demonstrates strong SQL skills alongside programming expertise.
- Expresses a genuine interest in data integrity, scalability, and performance.
- Has taken relevant online courses or certifications in data engineering fundamentals.
- 3
Data Analyst (moving into engineering)
1-3 years of transitionSkills to master
- Deepening programming skills (especially Python), learning infrastructure as code (Terraform), understanding pipeline orchestration (Airflow), and moving from consuming data to building the underlying infrastructure.
You're ready to move on when
- Has identified and automated repetitive data tasks in their previous role.
- Has a strong understanding of data quality issues from an analyst's perspective.
- Can write complex SQL queries and has started experimenting with Python scripting for data tasks.
- Shows initiative in understanding how data gets into the warehouse.