The pathway
How you actually get there, here
How you become one varies far more by country than what one does. This is the UK route. Most people take one of these ways in; the right one depends on where you're starting from.
- 1
From Data Engineer
3-5 years as a Data EngineerSkills to master
- Deepen your understanding of data quality principles, incident response, and proactive monitoring. Focus on building fault-tolerant pipelines and automating testing.
You're ready to move on when
- You're the person who always spots data inconsistencies in your pipelines.
- You've taken the lead on debugging complex data issues multiple times.
- You've started implementing more robust testing or monitoring in your existing data engineering work.
- You find yourself constantly thinking about 'what if this breaks?' when building new data flows.
- 2
From Site Reliability Engineer (SRE) with Data Focus
4-6 years as an SRESkills to master
- Translate your SRE principles (SLOs, incident management, automation) to the unique challenges of data. Learn data modelling, SQL, and specific data quality tools.
You're ready to move on when
- You're already managing the reliability of data-serving applications or databases.
- You're adept at incident response and post-mortems for software systems, and you're keen to apply that to data.
- You have a strong automation mindset and want to apply it to data pipelines.
- You're comfortable with distributed systems and eager to learn the nuances of data consistency and freshness.
- 3
From Software Engineer (with Data Interest)
5-7 years as a Software EngineerSkills to master
- Develop strong data modelling skills, learn the intricacies of data warehousing/lakehouses, and understand data-specific reliability challenges like schema drift and data freshness. Pick up Python for data.
You're ready to move on when
- You've worked on backend systems that produce or consume a lot of data.
- You're passionate about building robust, fault-tolerant software and want to apply that to data.
- You've got strong programming skills and are eager to learn the data domain.
- You're frustrated by 'garbage in, garbage out' and want to fix data quality at the source.