Lead Data Engineer
A Lead Data Engineer ensures their team''s technology stack is fully compliant and managed within Experian security standards and policies. They act asa role modelfor best practice and high-quality technical output. Their mentoring brings tangible developmentalbenefitto the engineers they support. They lead and drive measurable technical improvement and innovation within their domain.
Does this sound like youInterested in finding out moreYou should apply.
Desirable, but not essential experience:
- Fivetran, Snowplow, or Orchestra for data ingestion and orchestration
- Data Mesh principles with domain-oriented data ownership
- Change Data Capture (CDC) patterns and implementations
- Real-time / streaming architectures (e.g. Kafka, Kinesis)
- MLOps or feature store implementations (e.g. SageMaker, Feast)
- Migration of legacy data warehouses to modern data platforms
- FinOps practices and cloud cost optimisation for data platforms
- Security tooling and compliance experience (e.g. Veracode, AquaSec, Rapid7)
Qualifications
AsLeadData Engineer, you will combine deep technicalexpertisewith leadership capability. You will drive the migration from legacy data systems to our modern stack,establishengineering standards within your pod, and ensure your team delivers high-quality, reliable data products.
Werequirea Lead Data Engineer who is highly skilled in:
- Snowflake expertise (warehouses, clustering, RBAC, performance tuning)
- dbt for modular transformations, testing, and CI/CD-enabled data pipelines
- Python for data engineering (pandas, orchestration, automation, scripting)
- Advanced SQL skills (complex transformations, query optimisation)
- AWS data services experience (S3, Glue, Kinesis, DMS, Redshift)
- Data pipeline design and architecture across batch and streaming workloads
- Data quality frameworks (e.g. dbt tests, Great Expectations, or equivalent)
- Version control and CI/CD practices (Git, GitHub Actions, CodePipeline)
- Line management and technical mentoring of engineers
- Driving technical standards and best practices across teams
- Strong stakeholder partnership, translating data needs into scalable solutions
- Creating onboarding materials, documentation, and selfservice learning resources
- Ability to communicate complex technical concepts to nontechnical audiences
You will lead a pod of Data Engineers in Hyderabad, reporting to the UK-based Senior Data Engineering Manager. You are accountable for the technical output, professional development, and day-to-day management of your team. You will work asynchronously with UK colleagues and ensure your podoperatesas true owners of their domain, not as a support function.
A significant part of your role is enabling other teams to succeed with data. You will build relationships with Marketing, Risk, Analytics, and Data Science teams to understand their challenges and help them navigate the data ecosystem. You will create andmaintainonboardingresources, run knowledge-sharing sessions, and ensure teams can self-serve whereappropriate. You measure success not just by pipelines delivered, but by the outcomes your customers achieve.
