Data Engineer

Role Overview:

We are seeking a Data Engineer to support a key client project, focused on designing, building, and optimising data pipelines within a cloud-based data and analytics environment. The role requires strong data engineering fundamentals, reliable delivery, and the ability to collaborate closely with technical and business teams.

Key Responsibilities:

Data Engineering & Pipeline Development

• Design, develop, and maintain scalable data pipelines across batch and streaming workloads.

• Build robust ingestion, transformation, and curation processes aligned with modern data engineering tools and patterns.

• Develop and maintain data models, curated datasets, and integration layers to support analytics and reporting.

• Optimise data processing for performance, reliability, and cost efficiency.

Data Quality, Governance & Security

• Implement data quality checks, validation routines, and automated monitoring.

• Ensure accurate and up‑to‑date data lineage, metadata management, and documentation.

• Apply appropriate security controls, including role‑based access, data masking, and protection of sensitive information.

Cloud & Platform Engineering

• Work with cloud‑native services for storage, compute, and workflow orchestration.

• Monitor pipelines and platform performance, identifying and resolving issues and bottlenecks.

• Support environment configuration, standardisation, and implementation of best practices.

DevOps, Automation & Observability

• Use CI/CD processes to deploy code, configurations, and data assets across environments.

• Maintain version control, participate in code reviews, and follow release processes.

• Build monitoring, alerting, and logging to support high‑quality operations and rapid issue resolution.

Collaboration & Delivery

• Collaborate with Data Scientists, analysts, engineers, and business stakeholders to understand requirements and deliver robust solutions.

• Support requirement gathering, solution design, documentation, and technical handover.

• Contribute to continuous improvement, standardisation, and knowledge sharing.