Senior Data Engineer, working in AWS
Kunai is seeking a Senior Data Engineer to join its Data Infrastructure team to build and shape the foundation of the company's data-dependent systems. The successful candidate will lead a cloud migration from GCP to AWS and design and implement scalable data pipelines using Apache Spark, Delta Lake, and the medallion architecture.
Requirements
- Strong Scala expertise with solid Python proficiency
- Deep experience with Apache Spark for both streaming and batch data processing at scale
- Proven track record running production ETL workloads on AWS (EMR, Glue) against terabytes of data
- Experience designing and operating data architectures using Delta Lake and the medallion (Bronze / Silver / Gold) pattern
- 8+ years of data engineering experience, with a track record of owning critical infrastructure end-to-end
Benefits
- Competitive compensation
- Professional development opportunities
- Flexible work arrangements
- Relocation assistance
Originally posted on Himalayas
