Azure Data Engineer
Required Technical Skill Set: Proficiency in Azure Databricks, Data Factory, Python, PySpark, SQL, ETL, CI/CD
Experience Range: 5-9 Years
Desired Competencies (Technical/Behavioral Competency)
Must-Have
Experience in implementing projects in Azure stacks
Experience with Azure Databricks, Data Factory
Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
Experience in Python PySpark
Experience in data ingestion, curation and transformation using spark
Good-to-Have
- Excellent verbal and written communication and interpersonal skills
- Ability to work independently and within a team environment.
Responsibility of / Expectations from the Role
- Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation
- Design, code, unit test, and code review iterative improvements to platform
- Ensure adherence to sound architecture
- Build and maintain the Infrastructure for data products, including data pipelines, storage systems, and processing engines.
- Ensures the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime.
- Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.
