Snowflake Developer
The Data Engineer is responsible for building and operating scalable data pipelines and curated datasets on the Snowflake platform. The role emphasizes high standards of data quality, performance, governance, and automation to support analytics and AI initiatives across the enterprise.
Key Responsibilities:-
- Design and implement automated ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines to ingest data from multiple enterprise systems.
- Construct scalable data transformation workflows using Python and advanced SQL, ensuring both reliability and maintainability.
- Perform data discovery and profiling of new and existing data sources, including documentation of data definitions, relationships, and completeness.
- Conduct data exploration and validation activities to ensure datasets are ready for analytics and AI applications, translating business requirements into actionable data solutions.
- Develop robust data models for analytics and reporting, including dimensional modeling (fact and dimension tables) and the creation of curated datasets optimized for consumption.
- Implement data quality controls, such as validation rules, monitoring systems, and processes for remediating duplicates or inconsistencies, ensuring ongoing data quality management.
- Optimize Snowflake performance through advanced SQL tuning and workload optimization strategies, including clustering and partitioning techniques. Manage data governance and metadata, including documenting lineage, establishing access controls, and aligning with enterprise security policies. Establish automation and CI/CD practices through Git-based workflows and automated deployment and monitoring checks.
Required Qualifications:-
- Strong proficiency in Python for data processing, transformation, and pipeline automation.
- Advanced SQL skills, including querying, transformation, and performance optimization.
- Experience with libraries such as Pandas, PySpark, and NumPy.
- Deep expertise with Snowflake, including data architecture, storage and compute optimization, and data sharing
Share your resume over [email protected]