Big Data Architect

Roles and Responsibilities :

• Design and develop scalable big data solutions using PySpark, Spark Streaming, and Kafka.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality data pipelines.
• Ensure data quality by implementing data validation, transformation, and loading processes.
• Troubleshoot complex issues related to big data processing and provide technical guidance to junior team members.

Job Requirements :

• 9-15 years of experience in Big Data architecture design and development.
• Strong expertise in PySpark, Spark Streaming, and Kafka technologies.
• Experience working on large-scale projects involving big data processing and analytics.