Pyspark Lead Developer
Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With nearly 245,000 employees and business partners across 65 countries, we deliver on the promise of helping our clients, colleagues, and communities thrive in an ever-changing world. Wipro is an Equal Employment Opportunity employer and makes all employment and employment-related decisions without regard to a person's race, sex, national origin, ancestry, disability, sexual orientation, or any other status protected by applicable law.
Website
http://www.wipro.com
The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters
PySpark Expertise-
Strong hands-on experience with PySpark architecture understanding
Clear understanding of how PySpark jobs execute in the background
Ability to read, write, analyze, and enhance PySpark scripts and configurations
SQL Proficiency:
Strong SQL skills
Experience working with SQL as part of data processing and PySpark job execution
Unix Shell Scripting:
Should have good understanding of Unix shell scripting.
Ability to understand backend Unix scripts supporting PySpark workflows
Experience in reading, analyzing, writing, and modifying shell scripts for PySpark integration
ETL Knowledge:
Hands-on experience with ETL processes using any programming language or framework
Ability to understand and work with complementary ETL workflows alongside PySpark
Job Scheduling & Automation
Experience with at least one enterprise scheduling/automation tool such as: Autosys/ ControlM/ Airflow/ or similar tools used in production environments
Nice-to-Have Skills
Experience working with finance domain applications
Familiarity with related frameworks or tools that enhance PySpark-based workflows
Deliver
No.Performance ParameterMeasure1.Continuous Integration, Deployment & Monitoring of Software100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan2.Quality & CSATOn-Time Delivery, Manage software, Troubleshoot queries, Customer experience, completion of assigned certifications for skill upgradation3.MIS & Reporting100% on time MIS & report generation
Mandatory Skills: PySpark .
Experience: 5-8 Years .
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.
SQL Proficiency:
Strong SQL skills
Experience working with SQL as part of data processing and PySpark job execution
Unix Shell Scripting:
Should have good understanding of Unix shell scripting.
Ability to understand backend Unix scripts supporting PySpark workflows
Experience in reading, analyzing, writing, and modifying shell scripts for PySpark integration
