Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark. Optimize and manage large datasets in Google BigQuery, ensure data quality, build job orchestration with Airflow, write efficient SQL, and collaborate with data scientists, analysts and product teams to deliver analytics-ready data and documentation.
Job Title: Data Engineer (Python, PySpark, BigQuery)
Location: Mumbai (Onsite)
Experience: 7+ Years
Employment Type: Full-Time
Job Summary:
We are looking for a highly experienced Data Engineerwith deep expertise in Python, PySpark, and BigQuery to join our data engineering team in Mumbai. The ideal candidate will be responsible for building and maintaining large-scale data pipelines and data infrastructure to support real-time and batch analytics across the organization.
Key Responsibilities:
- Design, develop, and maintain efficient and scalable ETL/ELT data pipelines using Python and PySpark
- Manage and optimize large datasets in Google BigQuery, ensuring high performance and cost efficiency
- Work closely with Data Scientists, Analysts, and Product Teams to understand data needs and deliver timely solutions
- Perform data modeling, transformation, and integration from multiple data sources
- Ensure data quality, validation, and integrity across all systems and workflows
- Build and maintain job orchestration and scheduling using tools like Apache Airflow
- Write efficient SQL queries and scripts for data extraction and reporting
- Maintain clear documentation of data workflows, architecture, and business logic
Must-Have Skills:
- 7+ years of hands-on experience in Data Engineering
- Strong programming skills in Python, with expertise in writing modular, production-ready code
- Proficiency in PySpark for distributed data processing
- Solid experience working with Google BigQuery, including query optimization and data management
- Strong SQL skills and experience with relational and columnar databases
- Experience with job orchestration tools like Apache Airflow (or similar)
- Excellent problem-solving and analytical skills
- Familiarity with version control tools like Git
Similar Jobs
Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Design and prototype intuitive, accessible enterprise web interfaces; create design systems and reusable components; conduct user research and usability testing; collaborate with product, engineering, and QA to ensure high-quality implementation and continuous UX improvements.
Top Skills:
Adobe XdBolt.NewChatgptClaudeFigmaFigma AiGalileo AiJIRALovableSix SigmaSketchUizardV0 By VercelWcag
Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Leads complex technology initiatives through planning, execution, monitoring, and closure. Manages integrated schedules, budgets, resources, risks, dependencies, governance, and delivery commitments. Coordinates engineering, product, architecture, infrastructure, security, and operations stakeholders. Oversees Agile and Waterfall practices, release planning, sprint execution, readiness activities, executive reporting, dashboards, and performance metrics. Uses enterprise-authorized AI capabilities to improve planning, forecasting, reporting, and decision support.
Top Skills:
AgileConfluenceJIRASafeSdlcWaterfall
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Provides technical leadership for pre-sales activities, designing integrated solutions and advising enterprise customers on cloud data management, backup, disaster recovery, analytics, distributed architectures, and storage. Leads technical sales calls, presentations, demonstrations, opportunity qualification, and customer consultations while partnering with account teams and clients to support regional revenue goals.
Top Skills:
Backup And Disaster RecoveryCloud Data ManagementData AnalyticsDistributed ArchitecturesFile SystemsSan
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
