Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark. Optimize and manage large datasets in Google BigQuery, ensure data quality, build job orchestration with Airflow, write efficient SQL, and collaborate with data scientists, analysts and product teams to deliver analytics-ready data and documentation.
Job Title: Data Engineer (Python, PySpark, BigQuery)
Location: Mumbai (Onsite)
Experience: 7+ Years
Employment Type: Full-Time
Job Summary:
We are looking for a highly experienced Data Engineerwith deep expertise in Python, PySpark, and BigQuery to join our data engineering team in Mumbai. The ideal candidate will be responsible for building and maintaining large-scale data pipelines and data infrastructure to support real-time and batch analytics across the organization.
Key Responsibilities:
- Design, develop, and maintain efficient and scalable ETL/ELT data pipelines using Python and PySpark
- Manage and optimize large datasets in Google BigQuery, ensuring high performance and cost efficiency
- Work closely with Data Scientists, Analysts, and Product Teams to understand data needs and deliver timely solutions
- Perform data modeling, transformation, and integration from multiple data sources
- Ensure data quality, validation, and integrity across all systems and workflows
- Build and maintain job orchestration and scheduling using tools like Apache Airflow
- Write efficient SQL queries and scripts for data extraction and reporting
- Maintain clear documentation of data workflows, architecture, and business logic
Must-Have Skills:
- 7+ years of hands-on experience in Data Engineering
- Strong programming skills in Python, with expertise in writing modular, production-ready code
- Proficiency in PySpark for distributed data processing
- Solid experience working with Google BigQuery, including query optimization and data management
- Strong SQL skills and experience with relational and columnar databases
- Experience with job orchestration tools like Apache Airflow (or similar)
- Excellent problem-solving and analytical skills
- Familiarity with version control tools like Git
Similar Jobs
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Support Compliance Shared Services by performing AML/KYC due diligence, screening and monitoring clients using systems like Factiva, handling email surveillance, preparing risk and compliance reports, administering conflict-of-interest systems, maintaining SOPs, and assisting training activities (Trellis). Collaborate with global compliance teams and escalate investigations to local compliance officers.
Top Skills:
E-Mail Surveillance ToolsFactivaTrellis
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Lead end-to-end delivery of complex initiatives as a client-facing Senior Project Manager and Scrum Master. Facilitate Scrum ceremonies, coach Agile teams, manage project scope, timelines, risks, dependencies, stakeholder communication, and reporting. Drive continuous improvement, monitor Agile metrics, and ensure alignment across global product, technology, operations, and client stakeholders.
Top Skills:
AgileAsanaConfluenceJIRASafeSdlc
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Perform quantitative and qualitative analysis of loans and properties underlying CMBS transactions; monitor pool and property performance; identify and report on credit risks and potential defaults; write monthly research reports and transaction summaries; support onshore team and respond to internal/external inquiries.
Top Skills:
Excel
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
