Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark. Optimize and manage large datasets in Google BigQuery, ensure data quality, build job orchestration with Airflow, write efficient SQL, and collaborate with data scientists, analysts and product teams to deliver analytics-ready data and documentation.
Job Title: Data Engineer (Python, PySpark, BigQuery)
Location: Mumbai (Onsite)
Experience: 7+ Years
Employment Type: Full-Time
Job Summary:
We are looking for a highly experienced Data Engineerwith deep expertise in Python, PySpark, and BigQuery to join our data engineering team in Mumbai. The ideal candidate will be responsible for building and maintaining large-scale data pipelines and data infrastructure to support real-time and batch analytics across the organization.
Key Responsibilities:
- Design, develop, and maintain efficient and scalable ETL/ELT data pipelines using Python and PySpark
- Manage and optimize large datasets in Google BigQuery, ensuring high performance and cost efficiency
- Work closely with Data Scientists, Analysts, and Product Teams to understand data needs and deliver timely solutions
- Perform data modeling, transformation, and integration from multiple data sources
- Ensure data quality, validation, and integrity across all systems and workflows
- Build and maintain job orchestration and scheduling using tools like Apache Airflow
- Write efficient SQL queries and scripts for data extraction and reporting
- Maintain clear documentation of data workflows, architecture, and business logic
Must-Have Skills:
- 7+ years of hands-on experience in Data Engineering
- Strong programming skills in Python, with expertise in writing modular, production-ready code
- Proficiency in PySpark for distributed data processing
- Solid experience working with Google BigQuery, including query optimization and data management
- Strong SQL skills and experience with relational and columnar databases
- Experience with job orchestration tools like Apache Airflow (or similar)
- Excellent problem-solving and analytical skills
- Familiarity with version control tools like Git
Similar Jobs
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Advanced Data Science Associate Consultant will develop algorithms, execute statistical techniques, collaborate with clients, and integrate engineering principles into data science workflows.
Top Skills:
Advanced AnalyticsBig DataDeep LearningGenerative AiJavaPythonR
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Data Architect Lead is responsible for designing scalable architecture solutions, engaging with clients, and innovating technology assets while mentoring juniors and driving business growth.
Top Skills:
Advanced AnalyticsAIApplication Portfolio AssessmentBig Data TechnologiesCloud StrategyIt TransformationMl
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Engineering Lead will design and implement technical features, work on ML pipelines, and mentor engineers while ensuring high-quality deliverables. This role requires collaborating with teams and managing the ML lifecycle for business value.
Top Skills:
Apache KafkaAWSAws KinesisAzureDeep LearningGCPHadoopHiveJavaKubeflowLangchainLlamaindexMachine LearningMl EngineeringMlflowPysparkPythonRabbit MqSagemakerScalaSpark
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
