Design, develop, maintain, and optimize scalable ETL pipelines and data workflows for a large-scale analytics platform. Ensure data reliability, manage production pipelines, resolve tickets within SLA, support P1/P2 incident resolution, and collaborate with data and application development teams. The role is based onsite in Mumbai and requires client site visits.
Location: Mumbai (On-Site)
Experience: 5+ years
About the Role: Join our AMS team supporting a large-scale analytics platform for a major Oil & Gas enterprise. You will design and develop data pipelines, optimize workflows, and ensure data reliability across large-scale data assets.
Key Technologies:
• AWS Glue, Lambda, Redshift, Aurora PostgreSQL
• MSK Kafka, AWS SQS
• Apache Airflow
• SQL, Python
What You'll Do:
• Build & maintain scalable ETL pipelines
• Optimize data workflows and transformations
• Resolve production tickets within SLA
• Support P1/P2 incident resolution
• Collaborate with Data Lead and App Dev teams
Requirements:
• 5+ years in Data Engineering
• Strong AWS data services experience
• Expert SQL and Python skills
• Experience with production pipeline management
• Mumbai based (client site visits required)
Nice to Have:
• Experience in Oil & Gas domain / large enterprise analytics
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, implement, automate, and maintain large-scale enterprise ETL processes for global clients. Deliver robust data solutions, validate and test data, apply engineering best practices, participate in code reviews, and collaborate across global teams. The role also requires managing multiple priorities, providing technical oversight and quality control, and supporting secure, compliant data practices.
Top Skills:
DatabricksETLPysparkPythonSource Control
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Build and operate a self-service data commercialization platform spanning web experiences, APIs, cloud infrastructure, lakehouse systems, and automation. Develop scalable data platforms using Python, Spark, Databricks, orchestration, Java, React, and cloud services. Design secure, reliable workflows with observability, access controls, infrastructure as code, CI/CD, and multi-cloud architecture. Collaborate on technical trade-offs and integrate distributed systems, databases, and AI-powered capabilities.
Top Skills:
Amazon EmrApache AirflowApache IcebergSparkAWSAws CdkAzureCi/CdCloudFormationDatabricksDelta LakeFlinkGraphQLJavaJavaScriptKafkaKubernetesLakehouseNosql DatabasesObject StoragePysparkPythonReactRelational DatabasesRest ApisSnowflakeSpring BootTerraformTerraformTrinoTypescriptUnity Catalog
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Build and maintain petabyte-scale data pipelines, entity-centric data models, and distributed workflows using Databricks and Spark. Partner with data science teams to productionize ML features and artifacts, optimize ETL/ELT processes, and implement testing, monitoring, observability, and incident response. Collaborate with governance and operations teams to ensure secure, compliant data management while supporting scalable merchant identity and trust-profile systems.
Top Skills:
SparkAWSCi/CdDatabricksGCPPythonSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
