Design, develop, maintain, and optimize scalable ETL pipelines and data workflows for a large-scale analytics platform. Ensure data reliability, manage production pipelines, resolve tickets within SLA, support P1/P2 incident resolution, and collaborate with data and application development teams. The role is based onsite in Mumbai and requires client site visits.
Location: Mumbai (On-Site)
Experience: 5+ years
About the Role: Join our AMS team supporting a large-scale analytics platform for a major Oil & Gas enterprise. You will design and develop data pipelines, optimize workflows, and ensure data reliability across large-scale data assets.
Key Technologies:
• AWS Glue, Lambda, Redshift, Aurora PostgreSQL
• MSK Kafka, AWS SQS
• Apache Airflow
• SQL, Python
What You'll Do:
• Build & maintain scalable ETL pipelines
• Optimize data workflows and transformations
• Resolve production tickets within SLA
• Support P1/P2 incident resolution
• Collaborate with Data Lead and App Dev teams
Requirements:
• 5+ years in Data Engineering
• Strong AWS data services experience
• Expert SQL and Python skills
• Experience with production pipeline management
• Mumbai based (client site visits required)
Nice to Have:
• Experience in Oil & Gas domain / large enterprise analytics
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and deploys scalable Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake across medallion layers. Builds HR data models, source-to-target mappings, reconciliation controls, governance, lineage, documentation, and data quality processes. Modernizes legacy Informatica and SQL integrations, including Oracle HCM feeds. Collaborates with distributed agile teams, mentors junior engineers, and supports production cutovers for sensitive employee data.
Top Skills:
Ai/Copilot ToolingSparkAzure Data FactoryAzure Data Lake StorageAzure DevopsAzure SqlAzure SynapseCi/CdCrunchrDatabricksDelta LakeGitInformaticaOracle Hcm CloudPower BIPysparkSpark SqlSQLUnity Catalog
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Design and build scalable cloud-based data solutions, develop ETL pipelines for warehouses and data lakes, enforce data quality, optimize processing and storage, collaborate with data and product teams, and mentor other engineers. The role requires expertise in Python, PySpark, SQL, Databricks, AWS services, data modeling, medallion architecture, and scheduling technologies.
Top Skills:
AecorsoftAlteryxAmazon RedshiftApache AirflowAws Ec2Aws GlueAws LambdaAws S3DatabricksDatabricks NotebooksDatasphereDimensional ModelingErwinETLExcelFact And DimensionsGeminiGenbiGenieKiroLakeflow ConnectLakeflow JobsMedallion ArchitecturePower BIPysparkPythonRScd TypesSQLStar SchemaTableau
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and delivers scalable data engineering solutions across Azure and on-premises environments. Builds batch and real-time ETL/ELT pipelines, data lakes, warehouses, marts, and streaming platforms using Spark and related Big Data technologies. Leads architecture, technical design, optimization, governance, and end-to-end implementation while ensuring quality, security, reliability, and performance. Collaborates with cross-functional stakeholders, mentors data engineers, and communicates technical recommendations to business and technology audiences.
Top Skills:
Apache NifiSparkAzureAzure Data FactoryAzure DatabricksAzure DevopsAzure Event HubsAzure FunctionsAzure Synapse AnalyticsCi/CdCosmos DbData LakesData MartsData WarehousesEltETLGitHadoopHbaseHiveKafkaMedallion ArchitectureMongoDBNoSQLPythonScalaSQLUnix Shell Scripting
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
