Design, develop, maintain, and optimize scalable ETL pipelines and data workflows for a large-scale analytics platform. Ensure data reliability, manage production pipelines, resolve tickets within SLA, support P1/P2 incident resolution, and collaborate with data and application development teams. The role is based onsite in Mumbai and requires client site visits.
Location: Mumbai (On-Site)
Experience: 5+ years
About the Role: Join our AMS team supporting a large-scale analytics platform for a major Oil & Gas enterprise. You will design and develop data pipelines, optimize workflows, and ensure data reliability across large-scale data assets.
Key Technologies:
• AWS Glue, Lambda, Redshift, Aurora PostgreSQL
• MSK Kafka, AWS SQS
• Apache Airflow
• SQL, Python
What You'll Do:
• Build & maintain scalable ETL pipelines
• Optimize data workflows and transformations
• Resolve production tickets within SLA
• Support P1/P2 incident resolution
• Collaborate with Data Lead and App Dev teams
Requirements:
• 5+ years in Data Engineering
• Strong AWS data services experience
• Expert SQL and Python skills
• Experience with production pipeline management
• Mumbai based (client site visits required)
Nice to Have:
• Experience in Oil & Gas domain / large enterprise analytics
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develops and maintains data engineering solutions involving ingestion, aggregation, processing, curation, modeling, and analysis of high-volume data. Uses Cloudera, Databricks, AWS, Python, PySpark, SQL, and related tools to unify data assets, generate insights, support business intelligence, and enable fraud, security, and digital identity products. Partners with product, data science, platform, technology, client, and sales teams to deliver data solutions, prototypes, and enhancements.
Top Skills:
Apache NifiAWSAzure Data FactoryCloudera AiCloudera Data EngineeringDatabricksEltETLGraph DatabaseHadoopImpalaNumpyPandasPentahoPysparkPythonSQLTalend
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Designs, develops, and supports scalable cloud data pipelines, transformations, data models, and reporting datasets. Partners with engineering, business intelligence, and business teams to deliver reliable, governed data solutions. Monitors and troubleshoots production processes, improves performance and reliability, contributes to data quality and documentation standards, and participates in code reviews and engineering best practices.
Top Skills:
SparkDatabricksDbtSnowflakeSQL
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Build data engineering solutions that ingest, aggregate, unify, and analyze high-volume data from diverse sources. Develop data pipelines and models using Cloudera, Databricks, AWS, Hadoop, Python, and SQL. Partner with product, data science, platform, technology, client, and sales teams to deliver actionable insights, prototypes, business intelligence, and innovative cyber, fraud, security, and digital identity products.
Top Skills:
Apache NifiAWSAzure Data FactoryCloudera AiCloudera Data EngineeringDatabricksGraph DatabaseHadoopImpalaNumpyPandasPentahoPysparkPythonSQLTalend
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
