Design, develop, maintain, and optimize scalable ETL pipelines and data workflows for a large-scale analytics platform. Ensure data reliability, manage production pipelines, resolve tickets within SLA, support P1/P2 incident resolution, and collaborate with data and application development teams. The role is based onsite in Mumbai and requires client site visits.
Location: Mumbai (On-Site)
Experience: 5+ years
About the Role: Join our AMS team supporting a large-scale analytics platform for a major Oil & Gas enterprise. You will design and develop data pipelines, optimize workflows, and ensure data reliability across large-scale data assets.
Key Technologies:
• AWS Glue, Lambda, Redshift, Aurora PostgreSQL
• MSK Kafka, AWS SQS
• Apache Airflow
• SQL, Python
What You'll Do:
• Build & maintain scalable ETL pipelines
• Optimize data workflows and transformations
• Resolve production tickets within SLA
• Support P1/P2 incident resolution
• Collaborate with Data Lead and App Dev teams
Requirements:
• 5+ years in Data Engineering
• Strong AWS data services experience
• Expert SQL and Python skills
• Experience with production pipeline management
• Mumbai based (client site visits required)
Nice to Have:
• Experience in Oil & Gas domain / large enterprise analytics
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Build and maintain petabyte-scale data pipelines, entity-centric data models, and distributed workflows using Databricks and Spark. Partner with data science teams to productionize ML features and artifacts, optimize ETL/ELT processes, and implement testing, monitoring, observability, and incident response. Collaborate with governance and operations teams to ensure secure, compliant data management while supporting scalable merchant identity and trust-profile systems.
Top Skills:
SparkAWSCi/CdDatabricksGCPPythonSQL
Fintech • Information Technology • Financial Services
Designs, develops, and supports enterprise data platforms using Python, SQL, Airflow, dbt, Snowflake, cloud technologies, and modern data architectures. Responsibilities include building scalable pipelines and reusable frameworks, implementing metadata, lineage, governance, quality, and observability capabilities, integrating Agentic AI, supporting production operations, improving performance and reliability, leading technology evaluations, and mentoring engineers. The role also contributes to Agile delivery, testing, deployments, documentation, demonstrations, and cross-functional platform modernization initiatives.
Top Skills:
Agentic AiAntigravityApache AirflowApache IcebergApache KafkaAWSAzureCi/CdCursorDbtDockerGCPGitKubernetesModel Context Protocol (Mcp)PythonRetrieval-Augmented Generation (Rag)SnowflakeSnowpipeSQLVector DatabasesWindsurf
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develop, test, validate, and support large-scale batch and real-time data platforms using Spark, Kafka, and NiFi. Build resilient data pipelines, validation frameworks, reusable platform components, and deployment automation. Optimize distributed systems for performance, scalability, and reliability; support production operations, monitoring, troubleshooting, and incident resolution. Collaborate on architecture, CI/CD, documentation, and engineering standards while mentoring junior engineers.
Top Skills:
Apache KafkaApache NifiApache OzoneSparkCephCi/CdDockerGitHdfsKubernetesLinuxPysparkPythonScalaShell ScriptingSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
