Lead a team of three data engineers supporting a large-scale analytics platform. Manage and optimize ETL pipelines, data transformations, monitoring, reliability, production incidents, and SLA-driven enhancements. Collaborate with business advisory teams and maintain operational runbooks and documentation. Participate in a 24x7 P1 incident rotation, including weekend and night on-call coverage, and work from the Mumbai client site as required.
About the Role:
We are looking for a Data Engineering Lead to join our AMS team supporting a large scale analytics platform for a major Oil & Gas enterprise. You will lead the data engineering track, managing ETL pipelines, data transformations, and ensuring platform reliability.
Key Technologies:
• AWS Glue, AWS Lambda, Amazon Redshift, Aurora PostgreSQL
• MSK Kafka, AWS SQS, AWS Transfer Family
• Apache Airflow (orchestration)
• SQL, Python
What You'll Do:
• Lead a team of 3 data engineers in maintaining & enhancing large-scale data assets
• Own ETL pipeline performance, monitoring & optimization
• Handle production incidents (24x7 rotation for P1 issues)
• Drive enhancements within defined SLA timelines
• Collaborate with client business advisory team
• Create & maintain runbooks and documentation
Requirements:
• 8+ years in Data Engineering with leadership experience
• Expert in AWS data services (Glue, Redshift, Aurora)
• Strong SQL and Python skills
• Experience managing production data pipelines at scale
• Ability to work from Mumbai (client site as required)
• Available for weekend/night on-call rotation
Nice to Have: - Experience in Oil & Gas domain / large enterprise analytics
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads the engineering strategy and delivery of AI-ready data products from requirements through production. Architects reusable pipelines, deployment standards, CI/CD, testing, observability, and DevSecOps practices. Partners with product owners and global commercial stakeholders to translate business needs into technical solutions. Builds and mentors an India-based AI data engineering team, establishes engineering standards, and oversees contractors and vendors.
Top Skills:
Amazon SagemakerAWSAzureBootstrapCollibraDataiku DssDockerGithub ActionsGxpHipaaHTMLKubernetesPower BIPythonReactSnowflakeSoc 2SQLStreamlitTableauTailwind CssVue
Fintech • Financial Services
Leads software engineering teams delivering Generative AI and data engineering solutions. Responsibilities include technical leadership, mentoring, resource and risk management, process improvement, stakeholder collaboration, engineering standards, testing, governance, and delivery oversight. The role drives scalable, secure cloud-native solutions involving LLMs, AI assistants, RAG, agentic workflows, and responsible AI while aligning technology roadmaps with business objectives.
Top Skills:
Agentic WorkflowsAi AgentsAi AssistantsAPIsAWSCi/CdContainersDjangoFastapiGenai GovernanceGenerative AiLarge Language Models (Llms)MicroservicesPrompt EngineeringPythonReactResponsible AiRetrieval-Augmented Generation (Rag)
Fintech • Financial Services
Build and maintain data architectures, pipelines, warehouses, and lakes that ensure accurate, accessible, secure, and reliable data. Develop processing and analysis algorithms for complex, high-volume data and collaborate with data scientists to deploy machine learning models. Set technical strategy, advise senior stakeholders, manage risks and controls, guide technical direction, lead teams or specialist assignments, and drive continuous improvements aligned with business objectives.
Top Skills:
Data LakesData PipelinesData WarehousesMachine Learning
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
