Leads the architecture, delivery, modernization, and operations of enterprise data platforms, warehouses, databases, and engineering solutions. Designs ETL/ELT and CDC pipelines, manages cloud and database environments, improves reliability, security, scalability, and cost efficiency, and drives migrations and strategic initiatives. Provides technical leadership, mentors engineers, coordinates cross-functional projects, manages incidents and root-cause analysis, supports capacity planning, and collaborates with security, cloud, SRE, analytics, and business teams.
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Lead Data Engineer
Lead Data Engineer
Overview:
We are seeking an experienced Lead Data Engineer to lead the design, delivery, modernization, and operational management of enterprise data platforms, databases, data warehouses, and data engineering solutions.
The role is responsible for providing technical leadership across Data Engineering, Database Administration, Cloud Data Platforms, and Data Warehouse operations while ensuring the reliability, scalability, security, and cost efficiency of the organization's data ecosystem.
The ideal candidate will possess strong expertise in data engineering, database technologies, cloud platforms, data warehousing, ETL/ELT, CDC, and platform operations, combined with proven leadership experience in managing projects, driving strategic initiatives, mentoring teams, and collaborating across multiple technology functions.
This role will partner closely with Data Engineering, DBA, Cloud Engineering, SRE, Security, Analytics, and Business teams to deliver scalable and business-aligned data solutions.
Key Responsibilities
Technical Leadership & Architecture
Provide technical leadership for Data Engineering, Data Warehouse, and Database initiatives.
Define and drive architecture standards, engineering best practices, and platform governance.
Design scalable, secure, and high-performance data solutions across cloud and on-premise environments.
Lead technical design reviews, solution assessments, and modernization initiatives.
Mentor engineers and foster a culture of engineering excellence and continuous improvement.
Data Engineering & Data Warehouse
Design, develop, and oversee enterprise ETL/ELT and CDC pipelines.
Manage data integration across relational, NoSQL, SaaS, and cloud-based platforms.
Design and optimize data warehouse, lakehouse, and analytical solutions using technologies such as Snowflake, Databricks, Apache Iceberg, and Amazon S3.
Ensure data quality, reliability, observability, and operational readiness of all data products.
Drive adoption of reusable frameworks, automation, and standardized engineering practices.
Database & Platform Management
Provide oversight of enterprise database environments including PostgreSQL, MySQL, Aurora PostgreSQL, Aurora MySQL, MongoDB Atlas, and DynamoDB.
Ensure database availability, performance, security, backup, recovery, and capacity planning.
Collaborate with DBA, SRE, and Cloud teams on performance tuning, incident resolution, disaster recovery, and operational improvements.
Establish monitoring, alerting, and operational processes for critical platforms.
Project Delivery & Operations
Ensure successful and timely delivery of projects through effective planning, prioritization, and execution.
Track project progress, dependencies, risks, and milestones.
Proactively identify and remove blockers impacting team productivity and project delivery.
Lead incident management and root cause analysis activities while driving preventive actions.
Continuously improve operational processes, runbooks, and service reliability.
Strategic Initiatives & Optimization
Drive modernization initiatives including migration from legacy platforms to cloud-native solutions.
Evaluate emerging technologies and conduct proof-of-concepts to support business objectives.
Lead cost optimization efforts across cloud platforms, licenses, and data infrastructure.
Partner with FinOps and platform teams to improve platform utilization and operational efficiency.
Identify opportunities to simplify architecture, reduce technical debt, and improve scalability.
Resource & Capacity Planning
Support workforce planning by forecasting resource needs for BAU activities and project initiatives.
Align team objectives with business priorities, strategic initiatives, and individual development plans.
Participate in hiring, onboarding, and succession planning activities.
Balance workloads and capacity across multiple projects and operational responsibilities.
Stakeholder & People Leadership
Foster strong collaboration across Data Engineering, DBA, SRE, Cloud, Security, BI, and application teams.
Establish regular stakeholder engagement to provide project updates, address challenges, and align priorities.
Conduct performance reviews, career development discussions, coaching, and mentoring activities.
Promote a culture of accountability, inclusion, innovation, and continuous learning.
Recognize and encourage outstanding team contributions and achievements.
Required Skills & Experience
Core Requirements:
8+ years of experience in Data Engineering, Database Engineering, Data Warehousing, or related disciplines.
Strong experience with Python, SQL, PySpark, ETL/ELT, and CDC-based architectures.
Expertise in relational databases including PostgreSQL, MySQL, Aurora PostgreSQL, and Aurora MySQL.
Strong understanding of database administration concepts including performance tuning, indexing, partitioning, backup/recovery, replication, and capacity planning.
Experience designing and managing enterprise data warehouses, data lakes, and lakehouse platforms.
Experience with cloud-based data services and modern analytics platforms.
Cloud & Data Platforms:
Strong expertise in AWS services including AWS Glue, S3, DMS, DynamoDB, IAM, VPC, and CloudWatch.
Hands-on experience with Snowflake, Databricks, Apache Iceberg, or equivalent modern data platforms.
Understanding of cloud security, governance, and cost optimization practices.
Leadership & Operations:
Proven experience leading technical teams and complex cross-functional projects.
Strong stakeholder management and communication skills.
Experience managing incidents, RCAs, service reliability, and production support activities.
Experience with Agile delivery methodologies, CI/CD, GitLab, and Infrastructure as Code (Terraform).
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Lead Data Engineer
Lead Data Engineer
Overview:
We are seeking an experienced Lead Data Engineer to lead the design, delivery, modernization, and operational management of enterprise data platforms, databases, data warehouses, and data engineering solutions.
The role is responsible for providing technical leadership across Data Engineering, Database Administration, Cloud Data Platforms, and Data Warehouse operations while ensuring the reliability, scalability, security, and cost efficiency of the organization's data ecosystem.
The ideal candidate will possess strong expertise in data engineering, database technologies, cloud platforms, data warehousing, ETL/ELT, CDC, and platform operations, combined with proven leadership experience in managing projects, driving strategic initiatives, mentoring teams, and collaborating across multiple technology functions.
This role will partner closely with Data Engineering, DBA, Cloud Engineering, SRE, Security, Analytics, and Business teams to deliver scalable and business-aligned data solutions.
Key Responsibilities
Technical Leadership & Architecture
Provide technical leadership for Data Engineering, Data Warehouse, and Database initiatives.
Define and drive architecture standards, engineering best practices, and platform governance.
Design scalable, secure, and high-performance data solutions across cloud and on-premise environments.
Lead technical design reviews, solution assessments, and modernization initiatives.
Mentor engineers and foster a culture of engineering excellence and continuous improvement.
Data Engineering & Data Warehouse
Design, develop, and oversee enterprise ETL/ELT and CDC pipelines.
Manage data integration across relational, NoSQL, SaaS, and cloud-based platforms.
Design and optimize data warehouse, lakehouse, and analytical solutions using technologies such as Snowflake, Databricks, Apache Iceberg, and Amazon S3.
Ensure data quality, reliability, observability, and operational readiness of all data products.
Drive adoption of reusable frameworks, automation, and standardized engineering practices.
Database & Platform Management
Provide oversight of enterprise database environments including PostgreSQL, MySQL, Aurora PostgreSQL, Aurora MySQL, MongoDB Atlas, and DynamoDB.
Ensure database availability, performance, security, backup, recovery, and capacity planning.
Collaborate with DBA, SRE, and Cloud teams on performance tuning, incident resolution, disaster recovery, and operational improvements.
Establish monitoring, alerting, and operational processes for critical platforms.
Project Delivery & Operations
Ensure successful and timely delivery of projects through effective planning, prioritization, and execution.
Track project progress, dependencies, risks, and milestones.
Proactively identify and remove blockers impacting team productivity and project delivery.
Lead incident management and root cause analysis activities while driving preventive actions.
Continuously improve operational processes, runbooks, and service reliability.
Strategic Initiatives & Optimization
Drive modernization initiatives including migration from legacy platforms to cloud-native solutions.
Evaluate emerging technologies and conduct proof-of-concepts to support business objectives.
Lead cost optimization efforts across cloud platforms, licenses, and data infrastructure.
Partner with FinOps and platform teams to improve platform utilization and operational efficiency.
Identify opportunities to simplify architecture, reduce technical debt, and improve scalability.
Resource & Capacity Planning
Support workforce planning by forecasting resource needs for BAU activities and project initiatives.
Align team objectives with business priorities, strategic initiatives, and individual development plans.
Participate in hiring, onboarding, and succession planning activities.
Balance workloads and capacity across multiple projects and operational responsibilities.
Stakeholder & People Leadership
Foster strong collaboration across Data Engineering, DBA, SRE, Cloud, Security, BI, and application teams.
Establish regular stakeholder engagement to provide project updates, address challenges, and align priorities.
Conduct performance reviews, career development discussions, coaching, and mentoring activities.
Promote a culture of accountability, inclusion, innovation, and continuous learning.
Recognize and encourage outstanding team contributions and achievements.
Required Skills & Experience
Core Requirements:
8+ years of experience in Data Engineering, Database Engineering, Data Warehousing, or related disciplines.
Strong experience with Python, SQL, PySpark, ETL/ELT, and CDC-based architectures.
Expertise in relational databases including PostgreSQL, MySQL, Aurora PostgreSQL, and Aurora MySQL.
Strong understanding of database administration concepts including performance tuning, indexing, partitioning, backup/recovery, replication, and capacity planning.
Experience designing and managing enterprise data warehouses, data lakes, and lakehouse platforms.
Experience with cloud-based data services and modern analytics platforms.
Cloud & Data Platforms:
Strong expertise in AWS services including AWS Glue, S3, DMS, DynamoDB, IAM, VPC, and CloudWatch.
Hands-on experience with Snowflake, Databricks, Apache Iceberg, or equivalent modern data platforms.
Understanding of cloud security, governance, and cost optimization practices.
Leadership & Operations:
Proven experience leading technical teams and complex cross-functional projects.
Strong stakeholder management and communication skills.
Experience managing incidents, RCAs, service reliability, and production support activities.
Experience with Agile delivery methodologies, CI/CD, GitLab, and Infrastructure as Code (Terraform).
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard's security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
Mastercard Mumbai, Maharashtra, IND Office
Mastercard Mumbai, India Office
Bandra Kurla Complex Road, Mumbai, Maharashtra, India, 400051
Similar Jobs at Mastercard
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead technical design and engineering standards for scalable data platforms using Databricks, Spark, Python, PySpark, and dbt. Own architecture reviews, CI/CD, DataOps, observability, platform administration, deployment governance, migrations, and upgrades. Resolve complex platform challenges, mentor engineers, and guide code quality. Partner with stakeholders on roadmaps, prioritization, and technical trade-offs while supporting Mastercard’s cloud strategy.
Top Skills:
SparkCi/CdDatabricksDatabricks Asset BundlesDataopsDbtGitlabJenkinsPysparkPythonTest-Driven Development (Tdd)
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads the design, development, deployment, and support of scalable data pipelines and platforms across Hadoop, on-premises, and AWS cloud environments. Builds batch and near-real-time processing frameworks, modernizes ETL and data warehouse workloads, implements governance and observability capabilities, and troubleshoots production issues. Mentors engineers, collaborates with cross-functional stakeholders, evaluates emerging technologies, and ensures secure, high-quality delivery for enterprise-scale data ecosystems.
Top Skills:
Amazon DynamodbAmazon EmrAmazon S3Apache AirflowApache HiveApache NifiSparkAWSAws GlueCassandraCloud Object StorageData LakehousesData LakesEnterprise Data WarehousesETLHadoopJavaOracleScalaSQLSQL Server
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Supports software engineering activities including programming, testing, implementation, documentation, maintenance, and software delivery. Develops secure, scalable solutions, researches technical alternatives, follows quality and audit standards, reports project metrics, and improves development processes. Collaborates with geographically distributed teams and learns new technologies, frameworks, and tools.
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
