Mastercard Logo

Mastercard

Sr Data Engineer

Reposted 17 Days Ago
Be an Early Applicant
Hybrid
Pune, Maharashtra
Senior level
Hybrid
Pune, Maharashtra
Senior level
Join the AI Innovation at Scale team to design and execute test strategies, perform white-box and black-box testing, validate data using Impala and Spark, monitor Spark job execution, collect logs, analyze quality data, and work with stakeholders to resolve issues and improve QA processes.
The summary above was generated by AI
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Sr Data Engineer
Overview
The AI Innovation at Scale team is seeking a highly motivated and detail-oriented Quality Assurance Engineer to join our team. This role is critical in ensuring the delivery of high-quality products by assessing requirements, identifying issues, and implementing effective testing strategies. The ideal candidate is curious, detail-oriented, technically skilled, and thrives in a collaborative environment. You will play a key role in improving quality management and continuous improvement.
Role
As a Senior AI Engineer, you will:• Be an integral part of a creative and innovative team, contributing to collaborative projects and sharing insights to drive engineering and data science excellence• Work with cutting-edge big data platforms (e.g., Databricks, Apache Spark) at petabyte scale, pushing the boundaries of data processing and model enablement• Partner closely with Data Science teams to enable seamless R&D, scale models, features, and experimentations into reliable systems• Support the deployment of model features and model artifacts, ensuring seamless integration into production environments and downstream decisioning systems• Write clean, testable, and maintainable code, ensuring solutions are robust, efficient, and production-grade• Design, build, and maintain data pipelines that integrate multiple data sources to support a unified merchant registry and trust profile, enabling richer datasets and unlocking new opportunities for innovation• Collaborate with data operations and governance teams to move and manage data in compliance with security standards, policies, and regulatory requirements• Contribute to the design and evolution of scalable, entity-centric data models that support merchant identity resolution and longitudinal profiling• Automate and maintain data workflows in distributed environments, improving reliability and operational efficiency• Analyze and optimize ETL/ELT processes to support high-performance data access and model execution• Implement testing frameworks and monitoring capabilities to ensure production solutions are reliable, observable, and continuously improving• Support incident response, debugging, and performance tuning of production AI/ML systems
About You
Essential Skills to be successful:• Proven track record of self-directed learning, demonstrating the ability to acquire new skills and knowledge independently• Strong independent research skills and resourcefulness, enabling you to find solutions and innovate in data engineering• Strong understanding of data pipelines and end-to-end ML model development workflows, with exposure to entity-centric data systems• Experience with Python and SQL, showcasing the ability to write clean, readable, and maintainable code• Experience with big data technologies (e.g., Spark, distributed compute frameworks)• Hands-on experience with cloud platforms such as Databricks, AWS, or GCP• Critical thinking and a drive to produce high-quality work, ensuring all solutions meet rigorous standards• Strong communication skills, enabling effective collaboration with team members and stakeholders• Experience collaborating across data science, engineering, and governance teams• Ability and interest in problem-solving, with a proactive approach to tackling challenges• Openness to learn and apply new technologies, staying current with industry trends and advancements• Familiarity with Agile methodologies, with the ability to drive iterative delivery and cross-team collaboration• Bachelor's degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or a related field or equivalent practical experience• Contributions to platform standardization, reusability, and shared tooling across teams
Nice to Have• Experience working in hybrid environments (cloud and on-premises)• Familiarity with ML lifecycle and CI/CD practices for data and ML workflows• Experience with data governance, lineage, and metadata management• Exposure to batch, streaming, or real-time data pipelines and production ML monitoring/observability• Experience supporting high-scale production systems in merchant, fraud, or payment domains• Understanding of security, compliance, and handling sensitive data• Experience designing scalable databases and data models such as business registries• Experience with database updates and maintenance
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

Mastercard Mumbai, Maharashtra, IND Office

Bandra Kurla Complex Road, Mumbai, Maharashtra, India, 400051

Similar Jobs at Mastercard

7 Days Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, build, and maintain scalable batch and near-real-time data pipelines and curated datasets. Enable ML-ready feature datasets, implement reliability patterns, ensure secure data handling and governance, and drive engineering best practices in collaboration with data science, platform, and BI stakeholders.
Top Skills: AWSCi/CdDatabricksDatabricks LakehouseHadoopLakehouse PatternsMlopsObject StoragePysparkPythonS3ScalaSparkSQL
16 Days Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead design and implementation of an Analytic Foundation and scalable big-data services delivered via APIs. Build data pipelines, analytics and data models, responsive UIs, and production ML/data-driven applications. Ensure high-quality, well-tested code, mentor junior engineers, drive process improvements, and collaborate with product and design teams to deliver customer-focused data solutions.
Top Skills: .NetAdvanced StatisticsAirflowC#HadoopHiveImpalaJavaMachine LearningNifiPythonReactReduxScalaSparkSpring BootSQLSQL ServerSqoopTypescript
11 Days Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
This role entails testing and validating big data platforms focusing on real-time and batch processing, ensuring data correctness and system reliability.
Top Skills: Apache NifiSparkCi/CdGitJSONKafkaLinuxPysparkPythonShell ScriptingSQL

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account