Numerator Logo

Numerator

Sr. Data Engineer

Posted 3 Months Ago
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Design, build, and optimize high-volume data pipelines using Python, Databricks and Spark on Azure. Create and maintain automation test suites (Azure DevOps), perform manual/load/exploratory testing, collaborate with BAs and developers to meet sprint goals, and assist with sprint estimation and delivery.
The summary above was generated by AI

 We’re reinventing the market research industry. Let’s reinvent it together.

At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark.

Responsibilities

  • Adhere to coding and Numerator technology standards 

  • Build suitable automation test suites within Azure DevOps 

  • Maintain and update automation test suites as required 

  • Carry out manual testing, load testing, exploratory testing as required 

  • Work closely with Business Analysts and Senior Data Developers to consistently achieve sprint goals 

  • Assist in estimation of sprint-by-sprint stories and tasks 

  • Pro-actively take a responsible approach to product delivery

Requirements

  • 7-10 years of experience in data engineering roles

  • Good Python skills 

  • Experience working with Microsoft Azure Cloud 

  • Experience in Agile methodologies (Scrum/Kanban)

  • Experience with Apache Spark, PySpark, Databricks 

  • Experience working with Devops pipeline, preferably Azure DevOps

Preferred Qualifications

  • Bachelor's or master's degree in computer science, Information Technology, Data Science, or a related field.

  • Experience working in a support focused role 

  • Knowledge/experience in AI ML techniques

  • Certification in relevant Data Engineering discipline or related fields.

There is strength in numbers - We are the Numerati

Numerator is 5,800 employees strong. We have the confidence to be real and embrace what makes each Numerati unique. Our diverse experiences, ideas and backgrounds fuel our innovation.

Being part of the Numerati means that we’ll take care of you! From our Recharge Days, maximum flexibility policy, wellness resources for employees and their families, development opportunities and much more — we’re always finding ways to better support, celebrate and accelerate our team.

Similar Jobs

6 Days Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and maintain software for Atlassian’s Trusted Data Platform. The provided description contains limited role-specific responsibilities, qualifications, technologies, travel requirements, and clearance information.
3 Hours Ago
In-Office or Remote
Senior level
Senior level
Information Technology
Build and maintain scalable data pipelines on Azure Databricks using PySpark, SQL, and Delta Lake. Design dimensional and Gold-layer data models, ingest structured and semi-structured data, implement testing and monitoring, troubleshoot data-quality issues, and follow cataloging, lineage, security, privacy, and regulatory standards. Collaborate with data leads, analysts, data scientists, and AI engineers to deliver reliable datasets and participate in code reviews and platform standards discussions.
Top Skills: AzureAzure DatabricksAzure Event HubsCi/CdDelta LakeGitMariadbPysparkSQL
Yesterday
In-Office or Remote
Senior level
Senior level
Fintech • Food • Payments • Software
Own and operate qlub’s production data platform across ingestion, dbt modeling, BigQuery, Airflow, ClickHouse, GCP infrastructure, data quality, and CI/CD. Build reliable pipelines, optimize performance and cost, troubleshoot production issues, establish engineering standards, and mentor data engineers. Explore practical applications of LLMs and agents for data discovery, monitoring, and troubleshooting while maintaining secure, maintainable systems.
Top Skills: AirbyteApache AirflowApache FlinkAws Ec2Aws RdsAws S3BashCi/CdClickhouseCloud RunCronDatastreamDbtDebeziumDockerFivetranGitGoogle BigqueryGoogle Cloud Platform (Gcp)Google Cloud StorageGreat ExpectationsIamKafkaKubernetesLinuxLlm ApisMonte CarloPostgresPower BIPythonRagSodaSQLSshTableauTerraform

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account