Ryan Specialty Logo

Ryan Specialty

Senior Data Engineer

Posted 4 Days Ago
Be an Early Applicant
In-Office
Mumbai, Maharashtra
Senior level
In-Office
Mumbai, Maharashtra
Senior level
The Senior Data Engineer will design and optimize data pipelines using Databricks and Spark, lead teams, and manage data workflows.
The summary above was generated by AI

Position Summary:

Job Title: Senior Data Engineer
Location: India
Project: Enterprise Data Hub (EDH)
About the Role
We are seeking a highly skilled and hands-on Senior Data Engineer to join our EDH initiative. This role demands deep expertise in building scalable data pipelines and automation frameworks using Databricks and the Azure ecosystem. The ideal candidate will have a strong engineering mindset, leadership experience, and a passion for solving complex data challenges.

Location:

Mumbai - India

What will your job entail?

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using Databricks and Apache Spark

  • Implement job orchestration and automation using tools like Azure Data Factory, Azure Functions, and DevOps

  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions

  • Lead and mentor junior engineers, ensuring best practices in coding, testing, and deployment

  • Manage and monitor data workflows, ensuring reliability and performance

  • Contribute to architectural decisions and help shape the future of the EDH platform

Required Qualifications

  • 6–7 years of hands-on experience in Databricks and Spark-based data engineering

  • Strong proficiency in the Azure tech stack: Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Functions, etc.

  • Proven experience in job automation, CI/CD pipelines, and workflow orchestration

  • Solid understanding of data modeling, ETL/ELT processes, and performance tuning

  • Experience leading small teams or mentoring engineers in a fast-paced environment

  • Excellent problem-solving and communication skills

Preferred Qualifications

  • Experience with Delta Lake, Unity Catalog, and MLflow

  • Familiarity with data governance and security best practices in cloud environments

  • Exposure to Agile methodologies and DevOps practices

Disclaimer

Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.

Top Skills

Spark
Azure Data Factory
Azure Data Lake
Azure Functions
Azure Synapse
Databricks

Similar Jobs

24 Days Ago
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
Senior level
Senior level
Enterprise Web • Fintech • Financial Services
As a Senior Data Engineer, you'll design and maintain data pipelines, implement data models, and ensure data governance while collaborating across teams to deliver insights and improve data quality.
Top Skills: AirflowDockerKafkaPower BIPythonSnowflakeSQLTableau
5 Days Ago
In-Office
Mumbai, Maharashtra, IND
Senior level
Senior level
Fintech • Software • Financial Services
The Senior Data Engineer is responsible for designing, building, and maintaining the data infrastructure and architecture. They ensure data accuracy and facilitate data accessibility for analytics and business intelligence purposes.
19 Days Ago
Remote or Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Seeking a Senior Data Engineer to design and implement ELT processes, build reliable data pipelines, and utilize AWS for data solutions.
Top Skills: Apache AirflowAWSDbtDockerFlinkHelmJenkinsKafkaKubernetesKustomizeSnowflakeSparkTerraform

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account