Quantiphi Logo

Quantiphi

Senior Data Engineer - Databricks

Posted 4 Days Ago
Be an Early Applicant
Mumbai, Maharashtra
Senior level
Mumbai, Maharashtra
Senior level
The Senior Data Engineer will design and implement data solutions using Databricks, PySpark, and other cloud-based technologies. Responsibilities include developing data pipelines, optimizing queries, and managing ETL projects, as well as leveraging AWS services and orchestration tools like Airflow. The ideal candidate should have significant hands-on experience and a strong background in data integration and cloud systems.
The summary above was generated by AI

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Must have skills:

  • 3+ years’ of hands-on experience in delivering data solutions

  • Experience with Databricks implementations - developing data pipelines using PySpark

  • Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs

  • Experience in Python, Scala

  • Experience in advanced SQL and Query optimization 

  • Experience in implementing data integration projects using ETL 

  • Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2 

Good to have skills : 

  • Experience with AWS services - S3,Redshift,Secrets Manager

  • Experience in implementing data integration projects using ETL (preferably Qlik Replicate & QlikCompose)

  • Experience in using Airflow or Step Functions for orchestration

  • Exposure to IaC tools like Terraform and to CI/CD tools

  • Prior experience in migrating (on-prem to cloud) and processing large amounts of data

  • Experience in implementing data lake and data warehouse on cloud

  • Experience in implementing the industry's best practices

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

Python
Scala
SQL

Similar Jobs

Be an Early Applicant
2 Days Ago
3 Locations
10,000 Employees
Senior level
10,000 Employees
Senior level
Cloud • Information Technology • Sales • Security • Cybersecurity
As a Senior Data Engineer, you will develop and optimize data pipelines, design and implement data models, and ensure data quality for various business functions, particularly in Sales and Marketing. You will collaborate with cross-functional teams to meet reporting and ad hoc requests while monitoring and troubleshooting ETL workflows.
Be an Early Applicant
7 Days Ago
Pune, Maharashtra, IND
Hybrid
1,100 Employees
Senior level
1,100 Employees
Senior level
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
As a Senior Data Engineer at LogicMonitor, you will design, develop, and maintain data solutions while collaborating with stakeholders to create data pipelines, optimize dashboards and frameworks, and resolve data transformation issues, driving data security and architecture management.
10 Days Ago
Pune, Maharashtra, IND
Remote
6,000 Employees
Senior level
6,000 Employees
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account