Quantiphi Logo

Quantiphi

Senior Data Engineer - KStream

Sorry, this job was removed at 07:51 a.m. (IST) on Tuesday, Jan 21, 2025
Be an Early Applicant
Mumbai, Maharashtra
Mumbai, Maharashtra

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Experience : 4 to 6 Years

Location : Mumbai/ Pune (Hybrid)

Role: Senior Data Engineer

Required Skills:

  • Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

  • In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.

  • Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.

  • Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.

  • Ability to design and implement complex data processing pipelines in PySpark.

  • Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.

  • Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.

  • Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

  • Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

  • Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

  • Experience building and supporting large-scale systems in a production environment.

  • Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.

 

Good to have skills:

  • Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.

  • Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.

  • Prior experience of working on AWS Migration Acceleration Programs for customers.

  • Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.

  • Experience using Github/codecommit for developmental activities 

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Similar Jobs

2 Hours Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Fintech • Software
Lead the development of high frequency trading strategies and predictive models, using machine learning and statistics. Collaborate with traders to improve models and influence trading approaches.
Top Skills: Machine LearningPythonStatistics
3 Hours Ago
Easy Apply
Hybrid
Pune, Maharashtra, IND
Easy Apply
Mid level
Mid level
Healthtech • Information Technology • Software • Telehealth
Lead a team of analysts in data analytics and visualization to empower stakeholders with actionable insights and drive decision-making.
Top Skills: LookerLookmlExcelPythonSQL
4 Hours Ago
Hybrid
2 Locations
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
As a Business Technology Solutions Consultant, you will design and implement enterprise data management strategies, develop data governance frameworks, and build scalable cloud-based solutions while collaborating with stakeholders to optimize data utilization.
Top Skills: AWSAzureDatabricksETLNoSQLPythonRSnowflakeSQL

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account