The Technical Lead will develop and maintain ELT/ETL pipelines, focusing on data quality and schema enforcement, while utilizing Databricks and PySpark.
Data Engineer - Databricks,Spark / PySpark,Kafka
• Write efficient Pyspark code and libraries for Databricks notebooks using best practices.
• Build and maintain ELT/ETL pipelines using Medallion Architecture.
• Implement batch pipelines using Databricks,Spark / PySpark,Kafka
• Ensure data quality, schema enforcement, and lineage.
• Support ingestion of healthcare data sources with incremental and CDC logic
• Maintaining the code base, code deployment and infra setup for data pipelines .
• Experience in MDM, Data Mart
• Exposure to incentive planning and compensation.
• Experience in healthcare domain
Top Skills
Databricks
Kafka
Pyspark
Spark
Similar Jobs
Insurance
TBD
Software
In this role, you will lead the design and development of applications using Java/J2EE, OSGi, and microservices, while mentoring junior engineers and promoting innovative practices.
Top Skills:
AngularjsElastic SearchHibernateJ2EeJavaKubernetesMicroservicesOsgiRest
Software
The Technical Lead is responsible for analyzing, designing, developing, and testing integrated hardware/software systems, troubleshooting complex issues, and guiding new team members.
Top Skills:
802.1XAncpAutomation TestingCfmDhcpErpsL2/L3 ProtocolsLacpLldpMulticastNetconfPppoeQosRadiusRestSnmpTcp/IpVlanXstp
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
