Build and maintain scalable data pipelines for a global fintech engagement using Azure Databricks, PySpark, SQL, and Delta Lake. Develop Bronze, Silver, and Gold data layers, optimize data models, implement validation and monitoring, troubleshoot data quality issues, and follow governance, security, cataloging, and lineage standards while collaborating with data and engineering teams.
This is a remote position.
Shuru is an AI-native technology and engineering company that partners with businesses to build and scale high-impact digital products, platforms, and AI-driven solutions. We work with fast-growing organizations across industries, helping them solve complex technology challenges through strong engineering, product, data, and AI capabilities.
Shuru is looking for a Senior Data Engineer to build scalable and reliable data pipelines for a global fintech engagement. This is a hands-on role focused on Azure Databricks, PySpark, SQL, and Delta Lake.
- Build and maintain data pipelines using Azure Databricks, PySpark, and SQL.
- Develop Bronze, Silver, and Gold data layers using Delta Lake.
- Build and optimize data models for analytics and business use cases.
- Implement data validation, testing, monitoring, and quality checks.
- Troubleshoot pipeline and data quality issues.
- Work closely with data leads, analysts, and engineering teams to deliver production-ready solutions.
- Follow data governance, security, cataloging, and lineage standards.
Requirements
- 5–8 years of Data Engineering experience.
- Strong hands-on experience with Azure Databricks, PySpark, and SQL.
- Experience with Delta Lake and Lakehouse architecture.
- Strong understanding of data modelling and dimensional modelling.
- Experience with data quality, testing, and pipeline monitoring.
- Familiarity with Git and CI/CD.
Benefits
- Work on challenging, large-scale engineering and data problems.
- Build modern platforms using cutting-edge cloud and data technologies.
- Work closely with experienced engineering, product, and technology leaders.
- Opportunity to take ownership of architecture and key technical decisions.
- Remote-first and collaborative work environment.
- Strong opportunities for learning, leadership, and career growth.
Similar Jobs
Information Technology
Build and maintain scalable data pipelines on Azure Databricks using PySpark, SQL, and Delta Lake. Design dimensional and Gold-layer data models, ingest structured and semi-structured data, implement testing and monitoring, troubleshoot data-quality issues, and follow cataloging, lineage, security, privacy, and regulatory standards. Collaborate with data leads, analysts, data scientists, and AI engineers to deliver reliable datasets and participate in code reviews and platform standards discussions.
Top Skills:
AzureAzure DatabricksAzure Event HubsCi/CdDelta LakeGitMariadbPysparkSQL
AdTech • Digital Media • Marketing Tech • Mobile
Designs and develops scalable data architectures, cloud data solutions, data warehouses, business analytics tools, and complex data pipelines. The role involves data wrangling, exploration, and discovery across heterogeneous sources, using AWS, SQL, Python, and relational database technologies. The engineer also contributes to data engineering innovation, knowledge sharing, and project planning while enabling data-driven organizational decision-making.
Top Skills:
Amazon Web Services (Aws)Data WarehousingDaxPythonRelational DatabasesSQL
Information Technology • Consulting
Develop and maintain Oracle APEX applications, Oracle Analytics Server/OBIEE reporting solutions, BI Publisher reports, and Oracle database objects. Build dashboards, workflows, integrations, REST APIs, and data models; write complex SQL and PL/SQL; troubleshoot and tune application and database performance; support deployments, testing, production issues, documentation, and stakeholder collaboration.
Top Skills:
Agile/ScrumBi PublisherCi/CdCSSHTMLJavaScriptLinux/UnixObieeOracle Analytics ServerOracle ApexOracle Autonomous DatabaseOracle Cloud InfrastructureOracle Data IntegratorOracle DatabaseOracle Rest Data ServicesPl/SqlRest ApisSource ControlSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
