Lead design and deliver end-to-end data solutions on Microsoft Fabric. Build and optimize PySpark/ELT pipelines, architect Lakehouse/Delta Lake with Medallion patterns, enforce data governance/lineage/security, implement CI/CD and DevOps, mentor engineers, troubleshoot production, and collaborate with stakeholders on performance and cost optimization.
About
The Company:
iLink Digital is a
Global Software Solution Provider and Systems
Integrator, delivers next-generation technology
solutions to help clients solve complex business
challenges, improve organizational effectiveness,
increase business productivity, realize sustainable
enterprise value and transform your business
inside-out. iLink integrates software systems and develops
custom applications, components, and frameworks on the latest
platforms for IT departments, commercial accounts, application
services providers (ASP) and independent software vendors
(ISV). iLink solutions are used in a broad range of industries
and functions, including healthcare, telecom, government, oil
and gas, education, and life sciences. iLink’s expertise
includes Cloud Computing & Application Modernization, Data
Management & Analytics, Enterprise Mobility, Portal,
collaboration & Social Employee Engagement, Embedded
Systems and User Experience design
etc.
What makes
iLink's offerings unique is the fact that we use
pre-created frameworks, designed to accelerate software
development and implementation of business processes for our
clients. iLink has over 60 frameworks (solution accelerators),
both industry-specific and horizontal, that can be easily
customized and enhanced to meet your current business
challenges.
Requirements
We are looking for a highly skilled Lead Data Engineer with strong expertise in Microsoft Fabric to design, develop, and manage modern data platforms. The ideal candidate will drive end-to-end data engineering solutions, mentor the team, and collaborate closely with business and technical stakeholders to deliver scalable and high-performance data pipelines.
- Lead the design and implementation of end-to-end data solutions on Microsoft Fabric, including Data Factory, Lakehouse, Warehouse, and Data Engineering experiences.
- Build and optimize ETL/ELT pipelines using PySpark, Dataflows Gen2, and Fabric pipelines.
- Architect and maintain Lakehouse and Delta Lake structures for large-scale data processing.
- Ensure strong data governance, quality, lineage, and security across the ecosystem.
- Work closely with data architects, analysts, and business partners to understand requirements and convert them into technical solutions.
- Oversee performance tuning, capacity planning, cost management, and platform optimization.
- Mentor junior data engineers and provide best practices for coding, design, and deployment.
- Implement CI/CD processes for Fabric workloads (Git integration, workspace management, DevOps).
- Troubleshoot data pipeline failures, production issues, and optimize workloads.
- Stay updated with Microsoft Fabric roadmap and bring innovative solutions into the architecture.
- 7+ years of experience in Data Engineering, with at least 2+ years in Microsoft Fabric or modern data platforms.
- Strong hands-on experience in:
- PySpark / Spark SQL
- Fabric Data Engineering, Lakehouse, Warehouse
- Pipelines, Dataflows Gen2, KQL, Notebooks
- Delta Lake and Medallion architecture
- PySpark / Spark SQL
- Solid understanding of data modeling, data warehousing, and SQL performance tuning.
- Experience with Azure services: ADLS, Synapse, Data Factory, Databricks (added advantage).
- Expertise in Git, DevOps practices, and production deployment workflows.
- Strong analytical/problem-solving skills and stakeholder management capabilities.
- Experience leading a team or owning end-to-end delivery of data solutions.
- Knowledge of Power BI integration with Fabric
- Experience with Real-time analytics / Event streaming
- Familiarity with Python development and API integrations
- Exposure to ML pipelines within Fabric
Benefits
- Competitive
salaries
- Medical
Insurance
- Employee
Referral Bonuses
- Performance
Based Bonuses
- Flexible
Work Options & Fun Culture
- Robust
Learning & Development Programs
- In-House
Technology Training
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead design and build of data models, pipelines, and feature stores to power AI, RAG, and advanced analytics for commercial pharma. Translate data strategy into technical designs, ensure data quality and governance, mentor engineers, and deliver performant data solutions that drive business decisions and AI deployments.
Top Skills:
AirflowCi/CdDbtDockerFeature StoresGitNoSQLNumpyPandasPolarsPower BIPythonRagSnowflakeSparkSQLStreamlitTableau
Cloud • Information Technology • Security • Software • Cybersecurity
Own and drive enterprise sales within a territory: identify customer pain points, educate C-level decision makers, manage full sales cycle, create coverage and prospecting plans, and collaborate with Solutions Engineers and Channel partners to close deals and expand footprint.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
