Design, build, and maintain Azure-based data pipelines and data models using Synapse, Spark, SQL and ADLS. Implement ETL/ELT, ensure data quality, optimize performance, support deployment/monitoring, and collaborate with analysts, scientists, and stakeholders.
Key Responsibilities
- Design, build, and maintain data pipelines using Azure services
- Develop and optimize solutions using Azure Synapse Analytics (pipelines, Spark, SQL pools)
- Implement ETL/ELT processes for ingesting and transforming data from multiple sources
- Design and manage data models to support reporting and analytics
- Work with structured and unstructured datasets in a data lake environment
- Ensure data quality, integrity, and consistency across pipelines
- Optimize performance of queries, pipelines, and storage
- Collaborate with data analysts, data scientists, and business stakeholders
- Support deployment, testing, and monitoring of data solutions
- Maintain documentation for data processes and architectures
Required Skills & Experience
- Strong hands-on experience with Microsoft Azure data services
- Proven experience with Azure Synapse Analytics (pipelines, Spark, SQL)
- Proficiency in SQL and Python
- Experience with data warehousing concepts and dimensional modeling
- Experience with ETL/ELT design and implementation
- Familiarity with Azure Data Lake Storage (ADLS)
- Understanding of distributed data processing (e.g., Spark)
- Experience with version control and CI/CD practices (Azure DevOps preferred)
Soft Skills
- Strong analytical and problem-solving abilities
- Good communication and stakeholder interaction skills
- Ability to work independently and within a team
- Attention to detail and focus on quality
Preferred Qualifications
- 6+ years of experience in Data Engineering.
- Experience with Delta Lake or similar technologies
- Exposure to Azure Data Factory
- Knowledge of performance tuning and query optimization
- Understanding of data governance and security best practices in Azure
Similar Jobs
Artificial Intelligence • HR Tech • Professional Services • Software
Design and implement modern data warehouse solutions using Databricks and cloud (Azure/AWS). Develop, orchestrate (Airflow) and troubleshoot ETL pipelines (batch and streaming), build dimensional data models for reporting, collaborate with architects and business stakeholders, mentor team members, and drive technical discussions.
Top Skills:
AirflowApache KafkaAWSAzure Data FactoryAzure DatabricksCassandraCircleCIDatabricks Delta LakeGitHadoop (HiveImpala)KinesisMongoDBNeo4JPigPl/SqlPysparkPythonRdbmsSQLTerraformUnix Shell Scripting
Artificial Intelligence • HR Tech • Professional Services • Software
Design, develop, and maintain scalable ETL/ELT pipelines and data models using Azure Databricks and SQL. Optimize data processing workflows, ensure data quality, support cloud data warehouse initiatives, troubleshoot pipeline performance, and collaborate with stakeholders to deliver analytics-ready data for BI and reporting.
Top Skills:
AzureAzure DatabricksData WarehousingETLSQL
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
