Design and build conformed dimensions and transactional fact tables. Develop and maintain Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake. Implement dimensional modeling, transactional fact design, incremental processing/CDC, and translate SQL Server/stored-procedure logic into Spark transformations while ensuring data reconciliation and audit standards.
Title: Senior Azure Databricks Consultant
Location: Hyderabad/Mumbai/Bangalore
Education: Bachelors Degree
Exp Level: 8+ Years
Job Description:
- Design and build conformed dimensions and transactional fact tables for enterprise reporting.
- Develop and maintain data pipelines on Azure Databricks using PySpark, Spark SQL, and Delta Lake.
- Implement best practices in dimensional modeling, including:
- Star schemas
- Conformed dimensions
- Surrogate and deterministic hash keys (e.g., SHA-256)
- Transactional fact design
- Translate existing SQL Server and stored procedure logic into efficient Spark-based transformations.
- Implement incremental data processing and change data capture (CDC) pipelines.
- Ensure data reconciliation with source systems to meet accuracy and audit standards.
- Collaborate closely with a senior Databricks lead to deliver core data assets within defined timelines.
Datavail’s Data Management Services:
Datavail’s Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. Datavail’s team is comprised of not just excellent BI & analytics consultants, but great people as well. Datavail’s data intelligence consultants are experienced, knowledgeable and certified in the best in breed BI and analytics software applications and technologies. We ascertain your business objectives, goals and requirements, assess your environment, and recommend the tools which best fit your unique situation. Our proven methodology can help your project succeed, regardless of stage. With the combination of a proven delivery model and top-notch experience ensures that Datavail will remain the Data Management experts on demand you desire. Datavail’s flexible and client focused services always add value to your organization.
Similar Jobs
Hardware • Software • Analytics
Lead global ERP design, governance and deployments; drive integrations, extensions, and data migration strategies; provide technical leadership on architecture, testing, and scalable solutions while advising on best practices and emerging technologies.
Top Skills:
Azure DevopsCore JavaData MigrationDockerGitJavaKubernetesMobile Automation TestingMobile TestingOracleOracle Ebs R12Oracle FormsOracle WorkflowsPl/SqlPostgres
Software
Manage and standardize R&D lab infrastructure worldwide: configure, install, maintain lab and network equipment, servers, and cloud resources; enforce cybersecurity and compliance (TL9000, ISO standards); handle tickets/SLA support; manage inventory, procurement, budgeting (Capex/Opex), and drive lab improvements and integrations for SW/HW/system testing.
Top Skills:
BcpCcnaCloud InfrastructureDevOpsEsdFirewallsIp AddressingIso14000Iso27000Iso45000Network/Telecom EquipmentOs InstallationRoutingSecurity PatchingServer InfrastructureSwitchingTicketing SystemsTl9000VlanVulnerability Management
Database
Design, develop, and maintain scalable data warehouse solutions using dbt and SQL. Build incremental models, snapshots, tests, and macros. Implement dimensional data models and semantic layers, optimize queries, and ensure data quality and performance while collaborating with stakeholders.
Top Skills:
DbtSemantic LayerSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
