Blend360 Logo

Blend360

Databricks Engineer - Senior/ Lead

Posted 13 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Hyderabad, Telangana
Senior level
In-Office or Remote
Hiring Remotely in Hyderabad, Telangana
Senior level
Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Azure Databricks, Python, SQL, PySpark, and Spark. Manage Delta Lake tables and integrate Azure Data Lake Storage. Work with structured and semi-structured data, optimize performance and cost, ensure data quality and governance, and support analytics and machine learning use cases. Collaborate with data scientists, analysts, and stakeholders while applying security, access control, monitoring, and modern data engineering practices.
The summary above was generated by AI
Company Description

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

Job Description

We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in Python, SQL, and Apache Spark to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate should have experience working with large datasets, distributed data processing, and modern data engineering practices.  

Responsibilities 

  • Design, develop, and maintain scalable data pipelines using Azure Databricks 

  • Implement ETL/ELT workflows using PySpark, Spark SQL, and Python 

  • Optimize Spark jobs for performance, cost, and scalability 

  • Work with structured and semi-structured data (Parquet, Delta, JSON, CSV) 

  • Build and manage Delta Lake tables (ACID, time travel, schema evolution) 

  • Integrate Databricks with Azure Data Lake Storage (ADLS Gen2) 

  • Develop complex queries and transformations using SQL 

  • Collaborate with data scientists, analysts, and stakeholders to support analytics and ML use cases 

  • Ensure data quality, validation, and monitoring 

  • Follow best practices for security, access control, and governance in Azure 

Qualifications

  • 6+ years of experience in Data Engineering 

  • Strong hands-on experience with Azure Databricks 

  • Proficiency in Python for data processing 

  • Strong knowledge of SQL (joins, window functions, performance tuning) 

  • Hands-on experience with Apache Spark / PySpark 

  • Experience working with Delta Lake 

  • Knowledge of Azure Data Lake Storage (ADLS Gen2) 

  • Understanding of distributed computing concepts 

  • Experience with Git version control 

Additional Information

  • Experience with Azure Data Factory 

  • Exposure to CI/CD pipelines (Azure DevOps, GitHub Actions) 

  • Basic understanding of data modeling 

  • Familiarity with cloud security and RBAC in Azure 

  • Exposure to streaming data (Spark Structured Streaming, Event Hub, Kafka) 

Similar Jobs

6 Hours Ago
Remote
2 Locations
Senior level
Senior level
Events • Food • Travel • Hospitality • Hotels & Resorts
Supports the Chief Engineer in managing hotel engineering operations, including building systems, HVAC, electrical, plumbing, life safety, equipment maintenance, compliance, contractors, budgets, and service requests. Supervises, schedules, trains, and develops maintenance staff; oversees work quality and documentation; responds to guest concerns and emergencies; monitors inventory, efficiency, and operating expenses.
Top Skills: Electrical SystemsHvacLife Safety SystemsPlumbing And Gas SystemsProperty Management Systems
6 Hours Ago
Remote
India
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Own the India territory end to end by building pipeline, closing full-cycle direct and partner co-sell deals, winning new logos, and expanding accounts. Sell Deepgram’s voice AI platform to technical and business buyers, guide evaluations with Field Engineers, maintain accurate forecasting, represent the company at industry events, and provide customer and market feedback. The role requires self-prospecting, technical sales expertise, Indian market experience, quota-carrying success, and a land-and-expand mindset.
Top Skills: APIsArtificial Intelligence/Machine LearningCloud ApisSpeech-To-Text (Stt)Text-To-Speech (Tts)Voice Ai
6 Hours Ago
Remote
India
Junior
Junior
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Generate inbound and outbound sales opportunities by researching prospects, identifying speech recognition use cases, articulating Deepgram’s technical value proposition, and building qualified pipeline. Collaborate with Partnerships, Account Executives, Sales Operations, and Sales Engineers to improve sales effectiveness, exceed targets, and develop enterprise sales skills.
Top Skills: Automatic Speech Recognition (Asr)SaaSSpeech-To-Text (Stt)Text-To-Speech (Tts)Voice Ai

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account