emids Logo

emids

Senior Consultant

Posted 10 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in India
Senior level
In-Office or Remote
Hiring Remotely in India
Senior level
Design and build scalable data pipelines and modern data platform components on AWS Lakehouse using Databricks. Implement batch and streaming solutions, manage clusters and Delta Lake operations (vacuuming), optimize costs, and establish CI/CD, unit testing, security scanning, and AI-assisted development practices. Provide architect-level guidance and drive engineering standards.
The summary above was generated by AI

Databricks Engineer – Data Engineering (AWS) will build build scalable data pipelines and contribute to modern data platform development using AWS and Lakehouse architecture.

The candidate has solid hands-on Databricks experience and showed good engagement, passion, and familiarity with batch/streaming concepts, clustering, vacuuming, and cost-modeling considerations.

However, we do not recommend moving forward. The main concern is that the candidate frequently gave lengthy, indirect answers that did not address the specific questions asked, even after redirection. There were also notable gaps in modern data engineering practices, especially around CI/CD, unit testing, security scanning, and practical use of AI in development workflows.

Given the architect-level expectations for this role, the candidate may struggle to operate independently, provide clear guidance, and drive engineering standards effectively.

Similar Jobs

Yesterday
In-Office or Remote
Senior level
Senior level
Insurance
Designs, develops, and maintains complex application modules using Java and Spring Boot in a microservices architecture. Participates in design and code reviews, creates test plans, resolves defects, supports production deployments, documents solutions, estimates work, and collaborates with business partners to deliver tactical solutions and improve operational efficiency.
Top Skills: Java 17Java 8MicroservicesRest ApisSpring Boot
10 Days Ago
In-Office or Remote
India
Senior level
Senior level
Healthtech • Information Technology • Other • Software • Analytics
Design and build scalable data pipelines and a modern data platform on AWS using Databricks and Lakehouse architecture. Implement batch and streaming processing, cluster management, vacuuming, and pipeline cost modeling. Establish and drive engineering standards including CI/CD, unit testing, security scanning, and practical AI integration. Operate at an architect level to provide technical guidance and ownership.
Top Skills: AISparkAWSCi/CdDatabricksDelta LakeLakehouseSecurity ScanningUnit Testing
11 Days Ago
In-Office or Remote
India
Senior level
Senior level
Healthtech • Information Technology • Other • Software • Analytics
Design, develop, and maintain Splunk dashboards, reports, alerts and integrations. Administer Splunk Enterprise and forwarders, implement custom scripts (Python/PowerShell), analyze and optimize performance, collaborate with stakeholders in Agile ceremonies, mentor developers, and maintain documentation.
Top Skills: Data MiningPowershellPythonRegular Expressions (Regex)SplunkSplunk Dashboard DevelopmentSplunk EnterpriseSplunk ForwarderSQL

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account