NextHire Consulting Logo

NextHire Consulting

Algotale( Lumiq.Ai) - Data Engineer (Python)

Reposted 9 Days Ago
Be an Early Applicant
In-Office
Mumbai, Maharashtra, IND
Senior level
In-Office
Mumbai, Maharashtra, IND
Senior level
Design, build, and maintain scalable Python-based data pipelines and backend services. Use OOP principles, orchestrate workflows with Apache Airflow, and model/optimize data in Snowflake. Implement data validation and quality checks, monitor and troubleshoot pipeline performance, collaborate with analysts and data scientists, and document data workflows and architecture.
The summary above was generated by AI
Job Title: Data Engineer

Experience: 5+ Years
Location: Mumbai / Noida

Job Overview

We are looking for a skilled Data Engineer with strong expertise in Python (OOPs), Airflow, and Snowflake to design and build scalable data pipelines and backend components for data platforms. The ideal candidate should have experience in building robust data engineering solutions and ensuring data quality across large datasets.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines and backend data services using Python.

  • Build modular and reusable components using Object-Oriented Programming (OOP) principles.

  • Develop and manage workflow orchestration using Apache Airflow.

  • Work with Snowflake to design efficient data models, optimize queries, and manage data warehousing solutions.

  • Implement data validation and data quality checks across large datasets.

  • Collaborate with data analysts, data scientists, and product teams to deliver reliable data solutions.

  • Monitor, troubleshoot, and optimize data pipelines for performance and reliability.

  • Maintain documentation for data workflows, pipelines, and architecture.

Required Skills
  • 5+ years of experience in Data Engineering or related roles

  • Strong proficiency in Python with emphasis on OOP concepts

  • Experience building backend applications or SDKs using Python

  • Hands-on experience with Apache Airflow

  • Strong understanding of Snowflake architecture and concepts

  • Experience designing and managing data pipelines

  • Strong communication skills (8/10 – Mandatory)

Nice to Have
  • Experience implementing Data Quality frameworks

  • Hands-on experience with Great Expectations

  • Experience performing data quality checks on large datasets

  • Advanced experience working with Snowflake

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

Preferred Candidate Traits
  • Strong problem-solving and analytical skills

  • Ability to work in a fast-paced and collaborative environment

  • Attention to detail with focus on data accuracy and reliability

Similar Jobs

An Hour Ago
Hybrid
Mid level
Mid level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Advanced Data Science Associate Consultant will develop algorithms, execute statistical techniques, collaborate with clients, and integrate engineering principles into data science workflows.
Top Skills: Advanced AnalyticsBig DataDeep LearningGenerative AiJavaPythonR
An Hour Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Data Architect Lead is responsible for designing scalable architecture solutions, engaging with clients, and innovating technology assets while mentoring juniors and driving business growth.
Top Skills: Advanced AnalyticsAIApplication Portfolio AssessmentBig Data TechnologiesCloud StrategyIt TransformationMl
An Hour Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Engineering Lead will design and implement technical features, work on ML pipelines, and mentor engineers while ensuring high-quality deliverables. This role requires collaborating with teams and managing the ML lifecycle for business value.
Top Skills: Apache KafkaAWSAws KinesisAzureDeep LearningGCPHadoopHiveJavaKubeflowLangchainLlamaindexMachine LearningMl EngineeringMlflowPysparkPythonRabbit MqSagemakerScalaSpark

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account