ScatterPie Analytics Private Limited Logo

ScatterPie Analytics Private Limited

Hadoop Developer

Posted Yesterday
Be an Early Applicant
In-Office
Mumbai, Maharashtra, IND
Mid level
In-Office
Mumbai, Maharashtra, IND
Mid level
Develop and maintain scalable big data applications using the Hadoop ecosystem. Build ETL pipelines for data ingestion, transformation, and processing; optimize workflows; monitor and troubleshoot Hadoop jobs; and support data quality, security, and governance. Collaborate with data scientists, BI teams, and analysts to meet business needs.
The summary above was generated by AI

Job Title: Hadoop Developer 

Experience Required: 3–5 years 
Location- Mumbai  

 

About the Role: 

We are seeking a skilled Hadoop Developer with 3–5 years of experience to join our data engineering team in Thane. The ideal candidate will have hands-on expertise in building, maintaining, and optimizing large-scale data processing systems using the Hadoop ecosystem. 

 

Key Responsibilities: 

  • Design, develop, and maintain scalable big data applications using the Hadoop ecosystem. 

  • Work on data ingestion, transformation, and processing using tools like Hive, Pig, Spark, Sqoop, and Flume. 

  • Implement ETL pipelines and optimize data workflows for performance and scalability. 

  • Collaborate with data scientists, BI teams, and analysts to support business needs. 

  • Ensure data quality, security, and governance within the Hadoop cluster. 

  • Monitor, troubleshoot, and improve existing Hadoop jobs and data pipelines. 

 



Requirements

Required Skills & Qualifications: 

  • 3–5 years of hands-on experience in Hadoop ecosystem tools (HDFS, Hive, Pig, Sqoop, Flume, Spark, Oozie). 

  • Strong programming skills in Java, Python, or Scala. 

  • Experience with SQL and working with large datasets. 

  • Knowledge of ETL concepts and data integration techniques. 

  • Experience with real-time data streaming frameworks (Kafka, Spark Streaming) is a plus. 

  • Familiarity with cloud platforms (AWS, Azure, GCP) for big data solutions is desirable. 

  • Good problem-solving and communication skills. 



Similar Jobs

11 Hours Ago
In-Office or Remote
India
Senior level
Senior level
Software
Join a team responsible for improving the availability and reliability of Hadoop environments. Contribute to troubleshooting and support in a collaborative environment.
Top Skills: AmbariCloudera ManagerHadoopHdfsHiveImpalaKafkaLinuxNifiYarn
9 Minutes Ago
In-Office
Mumbai, Maharashtra, IND
Junior
Junior
Fintech • Information Technology • Financial Services
Design, develop, and maintain software components and validation frameworks. Create and execute test plans, identify and track defects, support automation and regression testing, collaborate with stakeholders, monitor application behavior, and contribute to QA standards using tools like Git and test automation frameworks.
Top Skills: GitPythonSeleniumSQL
12 Minutes Ago
In-Office
Mumbai, Maharashtra, IND
Senior level
Senior level
Fintech • Information Technology • Financial Services
Lead index projections and research using statistical analysis, advanced data science, and domain expertise to inform trading and product decisions. Build analytics platforms, partner with quant research and product teams, provide client-facing insights, and design risk controls for index data and methodologies.
Top Skills: AladdinBloombergFactsetPythonRSQL

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account