Synechron Logo

Synechron

Data Engineer - Bigdata/Hadoop

Posted 13 Days Ago
Be an Early Applicant
In-Office
Mumbai, Maharashtra
Senior level
In-Office
Mumbai, Maharashtra
Senior level
Design and develop large-scale data pipelines using Hadoop, optimize workflows, maintain data quality, and collaborate with teams on data needs.
The summary above was generated by AI
Overall Responsibilities:
  • Design and develop large-scale, fault-tolerant data pipelines using Hadoop and related technologies
  • Optimize data workflows for performance and scalability
  • Collaborate with data scientists, analysts, and stakeholders to understand data needs
  • Maintain data quality, security, and governance standards
  • Analyze existing data architecture and recommend improvements
  • Automate data extraction, transformation, and loading processes
  • Troubleshoot and resolve data pipeline issues promptly
  • Document data systems, architecture, and processes
Software Requirements:
  • Strong proficiency in Hadoop ecosystem components like HDFS, MapReduce, YARN
  • Experience with Apache Spark, Hive, Pig, and optionally Kafka
  • Skilled in programming languages: Java, Scala, Python
  • Familiarity with ETL tools and pipelines
  • Knowledge of SQL and NoSQL databases (e.g., HBase, Cassandra)
  • Experience with cloud platforms (AWS, GCP, Azure) is a plus
  • Version control tools such as Git
Category-wise Technical Skills:
  • Big Data Processing: Hadoop (HDFS, MapReduce), Apache Spark, Hive, Pig
  • Programming Languages: Python, Scala, Java
  • Data Storage Solutions: HDFS, HBase, Cassandra
  • Messaging & Streaming Technologies: Kafka, Flink (optional)
  • Data Integration & ETL Tools: Apache NiFi, Airflow, Sqoop
  • Cloud & DevOps Platforms: AWS EMR, S3, Azure Data Lake, GCP Dataproc
  • Databases & Querying: SQL, NoSQL databases
  • Version Control & Collaboration: Git, Bitbucket
Experience:
  • Minimum 5+ years of professional experience in data engineering, with a proven track record of working within Hadoop ecosystems and big data platforms.
Day-to-Day Activities:
  • Building and maintaining data pipelines and workflows
  • Monitoring data pipeline performance and reliability
  • Collaborating with cross-functional teams to gather requirements and deliver solutions
  • Performing data extraction, transformation, and loading (ETL)
  • Optimizing storage and compute processes
  • Troubleshooting system issues and providing support
  • Keeping up-to-date with emerging Big Data trends and tools
Qualifications:
  • Bachelor's or Master’s degree in Computer Science, Information Technology, or related fields
  • Certification in Big Data Technologies is a plus (e.g., Cloudera, Hortonworks)
Soft Skills:
  • Strong analytical and problem-solving skills
  • Excellent communication and collaboration abilities
  • Ability to work independently and as part of a team
  • Adaptability to fast-changing technology landscapes
  • Attention to detail and commitment to quality
  • Good time management and prioritization skills

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Top Skills

Spark
AWS
Azure
Cassandra
Etl Tools
GCP
Git
Hadoop
Hbase
Hdfs
Hive
Java
Mapreduce
NoSQL
Pig
Python
Scala
SQL
Yarn

Similar Jobs

31 Minutes Ago
In-Office
Pune, Maharashtra, IND
Senior level
Senior level
Healthtech • Logistics • Pharmaceutical
Lead Salesforce projects focusing on implementation, technical leadership, vendor management, strategic planning, and operational efficiency. Build and manage teams, ensuring quality and stakeholder communication.
Top Skills: AgileConfluenceDevOpsInformaticaJIRAMicrosoft Office SuiteMulesoftSalesforceScrum
31 Minutes Ago
In-Office
Pune, Maharashtra, IND
Senior level
Senior level
Healthtech • Logistics • Pharmaceutical
The Engineer III engages in designing, developing, and deploying applications, focusing on cloud infrastructure, microservices, and database management while mentoring junior engineers.
Top Skills: AngularAWSAzureAzure PipelinesAzure ReposBootstrapCSSDockerGitHTML5JavaJavaScriptJenkinsKubernetesMySQLNode.jsOracleQuarkusReactRestful ApisSpring BootSql Server Integration ServicesSwaggerTsqlTypescript
2 Hours Ago
Easy Apply
Hybrid
Mumbai, Maharashtra, IND
Easy Apply
Senior level
Senior level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
The Growth Enterprise Account Executive will manage the sales cycle, build client relationships, develop strategies, and collaborate with teams to drive revenue and expand client accounts.
Top Skills: B2B Saas

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account