Design and develop large-scale data pipelines using Hadoop, optimize workflows, maintain data quality, and collaborate with teams on data needs.
Overall Responsibilities:
- Design and develop large-scale, fault-tolerant data pipelines using Hadoop and related technologies
- Optimize data workflows for performance and scalability
- Collaborate with data scientists, analysts, and stakeholders to understand data needs
- Maintain data quality, security, and governance standards
- Analyze existing data architecture and recommend improvements
- Automate data extraction, transformation, and loading processes
- Troubleshoot and resolve data pipeline issues promptly
- Document data systems, architecture, and processes
- Strong proficiency in Hadoop ecosystem components like HDFS, MapReduce, YARN
- Experience with Apache Spark, Hive, Pig, and optionally Kafka
- Skilled in programming languages: Java, Scala, Python
- Familiarity with ETL tools and pipelines
- Knowledge of SQL and NoSQL databases (e.g., HBase, Cassandra)
- Experience with cloud platforms (AWS, GCP, Azure) is a plus
- Version control tools such as Git
- Big Data Processing: Hadoop (HDFS, MapReduce), Apache Spark, Hive, Pig
- Programming Languages: Python, Scala, Java
- Data Storage Solutions: HDFS, HBase, Cassandra
- Messaging & Streaming Technologies: Kafka, Flink (optional)
- Data Integration & ETL Tools: Apache NiFi, Airflow, Sqoop
- Cloud & DevOps Platforms: AWS EMR, S3, Azure Data Lake, GCP Dataproc
- Databases & Querying: SQL, NoSQL databases
- Version Control & Collaboration: Git, Bitbucket
- Minimum 5+ years of professional experience in data engineering, with a proven track record of working within Hadoop ecosystems and big data platforms.
- Building and maintaining data pipelines and workflows
- Monitoring data pipeline performance and reliability
- Collaborating with cross-functional teams to gather requirements and deliver solutions
- Performing data extraction, transformation, and loading (ETL)
- Optimizing storage and compute processes
- Troubleshooting system issues and providing support
- Keeping up-to-date with emerging Big Data trends and tools
- Bachelor's or Master’s degree in Computer Science, Information Technology, or related fields
- Certification in Big Data Technologies is a plus (e.g., Cloudera, Hortonworks)
- Strong analytical and problem-solving skills
- Excellent communication and collaboration abilities
- Ability to work independently and as part of a team
- Adaptability to fast-changing technology landscapes
- Attention to detail and commitment to quality
- Good time management and prioritization skills
SYNECHRON’S DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
Candidate Application Notice
Top Skills
Spark
AWS
Azure
Cassandra
Etl Tools
GCP
Git
Hadoop
Hbase
Hdfs
Hive
Java
Mapreduce
NoSQL
Pig
Python
Scala
SQL
Yarn
Similar Jobs
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead projects using cloud technologies to solve complex business problems, mentor teams, and drive project delivery methodologies while collaborating with clients and stakeholders.
Top Skills:
AWSAzureDatabricksGCPPower BIRedshiftSalesforceSnowflake
Fintech • Information Technology • Financial Services
Design and build frontend-heavy and backend services across full-stack projects using Java and modern frontend frameworks, participate in SDLC and Agile ceremonies, set coding standards, support production systems, and collaborate globally to deliver user-focused digital experiences.
Top Skills:
AngularApache TomcatAzure DevopsCSSEasymockGitHelmHTMLJavaJavaScriptJmockJunitNgrxOciReactRxjsSpring FrameworkTestngUnix/Linux
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Creative Graphics Designer Manager will create engaging, medically accurate designs for various medical content formats, manage projects, and ensure compliance with brand and regulatory standards while collaborating with stakeholders.
Top Skills:
Adobe Creative SuiteAdobe XdAfter EffectsCorel DrawCSSHTMLIllustratorIndesignPowerPointPremiere Pro
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
