The Bigdata Engineer will design and develop ETL/Hadoop and analytics components, ensuring performance optimization and adherence to architectural standards, while managing distributed computing tasks and data ingestion workflows.
This is a remote position.
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Similar Jobs
.jpg)
AdTech • Cloud • Marketing Tech • Productivity • Software • Analytics • Automation
Hands-on Staff Software Engineer building and shipping backend features with enterprise reliability and scale. Own full product lifecycle, mentor peers, and adopt AI-native workflows to accelerate development and ensure quality.
Top Skills:
Ai AgentsAPIsC++Ci/CdClaude CodeDatabasesGithub CopilotGoHTTPJavaJavaScriptMvcOpencodePythonRubyTesting
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Perform functional, integration, UI and API testing in Agile teams; design and maintain Playwright-based automation frameworks; create test plans, execute regression and CI/CD tests; log defects and collaborate with developers to ensure high-quality financial-services software.
Top Skills:
Api TestingAzureAzure DevopsCi/CdGithub ActionsJavaScriptJenkinsPlaywrightPostmanRest Assured
Cloud • Information Technology • Productivity • Software • Automation
Lead consultative pre-sales technical engagements, design integration and AI solution strategies across Boomi's platform, deliver demos and presentations, support RFIs/RFPs and POCs, collaborate with account teams and partners, and act as a trusted advisor to demonstrate business value and ROI.
Top Skills:
Agent-Based AutomationAIApi ManagementAPIsBoomiBoomi AgentstudioData Pipeline Orchestration ToolsFederated Api ManagementGroovyIntegration PatternsIpaasJavaScriptLlmManaged File Transfer (Mft)Messaging QueuesMiddlewarePrompt EngineeringPythonRagRiveryThruVector Search
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
