The Bigdata Engineer will design and develop ETL/Hadoop and analytics components, ensuring performance optimization and adherence to architectural standards, while managing distributed computing tasks and data ingestion workflows.
This is a remote position.
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Similar Jobs
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Second-line Technology Risk role overseeing technology, data, cyber and AI risks. Drive GRC tool implementation/migration, perform risk assessments and deep dives, support control frameworks, policy enhancements, third‑party risk reviews, and automate risk management processes across the enterprise.
Top Skills:
Claude CodeDiligent OneGithub CopilotGrc Tool
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Administer and maintain client share plans and incentive structures via an online portal. Lead plan setup and migrations, manage and validate plan data, process transactions, maintain records, ensure compliance with procedures, and collaborate with global teams to resolve data issues and deliver high-quality administration services.
Top Skills:
ExcelLookupsMail MergeMS OfficeOnline PortalPivot TablesSystems
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Perform fund accounting and reconciliations for F&O, CFDs, swaps and other instruments; execute cash, position and trade reconciliations; research and resolve breaks; prepare journal entries; verify prices and income via Bloomberg/market data; liaise with internal and external stakeholders; meet quality SLAs and handle daily and monthly complex reconciliations.
Top Skills:
BloombergGenevaExcelMicrosoft OutlookMicrosoft Word
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
