The Bigdata Engineer will design and develop ETL/Hadoop and analytics components, ensuring performance optimization and adherence to architectural standards, while managing distributed computing tasks and data ingestion workflows.
This is a remote position.
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Lead design and delivery of scalable finance integrations and automation. Partner with Finance to replace spreadsheets, build APIs/middleware/RPA/AI solutions, ensure SOX and security compliance, and enforce engineering standards including testing and QA automation.
Top Skills:
Ai AgentsAi/MlAPIsEvent-Driven ArchitecturesFloqastGeminiGenerative AiMcp IntegrationsMiddlewareNetSuiteRpaUipathWorkatoWorkdayWorkflow ToolsWorkiva
Cloud • Information Technology • Security • Software
Own full sales cycle for North America SMB/EOT accounts: prospect, qualify, run discovery, demo, propose, and close. Manage high-volume pipeline, forecast in Salesforce, partner with SDRs and SEs, hit monthly/quarterly bookings, and feed market intelligence back to leadership.
Top Skills:
JumpcloudSalesforce
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Lead and develop an offshore sales development team to drive high-volume inbound and outbound lead generation for US and EMEA. Own team performance, prospecting, CRM reporting, rapid lead follow-up (15-minute target), and cross-functional alignment with sales and marketing to meet/exceed lead targets.
Top Skills:
CRMLinkedInSalesforce
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
