The Bigdata Engineer will design and develop ETL/Hadoop and analytics components, ensuring performance optimization and adherence to architectural standards, while managing distributed computing tasks and data ingestion workflows.
This is a remote position.
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Design, develop, and maintain Salesforce solutions across Sales, Service, and Experience Clouds including CPQ. Perform Apex and LWC development, unit testing, deployments (Gearset), integrations, and support SOX-compliant change management while collaborating with global teams.
Top Skills:
ApexChange SetsExperience CloudFlowGearsetGitJIRALightning Web Components (Lwc)Process BuilderRest ApiSales CloudSalesforce CpqSalesforce Data LoaderSalesforce DxService CloudSoap ApiSOQLSoslValidation RulesVisualforce
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop and maintain full stack applications integrating AI models and financial datasets. Collaborate with teams to deliver secure, responsive web applications using modern technologies.
Top Skills:
Amazon NeptuneAWSDjangoDockerFastapiFlaskGitGithub ActionsJenkinsKubernetesMongoDBNeo4JNode.jsPostgresPythonReactReduxTailwindTypescript
Cloud • Information Technology • Security • Software • Cybersecurity
Manage field marketing strategies to boost awareness and demand for Zscaler while collaborating with sales and cross-functional teams.
Top Skills:
Ai Productivity ToolsGoogle SuiteSalesforce
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
