The Bigdata Engineer will design and develop ETL/Hadoop and analytics components, ensuring performance optimization and adherence to architectural standards, while managing distributed computing tasks and data ingestion workflows.
This is a remote position.
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, develop, test, deploy, monitor, and maintain full-stack production software using Java, Python, APIs, services, data workflows, and cloud-native components. Build automated testing and CI/CD quality gates, apply secure and maintainable engineering practices, improve observability and operational reliability, modernize legacy systems, and collaborate across product, architecture, security, data, and operations teams. Use approved AI-assisted development tools responsibly throughout the software delivery lifecycle.
Top Skills:
APIsAutomated TestingCi/CdCloud-Native TechnologiesJavaMetricsObservabilityPythonSecurity ScanningStatic AnalysisStructured LoggingTracing
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Designs, develops, debugs, and verifies embedded software and firmware for aerospace systems. Leads test architecture, verification strategies, certification activities, audits, design reviews, and bench setup. Evaluates emerging technologies, influences software architecture, automates processes with generative AI, and guides engineers while managing cross-functional stakeholders, quality, cost, and schedule objectives.
Top Skills:
CC++ChatgptDebuggersDo-178B/CEmbedded SoftwareEmbedded SystemsFirmwareLarge Language ModelsMatlabMulticore ProcessorsNatural Language ProcessingPythonSimulatorsVectorcast/Cover
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Leads multiple aerospace datalink product development teams within an Aircraft Communication, Navigation and Surveillance center of excellence. Oversees avionics system and software development, program execution, quality, budgets, cost and cycle-time reduction, Agile transformation, digital engineering adoption, innovation, stakeholder engagement, and talent management. Requires strong avionics expertise, aerospace software design experience, knowledge of DO-178B/C and ARP4754A, and demonstrated technical and people leadership.
Top Skills:
AgileAIAircraft SystemsArp4754AAutomationAvionicsDigital ThreadDigital TwinHoneywell Operating SystemLean Product DevelopmentModel-Based Systems Engineering (Mbse)Rtca Do-178B/C
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
