The Senior Product Support Engineer will design and optimize Hadoop and Spark-based systems, troubleshoot performance issues, and support migrations while working in a 24/7 environment.
Position Summary:
We are seeking a Product Specialist - Hadoop SME (Subject Matter Expert) who will be responsible for designing, optimising, migrating and scaling Hadoop and Spark-based data processing systems. This role involves hands-on experience with Hadoop and other core data operations, focusing on building resilient, high-performance distributed data systems. You will collaborate with customer engineering teams to deliver high-throughput Hadoop and Spark applications and solve complex data challenges in migration, upgrades, reliability, and optimise post-migration system performance.
If you’re passionate about working in fast-paced, dynamic environments and want to be part of the cutting edge of data solutions, this role is for you.
We’re looking for someone who can:
- Design and optimise distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads.
- Troubleshooting: Provide expert-level support for data or performance issues in Hadoop and Spark jobs and clusters.
- Data Processing Expertise: Work extensively with large-scale data pipelines using Hadoop and Spark's core components
- Performance Tuning: Conduct deep-dive performance analysis, debugging, and optimisation of Impala and Spark jobs to reduce processing time and resource consumption.
- Cluster Management: Collaborate with DevOps and infrastructure teams to manage Impala and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.).
- Migration: Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimise system performance after migration to ODP.
- This role requires flexibility to work in rotational shifts, based on team coverage needs and customer demand.
Candidates should be comfortable supporting operations in a 24/7 environment and be willing to adjust their working hours accordingly.
Similar Jobs
Big Data • Cloud • Software • Database
Lead pre-sales technical efforts with partners and customers to design, demo, and deploy MongoDB-based solutions. Support account teams with discovery, proofs of value, architecture, performance tuning, and partner enablement. Serve as a trusted advisor, translate technical decisions into business value, mentor peers, and represent MongoDB at events and partner engagements.
Top Skills:
Angular.JsApache KafkaAtlasAtlas Data LakeAtlas Full-Text SearchAtlas Stream ProcessingAtlas Vector SearchAWSCC#C++Cloud DevopsCloud ManagerCompassConnector For BiConnector For SparkCSSCursorDatabase BenchmarkingHTMLInfrastructure As CodeJavaKubernetesLovableMongoDBNode.jsOps ManagerPerformance TuningProfilingPythonReactSQLTypescriptV0VueWindsurf
Big Data • Cloud • Software • Database
Seeking a Principal Technologist to engage with executive leaders, influence AI and database strategies, and deliver impactful technical presentations. Responsibilities include showcasing MongoDB's capabilities and bridging data architectures with AI applications.
Top Skills:
AICloud ComputingDatabase ArchitecturesDistributed SystemsMongoDB
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Treasury Risk & Controls Specialist will leverage treasury expertise to support risk management initiatives, document internal controls, collaborate with teams on operational risks, analyze data, and drive remediation initiatives.
Top Skills:
Data AnalysisRegulatory ComplianceRisk Management
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
