Support big data infrastructure for enterprise customers, handling installations, upgrades, monitoring tools, and providing emergency support. Requires travel to customer sites.
Big Data Platform Engineer / BD Site Reliability Engineer (SRE) - Job Requirements
Position Overview
We are seeking a Big Data Platform Engineer to support our enterprise customers' big data infrastructure deployments and operations. This role requires a hands-on technical professional who can work both remotely and on-site at customer locations, including weekend emergency support when critical issues arise.
Key Responsibilities
- Customer Site Support: Provide ongoing technical support for customer big data clusters and installations
- Installation & Upgrades: Lead and support installation/upgrade projects both remotely (back office support) and on-premises at customer sites
- Travel Requirements: Willingness to travel to customer sites as needed for installations, upgrades, and critical issue resolution
- Emergency Response: Available for weekend/after-hours support during customer site crises
- Installation Code Development: Develop, maintain, and fix installation automation scripts and tools
- CI/CD Pipeline Management: Build and maintain continuous integration/deployment pipelines
- Monitoring Solutions: Develop and enhance monitoring tools for big data infrastructure
Required Technical Skills
Core Infrastructure & Automation
- Ansible: Advanced proficiency in playbook development and infrastructure automation
- Bash: Strong shell scripting capabilities for system administration and deployment
- Python: Solid programming skills for automation tools and utilities development
- RedHat Linux: Deep knowledge of RedHat Enterprise Linux distribution, system administration, and package management
CI/CD & Virtualization
- Jenkins: Experience building and maintaining CI/CD pipelines
- VMware vSphere: Virtual infrastructure management and deployment
Big Data Ecosystem (Required)
- Apache Spark: Cluster configuration, tuning, and troubleshooting
- YARN: Resource management and cluster administration
- HDFS: Distributed file system management and optimization
- Apache Kafka: Streaming platform deployment and maintenance
- Apache ZooKeeper: Coordination service configuration and management
Preferred (Bonus) Skills
- Kubernetes: Container orchestration and cloud-native deployments
- Vanilla, Open Shift, RKE
- Harbor: Container registry management
- Longhorn: Distributed storage solutions
Work Environment & Requirements
- Hybrid Role: Mix of remote work and customer site visits
- Travel: Must be willing and able to travel to customer sites domestically and potentially internationally
- Availability: Flexible schedule including weekend emergency support capability
- Customer-Facing: Strong communication skills for direct customer interaction during installations and support
Ideal Candidate Profile
- 3-5 years experience with big data infrastructure and automation
- Proven track record in customer-facing technical roles
- Strong problem-solving skills under pressure
- Self-motivated with ability to work independently at customer sites
Top Skills
Ansible
Apache Kafka
Spark
Apache Zookeeper
Bash
Harbor
Hdfs
Jenkins
Kubernetes
Longhorn
Open Shift
Python
Redhat Linux
Rke
Vmware Vsphere
Yarn
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The GEN BI Engineer will design and deliver innovative BI solutions, collaborate with stakeholders, and build scalable systems using data for strategic decisions.
Top Skills:
BigQueryGCPPower BIPythonSQL
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
As a Principal Salesforce Engineer, you'll design Salesforce solutions, manage Salesforce environments, develop Apex code, and ensure compliance with IT controls while collaborating with cross-functional teams.
Top Skills:
ApexGearsetJIRALightning Web ComponentsSalesforceSalesforce CpqSOQLSoslVisualforce
Cloud • Information Technology • Productivity • Software • Automation
Lead a team focused on developing enterprise-grade AI platforms. Oversee technical execution, drive innovation, and ensure systems meet scalability and compliance requirements.
Top Skills:
AnthropicAWSAzureAzure OpenaiBigQueryDatabricksFaissGCPGithub ActionsGrafanaJenkinsKafkaKinesisKubernetesLangchainLlamaindexMilvusMlflowOpenaiOpentelemetryPineconePrometheusSnowflakeTerraformWeaviate
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
