Design, develop, and maintain scalable data pipelines (PySpark/Apache Spark); process large-scale structured and unstructured data; build real-time analytics for cloud and edge devices; performance-tune and debug Spark jobs; collaborate with data scientists, data engineers, and firmware teams; apply distributed computing and data warehousing/lake concepts.
Location: This position will be based in Bangalore/Mumbai, India
Role and Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Apache Spark.
- Process and analyze large-scale structured and unstructured datasets in distributed environments.
- Responsible for building real-time analytics on cloud and edge devices
- Solve challenging data and architectural problems using cutting edge technology
- Cross functional collaboration with data scientists / data engineering / firmware controls teams
Skills and Experience:
- Strong Java/ Scala programming/debugging ability and clear design patterns understanding, Python is a bonus
- Understanding of Kafka/ Spark / Flink / Hadoop / HBase etc. internals (Hands on experience in one or more preferred)
- Implementing data wrangling, transformation and processing solutions, demonstrated experience of working with large datasets
- Experience in performance tuning and debugging Spark jobs
- Good understanding of distributed computing principles
- Knowhow of cloud computing platforms like AWS/GCP/Azure beneficial
- Exposure to data lakes and data warehousing concepts, SQL, NoSQL databases
- Working on REST API’s, gRPC are good to have skills
- Ability to adapt to new technology, concept, approaches, and environment faster
- Problem-solving and analytical skills
- Must have a learning attitude and improvement mindset
Qualifications:
- MTech/M.S with emphasis in computational or decision sciences preferred
- 3+ years of relevant experience
Bloom Energy Mumbai, Maharashtra, IND Office
Mumbai, India
Similar Jobs
Software
Design, implement, and lead large-scale generative AI and ML systems (LLM fine-tuning, RAG, agents, Graph ML). Build REST APIs, deploy with Docker/Kubernetes, optimize big-data workflows, mentor engineers, and operate ML services on cloud platforms.
Top Skills:
Anomaly DetectionAWSAzureBig DataCi/CdData MiningDockerDocument DatabasesFastapiGenerative AiGCPGraph MlKnowledge BasesKubernetesLlmsNoSQLPythonPyTorchRagRestful ApisSagemakerTensorrtTriton
Financial Services
Leads BI modernization and migration initiatives, developing Cognos reports, semantic layers, data models, dashboards, and Snowflake or Databricks datasets. Migrates SAP BusinessObjects content, supports Sigma adoption, optimizes SQL and reporting performance, and ensures data quality, governance, testing, and production reliability. Partners with data and business teams on reusable data products, migration planning, incident resolution, and AI-assisted engineering practices.
Top Skills:
AWSChatgptCopilotDatabricksDatabricks GenieIbm CognosMaster Data LakePythonQlik SenseSap BusinessobjectsSigma ComputingSnowflakeSnowflake CortexSQLTableau
Financial Services
Lead development of agentic AI systems, LLM and NLP applications, MCP integrations, scalable data pipelines, and cloud-based client-facing solutions for financial services. Architect distributed systems with strong observability, security, regulatory compliance, and responsible AI controls. Govern AI-assisted software development practices, coach engineering teams, and establish standards for secure coding, testing, validation, and automation. Collaborate with product and business stakeholders to deliver reliable, scalable AI-driven technology.
Top Skills:
Agentic AiAgileAnthropic Claude CoworkAutogenAWSAzureCi/CdCloud ComputingCrewaiData PipelinesDevsecopsJavaLangchainLanggraphLarge Language Models (Llms)LlamaindexMicroservicesModel Context Protocol (Mcp)Natural Language Processing (Nlp)Openai FrontierPythonSdlcSemantic Kernel
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
