Build and maintain large-scale PySpark/Spark data reconciliation pipelines on Hadoop/Big Data platforms; integrate with Kafka, APIs and microservices; support capital markets regulatory reporting and reconciliations; lead globally distributed teams, manage stakeholders, and deliver solutions with strong application design and optional UI integration.
Job Title: PySpark Data Reconciliation Engineer
- 7+ years of relevant experience in technology and development.
- Technical skillset required:
- (1) Language: Java or Python
- (2) Experience with BigData/Hadoop/Spark/Kafka
- (3) Experience with APIs and microservices architecture
- (4) UI Development and integration experience would be a plus.
- Domain required:
- Experience in a capital market domain.
- Experience in Regulatory reporting or reconciliations (tech) would be a big plus.
- Proven track record of delivering large scale projects with globally distributed teams.
- Strong experience in applications development, design paradigms. Previous experience with data domain would be a plus.
- Experience in stakeholder management and managing global technology team is a must.
- Consistently demonstrates clear and concise written and verbal communication
Similar Jobs
Financial Services
Lead CLM product strategy and roadmap, drive discovery and launches, partner with Legal and Sourcing, operationalize AI-extracted contract metadata, and deliver analytics-ready datasets while ensuring scalability, reliability, and strong customer value.
Top Skills:
AIAribaContract Lifecycle Management (Clm)IcertisPrompt Engineering
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a distributed design team to define and execute design vision for IT Services in Jira Service Management. Partner with product, engineering, research, and content to ship AI-enabled experiences, recruit and mentor designers, introduce AI-driven design practices, and drive multiple initiatives from idea to launch while communicating impact to leadership.
Top Skills:
AIJira Service ManagementRovo
Digital Media • Information Technology • News + Entertainment
Design, develop, and maintain microservices-based Python applications and RESTful APIs. Implement asynchronous processing, ensure test coverage and performance, support CI/CD and containerized deployments, mentor junior engineers, and collaborate with cross-functional teams to deliver scalable, reliable software.
Top Skills:
CeleryDjangoDjango Rest FrameworkDockerFastapiGitGitlabGitlab CiJenkinsKubernetesMongoDBNoSQLPostgresPythonRabbitMQRedisRestful ApisSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
