Optiver Logo

Optiver

Senior Data Engineer

Posted 7 Days Ago
Be an Early Applicant
Mumbai, Maharashtra
Senior level
Mumbai, Maharashtra
Senior level
As a Senior Data Engineer at Optiver, you will design and manage scalable data pipelines, collaborate with research teams, optimize data processing, and mentor emerging talent. This role involves transforming workflows into production-ready solutions and ensuring data availability while aligning costs with performance targets.
The summary above was generated by AI

WHO WE ARE

Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and risk management. By providing liquidity on multiple exchanges across the world in various financial instruments we participate in the safeguarding of healthy and efficient markets. We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products: listed derivatives, cash equities, ETFs, bonds and foreign currencies.

In Asia Pacific, Optiver was one of the first global market makers to establish a presence in the region, with the incorporation our Sydney office in 1996. Since then, we have expanded our footprint by establishing offices in Taipei (2005), Hong Kong (2007), Shanghai (2012) and Singapore (2021). The business in Mumbai is newly established and deemed to be an integral part of the APAC strategy, with an anticipation of significant growth over the coming years.


WHAT YOU'LL DO

Optiver Mumbai is looking for a seasoned Data Engineer to be the first data engineering hire in our India office, responsible for supporting and advancing data needs for our local research team. You’ll collaborate closely with researchers in India and the Data Platform team in Sydney to productionise workflows, optimise data processing at scale, and manage infrastructure costs efficiently. This role requires deep experience with Spark and Databricks, combined with a drive to work independently and deliver impactful results. You will be part of a high-impact team in a dynamic and challenging environment, and will play a pivotal role in designing and implementing data solutions to support our research objectives. You’ll be responsible for ensuring the seamless operation of data pipelines, enabling efficient data access, and optimising our platform to align with cost and performance targets. You’ll partner with cross-functional teams to ensure data-driven insights are leveraged in real-time across the organisation. This is a unique opportunity to pioneer data engineering in our India office, working alongside talented researchers and engineers who are driving Optiver’s data and analytics strategy forward.  

Other responsibilities include:

  • Data Pipeline Design & Development: Architect, build, and manage scalable data pipelines using Spark, Databricks, and proprietary tooling, ensuring high availability, scalability, and optimised performance.
  • Workflow Productionisation: Collaborate with the research team to transform experimental workflows into production-ready data pipelines that meet performance and reliability standards.
  • Cost Optimisation: Partner with the Data Platform team to monitor and optimise resource usage, adjusting configurations to balance performance and cost-effectiveness.
  • Cross-Functional Collaboration: Liaise with the Data Platform team in Sydney to maintain alignment on data strategy, tools, and best practices.
  • Monitoring & Tuning: Implement monitoring tools and fine-tune systems for optimal throughput, latency, and reliability, ensuring data is readily accessible and performant.
  • Documentation & Standards: Develop and maintain clear documentation of data pipeline architecture, processes, and best practices.
  • Mentorship & Guidance: Serve as a mentor to emerging data engineering talent in the team and provide technical guidance as the team scales.


WHO YOU ARE

Optiver needs our first India-based Data Engineer to be someone with:

  • 5+ years in data engineering with a focus on scalable data technologies (e.g., Spark, Lakehouse).
  • Proficiency in distributed data processing and building robust data pipelines, with hands-on experience in Spark and Python.
  • Demonstrated ability to lead projects autonomously, prioritise tasks, and deliver high-quality results.
  • Proven success collaborating with research and platform engineering teams to support data-driven projects.
  • Strong problem-solving abilities with a focus on efficient, scalable, and cost-effective solutions.
  • Excellent written and verbal communication skills to convey complex technical concepts to both technical and non-technical stakeholders.
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related fields.
  • Other preferred qualifications include familiarity with cloud-based architectures (e.g. AWS), large-scale relational database experience (e.g. PostgreSQL) and/or experience with real-time data streaming technologies (e.g. Kafka).

 
WHAT YOU'LL GET

  • The chance to work alongside diverse, intelligent, and driven peers in a rewarding environment.
  • Competitive remuneration, including an attractive bonus structure.
  • Training, mentorship and personal development opportunities.
  • Competitive benefits.

As an intentionally flat organisation, we believe that great ideas and impact can come from everyone. We are passionate about empowering individuals and creating diverse teams that thrive. Every person at Optiver should feel included, valued and respected, because we believe our best work is done together.

Our commitment to diversity and inclusion is hardwired through every stage of our hiring process. We encourage applications from candidates from any and all backgrounds, and we welcome requests for reasonable adjustments during the process to ensure that you can best demonstrate your abilities.

Top Skills

Python
Spark

Similar Jobs

Be an Early Applicant
2 Days Ago
Pune, Maharashtra, IND
1,100 Employees
Senior level
1,100 Employees
Senior level
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
As a Senior Data Engineer, you will design and maintain data solutions, build and optimize data pipelines, and transform raw data into actionable insights. Collaborating with stakeholders, you'll resolve integration issues and manage data infrastructure, while ensuring data security and delivering solutions that empower analytics across the organization.
11 Days Ago
3 Locations
10,000 Employees
Senior level
10,000 Employees
Senior level
Cloud • Information Technology • Sales • Security • Cybersecurity
The role involves developing, maintaining, and optimizing data pipelines using Matillion, SQL, and Python for the Snowflake data warehouse. It requires designing data models, collaborating with cross-functional teams, ensuring data quality, and troubleshooting ETL workflows.
24 Days Ago
2 Locations
120 Employees
Senior level
120 Employees
Senior level
Information Technology • Database • Consulting
The Senior Data Engineer will design, implement, and maintain data warehouse environments, manage data flow, and ensure code integrity using version control systems. They will also collaborate with data scientists and analysts to meet data needs and create comprehensive documentation for data engineering processes.

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account