Designs, builds, and optimizes scalable data platforms, distributed systems, and high-volume ETL pipelines supporting trading and business operations. Develops solutions using Java, Python, Kafka, microservices, and modern databases while ensuring reliability, governance, data quality, and performance. Automates operational processes, improves application scalability, collaborates with trading and technology teams, and mentors junior engineers.
Job Purpose
As a Data Engineer, you will design, build, and optimize scalable data platforms that support trading and business functions across global markets. You will architect high-performance data systems, develop robust ETL pipelines, and enable efficient processing of large-scale datasets while ensuring reliability, scalability, and data governance standards.
Responsibilities- Design, develop, and maintain large-scale data platforms and processing systems that support trading and business operations.
- Build and optimize data ingestion, transformation, and storage solutions to improve performance, reliability, and operational efficiency.
- Develop, manage, and enhance ETL pipelines capable of handling large-volume, high-frequency datasets.
- Design and implement fault-tolerant, scalable, and distributed data architectures using modern engineering frameworks and technologies.
- Leverage Java, Python, Kafka, and microservices-based architectures to build high-performance data engineering solutions.
- Drive data governance, quality, and platform best practices while ensuring data consistency and integrity across systems.
- Automate operational processes, optimize existing applications, and continuously improve system scalability and maintainability.
- Collaborate closely with trading, technology, and business teams while mentoring junior engineers and contributing to the growth of the engineering organization.
- Bachelor's degree in Computer Science, Engineering, or a related technical discipline with an understanding of financial markets and trading concepts.
- 4+ years of experience in data engineering, data platform development, or large-scale data processing environments.
- Strong programming skills in Java and Python with experience building enterprise-grade applications and services.
- Experience working with microservices architectures, Spring Framework, and distributed systems.
- Strong understanding of ETL development, data warehousing concepts, and large-scale data pipeline design.
- Experience with messaging and streaming technologies such as Kafka and automation using shell scripting.
- Hands-on experience with relational and analytical databases, preferably ClickHouse and PostgreSQL.
- Knowledge of CI/CD practices and tools such as Jenkins, with a focus on automation and deployment reliability.
- Experience designing scalable, fault-tolerant, and high-performance systems capable of handling large datasets.
- Exposure to trading firms, capital markets, or international exchange data environments will be an added advantage.
- Strong analytical, problem-solving, and communication skills with the ability to work effectively across cross-functional teams.
- Demonstrated attention to detail, process orientation, continuous learning mindset, and the ability to mentor junior team members.
Edelweiss Global Markets Mumbai, Maharashtra, IND Office
Mumbai, India
Similar Jobs
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Lead month-end and quarterly close activities across general ledger, accounts payable, accounts receivable, billing, revenue, accruals, intercompany, and reconciliations. Review financial statements, analyze variances, ensure US GAAP compliance, maintain audit-ready controls, and resolve accounting issues. Serve as an accounting subject matter expert while partnering with shared services and cross-functional teams. Drive process simplification, standardization, automation, close-cycle improvements, and financial systems transformation.
Top Skills:
Account Reconciliation (Arcs)Financial Consolidation And Close (Fccs)OracleOracle EpmSalesforceUs Gaap
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Build and maintain reliable, scalable Java and Go backend microservices for a cloud-native SaaS identity analytics product. Responsibilities include designing APIs, implementing features, writing unit and end-to-end tests, conducting code reviews, supporting AWS infrastructure, collaborating with stakeholders, leading small projects, participating in on-call support, and troubleshooting escalated system issues.
Top Skills:
Amazon EksAWSClaudeCursorGoGrafanaGraphQLJavaKafkaMicroservicesNoSQLPrometheusRedisRestSpring BootSQL
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Leads six full-stack developers building and maintaining a fintech website while owning GA4, SQL-based analytics, ETL pipelines, dashboards, data quality, and business insights. Sets technical direction, oversees architecture, performance, reliability, and security, partners with Product, UX, and Marketing, manages the website and analytics roadmap, and coaches engineers through hiring, development, and performance management.
Top Skills:
Amazon AthenaAWSDashboardsData PipelinesETLGoogle Analytics 4SQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
