NVIDIA
Senior System Software Engineer – Accelerated Microservices and Libraries
Be an Early Applicant
Design, develop, and optimize real-time computer vision and vision-language model inference microservices and libraries. Build video ingestion, preprocessing, model serving, integration, and regression testing capabilities. Profile latency, throughput, GPU memory, concurrency, and model accuracy across platforms. Collaborate with engineering and product teams to deliver milestones and own component readiness through release and post-release debugging.
We are looking for a senior software engineer to contribute to building accelerated microservices and libraries for our harnesses and agents. In this role, you will be part of an engineering team designing and developing microservices and libraries and optimizing these for relevant metrics.
What you will be doing:
- Contribute to design and development of accelerated microservices and libraries
- Collaborate with peer engineering and Product Management teams to understand requirements and translate these into deliverables across milestones.
- Design, develop, and maintain real-time vision-language model inference microservices, from video ingestion and preprocessing through model serving and downstream integration.
- Develop automated functional, accuracy, and performance regression tests, and own component readiness through integration, release, and post-release debugging.
- Profile and optimize end-to-end latency, throughput, GPU memory usage, and concurrent user capacity across platforms.
What we need to see:
- Masters or Bachelors degree in Computer Science, or related engineering field
- 8+ years of overall experience in software development , a strong technical foundation in software design principles and strong programming skills in C/C++ and Python.
- Hands-on experience building microservices using containers, REST APIs, and asynchronous messaging.
- Hands-on experience integrating and serving computer vision and vision-language models in production.
- Understanding of real-time video processing and the tradeoffs among latency, throughput, and resource utilization and strong debugging skills.
- Experience evaluating model quality and diagnosing accuracy or performance regressions across model, preprocessing, and inference-runtime changes.
Ways to stand out from the crowd:
- Experience delivering end-to-end video AI applications, including video ingestion, inference, tracking, analytics, and downstream integrations, using technologies such as RTSP and FFmpeg.
- Background with NVIDIA DeepStream, TensorRT, Triton Inference Server, CUDA, or comparable technologies.
- Experience optimizing and profiling GPU inference pipelines, including batching, memory management, and concurrent model execution.
- Experience with stateful streaming inference, KV-cache management, batching, quantization, and their impact on serving performance.
- Experience profiling GPU applications with tools such as NVIDIA Nsight Systems and deploying inference services across x86 and ARM platforms.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and passionate people in the world working for us. Are you a creative problem solver with a passion for solving real-world problems with AI? If so, we want to hear from you.
NVIDIA Mumbai, Maharashtra, IND Office
No. 127, Andheri Kurla Road, Village, Chakala, Andheri East, Mumbai, Maharashtra, India, 400093
Similar Jobs
Security • Cybersecurity
Own global revenue recognition under ASC 606 and accounting processes including commissions, COGS, and leases. Review tax provisions, returns, transfer pricing, and subsidiary filings; support external audits and cross-functional reporting. Lead accounting projects, process improvements, and AI-driven workflow automation. Requires a CA, Big 4 high-tech experience, strong US GAAP and revenue recognition knowledge, ERP experience, advanced Excel skills, and excellent communication.
Top Skills:
Ai Automation ToolsAsc 340-40Asc 606ExcelMS OfficeNetSuiteUs Gaap
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
The Head ASP Management is responsible for procurement of ASP services, vendor relationships, contractual compliance, quality delivery, and supplier performance evaluation while driving cost efficiency and improvements in service delivery processes.
Top Skills:
AspMicrowaveOhsRan
Financial Services
Lead complex technology programs from planning through delivery, managing technical requirements, resources, budgets, timelines, risks, and cross-functional stakeholders. Collaborate with engineering, product, and business teams to align program objectives with business goals. Apply analytical reasoning, vendor management, agile methodologies, and data-driven optimization to improve program performance, mitigate roadblocks, and promote innovation.
Top Skills:
Agile Methodologies
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
