Top Tech Jobs & Startup Jobs in Mumbai

2 Days AgoSaved
Remote
India
Senior level
Senior level
Automotive • Other
Research, design, and train large-scale transformer and hybrid foundation models. Diagnose training instabilities, optimize scaling tradeoffs, define next-gen architectures, develop loss and alignment strategies (RLHF/DPO/GRPO), and lead distributed training (FSDP, ZeRO-3, tensor/pipeline parallelism) with mixed precision and gradient checkpointing while partnering with ML systems teams.
Top Skills: AdafactorAdamwAlibiBf16ChinchillaCloudContrastive ObjectivesDistributed TrainingDpoEdgeFp8FsdpGradient CheckpointingGrouped Query Attention (Gqa)GrpoLarge Language ModelsLearning-Rate SchedulersLionMixture-Of-Experts (Moe)MultimodalNext-Token PredictionPipeline ParallelismRlhfRopeScaling LawsTensor ParallelismTransformer ArchitecturesWarmup SchedulersZero-3
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account