Leads end-to-end delivery of large-scale AI and software-engineering data programs, managing scope, timelines, quality, throughput, contributors, and costs. Designs workflows for coding datasets, agentic trajectories, reinforcement-learning environments, benchmarks, and evaluations. Builds quality-control systems, analyzes operational metrics, manages distributed technical contributors, communicates with AI lab customers, translates research goals into task specifications, automates reporting with code, and develops reusable operational playbooks.
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are looking for an experienced Technical Program Operations Lead to own the production systems behind large-scale AI and software-engineering data programs. You will turn complex research requirements into predictable delivery across quality, throughput, contributor performance, timelines, and cost.
Programs may include coding datasets, repository-level tasks, agentic trajectories, reinforcement-learning environments, benchmarks, code reviews, and rubric-based evaluations. This is an operations leadership role with a strong technical bar, requiring the ability to inspect code, understand tests, analyze quality signals, and improve workflows at scale.
Key Responsibilities
- Own end-to-end program delivery across scope, timelines, quality, throughput, contributor performance, and cost.
- Design and manage workflows for coding datasets, agentic trajectories, RL environments, benchmarks, and rubric-based evaluations.
- Identify operational bottlenecks and improve workflows through better instructions, sequencing, incentives, review systems, and capacity planning.
- Define contributor requirements and partner with talent teams to source, assess, onboard, train, and ramp distributed software engineers.
- Build team-lead and reviewer structures for programs involving 100–1,000+ contributors.
- Own quality-control systems and analyze datasets to identify trends, systematic errors, and root causes.
- Act as a primary customer contact for AI labs, communicating progress, risks, quality trends, and recovery plans.
- Translate research objectives into practical task specifications and challenge requirements when they may not produce the intended evaluation signal.
- Use Python, SQL, or similar tools to automate quality sampling, defect analysis, throughput reporting, and operational reviews.
- Convert successful workflows into reusable playbooks, quality controls, evaluation assets, and contributor-management systems.
- Share operational learnings and mentor other program leads.
Requirements
- Proven experience leading complex, multi-stakeholder programs in software engineering, technical program management, consulting, finance, startups, operations, or a similar environment.
- Strong analytical and problem-solving skills, including the ability to identify bottlenecks, define meaningful metrics, and improve production performance.
- Experience managing distributed teams, contributor networks, marketplaces, or large-scale technical operations.
- Strong customer-facing communication skills, including managing expectations, communicating risks, and building long-term client relationships.
- Ability to read and review code, understand test suites, and independently assess technical work.
- Working knowledge of at least one programming language such as Python, TypeScript, Java, or Go.
- Experience using data and operational metrics to monitor quality, throughput, performance, and delivery.
- Ability to operate effectively in environments where research requirements and priorities evolve quickly.
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead the architecture and development of scalable, data-intensive applications and AI-native platforms. Drive Generative AI and agentic system adoption across the product lifecycle, establish responsible AI practices, optimize AI system performance and cost, and provide technical leadership for complex implementations. The role also involves mentoring engineers, shaping technical strategy, developing data platforms, and collaborating cross-functionally to transform emerging product concepts into validated customer-facing solutions.
Top Skills:
Agentic AiAWSAzureCodex SdkDatabricksGenerative AiJavaLanggraphLarge Language ModelsOpenai Agents SdkPostgresReactSnowflakeSpring BootTypescript
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Owns complex Packet Core customer service requests from initiation through resolution, leading network investigations, root-cause analysis, incident response, and service improvements. Provides technical leadership during crises, coordinates global support teams, maintains technical knowledge, and develops stable customer solutions. The role requires extensive Ericsson Packet Core expertise, cloud and virtualization knowledge, Linux and IP networking skills, and strong customer-facing communication.
Top Skills:
Dns/IpworksDockerEpcEpgEricsson Packet CoreImsIp NetworkingKubernetesOpenstackPcc/PcgPcrfProps-CRanSapc/CcpcSgsn-MmeUnix/Linux
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Deliver and configure Ericsson Communication Services solutions, including CS Core and IMS products. Execute system, module, and acceptance testing; resolve technical delivery issues; maintain solution documentation; improve delivery processes; provide R&D feedback; and support knowledge transfer and customer competence building.
Top Skills:
Cloud InfrastructureCloud/NfviCs CoreCscfCtcDnsEnumEricsson Communication ServicesImsMgwMrfMsc-SMtasSbcSoftware Virtualization
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
