Gramian Consulting Group Logo

Gramian Consulting Group

Web Researcher (AI Benchmarking)

Posted 11 Days Ago
Remote
Hiring Remotely in India
Entry level
Remote
Hiring Remotely in India
Entry level
Design difficult open-web research problems for benchmarking frontier AI browsing agents. Responsibilities include constructing multi-step questions, validating clues through government and institutional sources, tracing evidence across archives and PDFs, documenting auditable citations, testing search difficulty, eliminating ambiguity, and delivering reproducible research documentation.
The summary above was generated by AI

About Us

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role overview

Our client is building advanced evaluation benchmarks for frontier AI browsing agents.

We are looking for highly skilled investigative researchers who can design research problems that remain difficult even for state-of-the-art AI systems with full web access. This is not a traditional subject-matter or content-writing role. The work is centered on open-web investigation, evidence tracing, source validation, and benchmark construction.

You will begin from a verifiable fact, work backwards to construct a difficult research question, and document a complete, auditable evidence trail showing how the answer can be independently verified.

CONTRACT: Short-term freelance/contractor assignment, 8 weeka

COMMITMENT: 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST

LOCATIONS: Remote, GLOBAL

Responsibilities
  • Design challenging open-web research problems for evaluating advanced AI browsing agents.
  • Start from objectively verifiable facts and construct questions that make those facts difficult to discover.
  • Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities.
  • Ensure every clue is independently verifiable and subject to clear constraints.
  • Research across government databases, institutional sources, archives, registries, and PDF documents.
  • Produce complete evidence trails citing exact pages, tables, sections, or records.
  • Record validation searches and document what obvious search approaches return.
  • Test whether research questions remain difficult across multiple search attempts.
  • Refine questions to eliminate ambiguity while preserving difficulty.
  • Deliver structured, reproducible research documentation.

Requirements
  • Background in reference librarianship, archives, or special collections.
  • Experience in investigative journalism or professional fact-checking.
  • Experience with OSINT, due diligence, KYC, or investigative research.
  • Background in patent, prior-art, or legal-discovery research.
  • Experience with genealogy or historical records research.
  • Experience with competitive quizzing, puzzle design, or puzzle-hunt construction.
  • Familiarity with JSON or structured data formats.

Similar Jobs

9 Hours Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Install, configure, integrate, test, and deploy the Ericsson Fintech Platform in customer environments. Ensure interoperability with internal/external systems, execute unit and white/black-box tests, produce MOPs and test reports, collaborate with architects and PMs, and support production activities across time zones.
Top Skills: DockerEricsson Fintech Platform (Efp)KubernetesLinuxMicroservicesMiddlewareMobile App IntegrationsMonitoring And ObservabilityMySQLPayment GatewayPublic CloudRestShell Scripting (Bash)SmsSoapTcp/IpTransaction Processing SystemsUnixUssdXml Apis
Yesterday
In-Office or Remote
Entry level
Entry level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Leads techno-commercial strategy for RAN engagements across East and North Africa. Translates radio technology into ROI, TCO, pricing, offer scope, negotiation, and value narratives. Partners with sales, pricing, contract management, presales, and technical domain teams to improve win rates, protect margins, and support profitable growth. Requires strong RAN expertise, complex telecom deal structuring, commercial modelling, stakeholder management, financial fluency, and negotiation skills.
Top Skills: 2G3G4G5GCloud ComputingCloud RanCore NetworksMassive MimoOpen RanOss/BssRanSoftware LicensingTransport Networks
Yesterday
In-Office or Remote
Entry level
Entry level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Supports CI/CD pipelines, cloud infrastructure provisioning, containerized deployments, automation, monitoring, troubleshooting, and security practices. Collaborates with software developers, testers, and cloud engineers in an agile environment while learning DevOps, DevSecOps, GitOps, and cloud-native engineering. The role also contributes scripts, testing, validation, performance optimization, and continuous improvement across cloud platforms.
Top Skills: 5GAWSBashCi/CdDevsecopsDockerGitGitopsGoGoogle Cloud Platform (Gcp)Infrastructure As Code (Iac)JavaKubernetesLinuxAzurePython

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account