Rifa AI Logo

Rifa AI

Client QA & Operations Analyst

Posted 2 Hours Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in India
Junior
In-Office or Remote
Hiring Remotely in India
Junior
Audit AI agent call and chat transcripts against quality and compliance standards, identify regressions and edge cases, document actionable engineering issues, and participate in client QA and audit calls. Reconcile internal findings with client audits, explain performance data, and provide recurring quality insights to the Technical Program or Product Manager for release communications and client reviews.
The summary above was generated by AI
About us

Rifa AI is building the AI agents platform for contact centers in regulated industries.

Enterprises in these industries want AI agents handling their customer operations and mostly can't deploy them. It's not a model problem. Horizontal platforms lack governance, release processes, and change management, and in a domain where every call can be reviewed by a regulator, that's disqualifying. Building an AI agent has never been easier. Deploying one an enterprise can trust has never been harder. That harder problem is the one we work on.

Our platform turns a company's written procedures into AI agents: voicebots that hold real-time conversations, take actions in the client's CRM, and stay within the limits the client has set. Every release is gated by an automated testing suite, and every conversation feeds a post-analysis platform. We're live in production today, handling debt collection calls for US financial services clients.

The engineering convictions behind it: evaluation methodology, not model capability, is the bottleneck. Every rule and decision trace becomes part of a company's context graph. Observability goes beyond logging. And our Agent Studio lets engineers, non-engineers, and auditors collaborate to build and improve AI agents with the right guardrails to achieve the expected business outcomes.

Rifa was founded by Sameer Fulzele (IIT Bombay). We're a small team of exceptionally capable, passionate engineers with paying enterprise clients and growing revenue, backed by Seaborne Capital, a founder-first firm of exceptional industry operators that works closely with its founders, and by angel investors who are veterans of enterprise software and operators in the accounts receivable industry.

About the role

This is the hands-on quality and operations role behind our enterprise client relationships. You'll live in the transcripts and performance data: auditing how our AI agents handle real client conversations, catching issues before and after clients do, and turning what you find into clear, actionable work for the engineering team.

You'll be client-facing: on audit calls, walking client-side QA and compliance teams through findings, and reconciling our read of bot performance with theirs. It's a role for someone precise, curious, and organized, comfortable with data and detail, and confident explaining what they found and why it matters.

You'll report to the Technical Program / Product Manager, who owns the overall client relationship, and you'll be their eyes and ears on day-to-day quality.

What you'll do
  • Audit transcripts and bot performance. Review call and chat transcripts in Reflect, our observability platform, evaluate how our AI agents performed against quality and compliance standards, and score conversations consistently and fairly.

  • Find and document issues. Spot regressions, compliance gaps, mishandled flows, and edge cases in agent behavior, and document them clearly, with the transcript or metric as evidence.

  • Convey issues to engineering. Translate what you find into well-written Linear cards that engineers can act on without a follow-up call: clear repro steps, the affected conversation, and why it matters to the client.

  • Get on client calls. Join client QA and audit calls, walk their teams through findings, and answer questions on how our agents are performing.

  • Reconcile audits with the client. Compare our QA findings against the client's own audit team's results, work through discrepancies, and align on a shared, defensible view of quality.

  • Support the client relationship. Feed insights, recurring issues, and trends back to the Technical Program / Product Manager to inform release communications, weekly syncs, and monthly reviews.

What you'll bring
  • 1 to 3 years in QA, operations, quality analysis, delivery support, or a similar client-facing role, ideally at a B2B SaaS, BPO, or financial-services company.

  • Comfort with data and transcripts as evidence. You can read a call log or a QA scorecard, form your own view, and back it up, not just relay what someone else said.

  • Clear written and spoken English. A large share of this job is written: issue tickets, audit notes, and client-facing summaries that hold up under scrutiny.

  • US-hours overlap. Reliable daily overlap with US business hours (ET/CT), which in practice means a late-afternoon-into-evening IST schedule, and comfort being on a call with a client's ops or compliance team.

  • Precision and follow-through. You're organized, detail-oriented, and you close the loop on what you find.

Even better...
  • Experience in debt collections, lending, or another regulated financial-services domain, or familiarity with FDCPA / compliance workflows

  • Hands-on experience with QA tooling, call-quality scoring, or observability/audit dashboards

  • Familiarity with Linear (or similar issue trackers like Jira) and how good engineering tickets are written

  • An interest in AI / conversational systems and how they behave in production

How we work

Small teams per client, with real ownership. We review each other's work, we write things down, and we'd rather hear an honest "I don't know yet" than a confident wrong answer.

Our values
  • Trust: We do the right thing, especially when nobody is checking. Clients hand us regulated conversations with their own customers, and we earn that every day.

  • Transparency: We write things down, share the real numbers, and say "I don't know yet" out loud, with each other and with clients.

  • Technically best solution: We choose what's right, not what's easiest or trendiest. When we notice we got it wrong, we fix it.

  • Decisiveness: We decide quickly with the information we have, commit, and correct course fast when reality disagrees.

  • Simplicity: We keep systems, processes, and words simple. Complexity is a cost we pay only when it clearly buys something.

Similar Jobs

Junior
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Develops global medical communications content, including manuscripts, abstracts, congress materials, literature reviews, educational resources, presentations, and multimedia. The role researches, organizes, interprets, quality-checks, and ensures compliant delivery of medical content while coordinating with cross-functional teams. Responsibilities also include project tracking, issue resolution, stakeholder collaboration, and adoption of new content creation tools, including generative AI platforms.
Top Skills: Generative Ai
An Hour Ago
Remote or Hybrid
India
Entry level
Entry level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Owns the strategy, roadmap, backlog, prioritization, and delivery of a mobile digital banking product. The role gathers requirements, coordinates engineering and cross-functional teams, defines user stories and acceptance criteria, manages releases, monitors product metrics and feedback, drives enhancements, and ensures compliance with applicable banking regulations and industry best practices.
Top Skills: Digital BankingMobile Applications
An Hour Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Provide operational support and development for enterprise identity and access systems (Ping Identity/ForgeRock). Build features, perform unit testing, create QA test steps, update ITSM/process documentation, troubleshoot incidents, mentor juniors, and collaborate with global security, development, and product teams to improve authentication, SSO/MFA, and identity governance.
Top Skills: ForgerockGitIdentity GovernanceJenkinsMulti-Factor Authentication (Mfa)Ping IdentityPingamPingdsPinggatewayPingidmPostmanSingle Sign-On (Sso)

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account