HighLevel Logo

HighLevel

Lead Software Development Engineer in Test - AI

Posted 6 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Leads QA strategy and quality initiatives for AI products, architecting scalable automation frameworks and developing testing methodologies for RAG, hallucination, drift, and bias. Owns the AI quality charter and roadmap, influences architecture and cross-functional teams, coaches QA staff, and drives reliability and risk reduction. Bonus responsibilities include CI/CD, cloud platforms, MLOps monitoring, and AI workload performance testing.
The summary above was generated by AI

About HighLevel:
HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes.
To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently.
Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability.
Our People
With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home.
Our Impact
Every month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that.

Learn more about us on our YouTube Channel or Blog Posts.

About the Role:

    We are looking for a Lead Software Development Engineer in Test with deep expertise in AI tools and model testing. This role requires an individual who can define overall QA strategy, architect automation frameworks, and drive organisation-wide quality initiatives for our AI products. You will own the quality charter for the AI vertical, influence cross-functional teams, and play a key role in shaping the AI quality roadmap.

Requirements:

  • 7+ years of overall experience in QA/SDET roles
  • Deep expertise in AI tools & model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias
  • Proven experience in architecting large-scale, reusable, cross-platform automation frameworks
  • Strong leadership skills to coach and upskill an entire team, set best practices, and build a talent pipeline
  • Ability to influence cross-functional teams and participate in architecture discussions
  • Strong problem-solving skills with the ability to own decisions on test strategy, tools, frameworks, and AI testing methodologies

Responsibilities:

  • Define overall QA strategy and architect large-scale, reusable, cross-platform automation frameworks
  • Drive organization-wide quality initiatives and own the quality charter for the AI vertical
  • Possess deep expertise in AI tools & model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias
  • Own decisions on test strategy, tools, frameworks, and AI testing methodologies
  • Coach and upskill the entire team, set best practices, and build talent pipeline
  • Influence cross-functional teams, participate in architecture discussions, and align testing with business strategy
  • Responsible for end-to-end quality strategy at the product/vertical level
  • Shape AI quality roadmap, reduce organization-wide risk, and improve scalability and reliability

Bonus Points:

  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure).
  • Familiarity with MLOps pipelines and monitoring AI systems.
  • Exposure to performance and scalability testing of AI workloads.

EEO Statement:

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
We encourage you to review our Privacy Policy before submitting your application

Similar Jobs

2 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Security • Cybersecurity
Own global revenue recognition under ASC 606 and accounting processes including commissions, COGS, and leases. Review tax provisions, returns, transfer pricing, and subsidiary filings; support external audits and cross-functional reporting. Lead accounting projects, process improvements, and AI-driven workflow automation. Requires a CA, Big 4 high-tech experience, strong US GAAP and revenue recognition knowledge, ERP experience, advanced Excel skills, and excellent communication.
Top Skills: Ai Automation ToolsAsc 340-40Asc 606ExcelMS OfficeNetSuiteUs Gaap
6 Hours Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and deploys production AI assistants, copilots, agents, RAG systems, and intelligent automations. Integrates LLMs with Snowflake, AWS, enterprise applications, and workflow platforms to automate business processes. Builds backend services and serverless workflows, implements observability and responsible AI controls, and scales validated prototypes into reliable production solutions. Partners with technical and business teams to improve decision-making, efficiency, quality, and cost performance.
Top Skills: AirflowAmazon Api GatewayAmazon BedrockAmazon EventbridgeAmazon S3Amazon SagemakerAnthropicAws LambdaAws Step FunctionsAzure OpenaiDbtGeminiGoMcpMicrosoft Power AutomateMlflowN8NOauthOpenaiPythonRbacSalesforceServicenowSnowflakeSnowflake Cortex SearchSnowflake Ml RegistrySnowparkSsoTypescriptUipathWeights & BiasesWorkato
6 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Perform software verification and validation for embedded aerospace platform components. Develop test plans, conduct requirement- and scenario-based testing, execute change impact analyses, resolve technical issues, support audits, and collaborate with stakeholders. The role requires embedded C/C++ and RTOS expertise, emulator and debugger experience, testing tools, technical leadership, and stakeholder management.
Top Skills: BitbucketC++DeosDoors NgEmbedded CIcdJIRALauterbachLdraLinuxRtosVectorcast/Cover

What you need to know about the Mumbai Tech Scene

From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account