The AI Engineer will optimize and maintain AI-driven services on the Sootra platform, focusing on LLM/VLM pipelines, API management, and production stability.
Role Overview
We are looking for an AI Engineer to maintain and enhance the AI-driven backbone of the Sootra platform. This role involves ensuring production stability of LLM/VLM pipelines, optimizing model interactions, maintaining APIs and queues, and building feedback loops that continuously improve AI outputs.
Responsibilities
- Maintain and optimize LLM- and VLM-powered services for content generation, compliance scoring, and campaign testing.
- Manage and scale Flask/FastAPI microservices, ensuring high uptime and low latency.
- Maintain Dramatiq queues for async AI workflows, campaign generation, and pipeline orchestration.
- Deploy, monitor, and debug Uvicorn/Gunicorn-based hosting in production environments.
- Integrate with OpenRouter and equivalent LLM routing tools to balance cost, latency, and quality.
- Design and refine prompt engineering strategies for reliability, context-awareness, and compliance.
- Build and maintain feedback pipelines for AI model evaluation (human-in-the-loop scoring, automated quality checks, reinforcement).
- Expose and maintain REST APIs for AI services, ensuring secure, versioned endpoints.
- Collaborate with backend/frontend teams to keep microservice architecture aligned and maintainable.
- Track token consumption, latency, and error rates to ensure production-grade performance.
Required Skills
- Programming: Strong in Python, with experience in production-grade codebases.
- Frameworks: Flask (for APIs), FastAPI (optional), Uvicorn/Gunicorn for async hosting.
- Queues/Workers: Dramatiq (or Celery/RQ equivalent) for background jobs.
- AI/ML: Hands-on with LLMs and VLMs, including prompt engineering, fine-tuning, and evaluation.
- AI Infrastructure: Familiar with OpenRouter or equivalent LLM/VLM routing & fallback tools.
- Architecture: Experience designing and maintaining microservice architectures.
- APIs: Strong experience with REST API design (auth, rate limiting, documentation).
- Production: Dockerized deployments, CI/CD pipelines, logging/monitoring, error handling.
- Feedback Loops: Building structured evaluation/feedback systems for AI model performance.
- Cloud: AWS/GCP experience preferred (deployment, monitoring, scaling).
Experience
- 3–5 years as an AI Engineer or Python Backend Engineer working with production systems.
- Prior work with SaaS platforms, LLM/VLM integrations, or AI-first products is highly valued.
Demonstrated ability to maintain AI pipelines in production, not just prototypes.
Top Skills
AWS
Docker
Dramatiq
Fastapi
Flask
GCP
Gunicorn
Openrouter
Python
Uvicorn
Similar Jobs
.png)
Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Halter seeks expressions of interest for various roles across teams like Engineering, Product, Hardware, Sales, and Support. Applicants should be passionate about impactful work and problem-solving. A cover letter is required to express interest and qualifications.
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
The Country Director will lead Coinbase's business in India, defining strategies for growth, overseeing product launches, and engaging with regulators while building a high-performing team.
Top Skills:
BlockchainBusiness DevelopmentCryptoEcommerceFintechMarketingProduct ManagementRegulatory Compliance
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Operate and automate global cloud infrastructure for a large SaaS platform. Build tools in Python/JavaScript/Bash, contribute to config management and IaC, troubleshoot production systems, perform root cause analysis, and prepare services for production. Support services like databases, DNS, mail, Puppet, Kubernetes and RHOSP while integrating AI into tooling and workflows.
Top Skills:
AnsibleBashCactiCentos)CfengineChefIcingaJavaJavaScriptKubernetesLinux (RedhatLogstashMariadbMySQLNagiosNginxPostgresPuppetPythonRabbitMQRhospServicenowSplunkWindsurf
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
