Maintain and optimize production LLM and VLM services, including Flask/FastAPI microservices, Dramatiq queues, REST APIs, and Uvicorn/Gunicorn deployments. Design prompt strategies, feedback and evaluation pipelines, and AI routing integrations while monitoring latency, token usage, quality, and errors. Collaborate with engineering teams on scalable microservices, Dockerized deployments, CI/CD, security, and cloud infrastructure.
Role Overview
We are looking for an AI Engineer to maintain and enhance the AI-driven backbone of the Sootra platform. This role involves ensuring production stability of LLM/VLM pipelines, optimizing model interactions, maintaining APIs and queues, and building feedback loops that continuously improve AI outputs.
Responsibilities
- Maintain and optimize LLM- and VLM-powered services for content generation, compliance scoring, and campaign testing.
- Manage and scale Flask/FastAPI microservices, ensuring high uptime and low latency.
- Maintain Dramatiq queues for async AI workflows, campaign generation, and pipeline orchestration.
- Deploy, monitor, and debug Uvicorn/Gunicorn-based hosting in production environments.
- Integrate with OpenRouter and equivalent LLM routing tools to balance cost, latency, and quality.
- Design and refine prompt engineering strategies for reliability, context-awareness, and compliance.
- Build and maintain feedback pipelines for AI model evaluation (human-in-the-loop scoring, automated quality checks, reinforcement).
- Expose and maintain REST APIs for AI services, ensuring secure, versioned endpoints.
- Collaborate with backend/frontend teams to keep microservice architecture aligned and maintainable.
- Track token consumption, latency, and error rates to ensure production-grade performance.
Required Skills
- Programming: Strong in Python, with experience in production-grade codebases.
- Frameworks: Flask (for APIs), FastAPI (optional), Uvicorn/Gunicorn for async hosting.
- Queues/Workers: Dramatiq (or Celery/RQ equivalent) for background jobs.
- AI/ML: Hands-on with LLMs and VLMs, including prompt engineering, fine-tuning, and evaluation.
- AI Infrastructure: Familiar with OpenRouter or equivalent LLM/VLM routing & fallback tools.
- Architecture: Experience designing and maintaining microservice architectures.
- APIs: Strong experience with REST API design (auth, rate limiting, documentation).
- Production: Dockerized deployments, CI/CD pipelines, logging/monitoring, error handling.
- Feedback Loops: Building structured evaluation/feedback systems for AI model performance.
- Cloud: AWS/GCP experience preferred (deployment, monitoring, scaling).
Experience
- 3–5 years as an AI Engineer or Python Backend Engineer working with production systems.
- Prior work with SaaS platforms, LLM/VLM integrations, or AI-first products is highly valued.
Demonstrated ability to maintain AI pipelines in production, not just prototypes.
Similar Jobs
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
Own the technical direction and end-to-end delivery of a backend engineering team supporting high-volume supply chain visibility platforms. Design distributed microservices, event-driven systems, data models, integrations, and production architecture. Drive engineering standards, reliability, observability, technical debt reduction, risk management, code quality, mentoring, hiring, and cross-functional coordination. Remain hands-on in Java or Go development while partnering with Product and Engineering Managers to deliver complex multi-quarter initiatives.
Top Skills:
AWSCi/CdConfluenceDcsa ApisDockerEdi/EdifactGitGoJavaJIRAKafkaKubernetesOmsOraclePostgresRedisSAPSpring BootSQLTmsWmsX12
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead design, build, and maintain scalable infrastructure and platform services. Improve reliability, automation, CI/CD, observability, and security. Collaborate with engineering teams to define best practices and troubleshoot production incidents.
Cloud • eCommerce • Logistics • Software
Own the product lifecycle for AI-powered inventory management features. Translate business and customer needs into requirements, identify and prioritize AI use cases, define product vision, and manage scope, schedules, costs, and trade-offs. Partner with UX, engineering, security, legal, and leadership to build, test, monitor, and responsibly launch AI capabilities. Track metrics such as accuracy, adoption, and time savings while supporting globally distributed teams.
Top Skills:
Agile MethodsAi ModelsArtificial IntelligenceLarge Language ModelsMachine LearningOpen-Source Ai Tools
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
