Designs and maintains a centralized AI platform and agentic framework supporting secure deployment, management, and integration of AI agents. Responsibilities include building scalable agentic solutions, developing unified APIs, integrating agents into applications, optimizing cloud-native workloads, ensuring security and compliance, conducting capacity planning, mentoring engineers, and shaping the platform roadmap.
Overview
Cotiviti is seeking an experienced AI Engineer to design, build, and maintain a cutting-edge agentic framework and centralized AI platform that will serve as the backbone of our organization's AI initiatives. This role will be responsible for creating a unified interface that enables teams across the company to securely deploy, manage, and access AI agents while ensuring seamless data integration and platform reliability. The role will work closely with Data Scientists, MLOps engineers, Data Engineers, and Product Engineering teams.
Responsibilities- Design and implement scalable agentic solutions for diverse use cases
- Leverage a broad stack of Open Source AI technologies to build and maintain a centralized AI platform with unified APIs for cross-functional team access and build various types of agents
- Work with Product Engineers to integrate AI agents into customer-facing applications and internal tools
- Lead technical discussions, mentor junior engineers, and help set the technical vision for the AI platform roadmap.
- Ensure compliance with security, privacy, and regulatory requirements across the software development lifecycle.
- Optimize performance of AI-powered workloads across compute and storage layers using cloud-native and open-source solutions.
- Conduct performance analysis and capacity planning to ensure platform scalability.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of software engineering experience, including 4+ years working on AI/ML platforms or infrastructure.
- Experience in building large-scale distributed systems and microservices.
- Strong programming skills in Python.
- Hands-on experience with agentic AI frameworks such as LangChain, LangGraph, CrewAI, AutoGen, or similar.
- Experience with containerization and orchestration (e.g., Docker, Kubernetes).
- Understanding of MLOps tools such as MLflow, Kubeflow, SageMaker, Vertex AI, or Databricks
- Cloud platform experience (AWS, GCP, or Azure).
- Worked on low-code automation platforms such as n8n, Zapier, Copilot Studio, and similar tools.
Similar Jobs
Information Technology • Consulting
Develop, train, deploy, and maintain machine learning and generative AI solutions, including predictive models, NLP applications, chatbots, LLMs, and agentic AI systems. Design scalable ETL pipelines, optimize databases, process large datasets with Spark and Snowflake, and create business visualizations. The role requires expertise across Python, SQL, cloud AI platforms, machine learning frameworks, databases, and data engineering.
Top Skills:
Agentic AiAmazon S3Amazon SagemakerSparkAWSAws LambdaAzure AiBertETLGCPGptHugging FaceLarge Language ModelsMatplotlibAzureMicrosoft TeamsMongoDBMySQLNumpyPandasPostgresPower BIPythonPyTorchScikit-LearnSeabornSnowflakeSQLTableauTensorFlowVertex Ai
Healthtech
Lead the architecture and enterprise strategy for scalable, secure AI systems, including data pipelines, model platforms, inference, integrations, MLOps, generative AI, RAG, and AI safety guardrails. Evaluate technology stacks, optimize cloud infrastructure costs, guide legacy modernization, and ensure privacy and compliance. Partner with Data Science, DevOps, Product, business leaders, and customers while leading complex architecture initiatives, technical reviews, mentoring, and executive communication.
Top Skills:
AgileAnsibleApi DesignAws SagemakerAzure MlBentomlCC++CcpaCloud-Native ArchitectureCobolCognosCSS3Data WarehousingDb2Distributed SystemsGcp Vertex AiGdprHadoopHipaaHTML5ImsInfrastructure As CodeJ2EeJavaJavaScriptJSONKubeflowLlmsMicroservicesMlflowMlopsOraclePegaPyTorchRagSASSQLTensorFlowTeradataTerraformTransformer ArchitecturesVector DatabasesVisual BasicWaterfallXML
Information Technology • Consulting
Designs and leads enterprise AI Factory and GPU infrastructure architectures spanning compute, networking, storage, Kubernetes, cloud, security, observability, and AI/ML platforms. Assesses workloads, develops reference architectures and detailed designs, performs capacity planning and technology evaluations, leads proof-of-concepts, and supports deployment, migration, troubleshooting, and production transition. Collaborates across infrastructure, security, cloud, data, application, and operations teams to ensure scalable, secure, reliable, and cost-effective AI platforms.
Top Skills:
100G/200G/400G/800G EthernetAWSAzureBgpBluefield DpuCephCudaDcgmDell PowerscaleEcmpEcnEvpn/VxlanGpu OperatorGpudirect RdmaGpudirect StorageGrafanaHpc SchedulersIamInfinibandJaxKubernetesLinuxMtuNcclNetappNetrisNfsNgcNvidia A100Nvidia Ai EnterpriseNvidia B200Nvidia ConnectxNvidia H100Nvidia H200NvlinkNvmeNvme-OfNvswitchOpentelemetryPamPciePfcPrometheusPure FlashbladePyTorchQosQuantumRbacRdmaRocev2SpectrumSpectrum-XSupernicTensorFlowVastVlanVrfWeka
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
