Software Engineer III - AI (IND)

Position Title: Software Engineer III - AI (IND) Job Family: IFT > Engineering​/Dev Shift: Job Description: Job Title Software Engineer III - AI Requirement Type Full-Time Employee Job Location Gurugram/Bangalore Job Level Associate Hiring Manager Assistant Manager Product Management II Primary Skill AI Engineering Business VBC, HealthOs Individual Contributor /People Manager Individual Contributor ABOUT ELEVANCE HEALTH Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler.  It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 112 million individuals across 14 states. A regular in Fortune 500 list, Elevance Health ranked 18 in 2026. Gail Boudreaux , President and CEO of Elevance Health has been a consistent name in the Fortune list of most powerful women and currently holds 81st rank on this list. ABOUT CARELON GLOBAL SOLUTIONS Carelon Global Solutions (CGS) is a healthcare solutions company simplifying complex operational processes to improve the health of the healthcare system. Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health (Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers. Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective, and efficient. OUR MISSION & VALUES Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More. Our Values: Leadership | Community | Integrity | Agility | Diversity JOB PURPOSE - Carelon Global Solutions India is seeking a Software Engineer III - AI . - Reporting to the Assistant Manager Product Management II, you will lead the design and delivery of cloud-native data platforms and AI-enabled solutions on AWS. - You will own technical direction across Python services, Snowflake data warehousing, and production-grade AI/ML engineering—driving scalable architecture, engineering excellence, and end-to-end delivery for healthcare-grade systems. JOB RESPONSIBILITY Key Responsibilities - Proven delivery ownership across the SDLC: ability to lead discovery → design → build → test → release → operate for AI-powered products/services in production. - Strong Python engineering: production-grade APIs/services (e.g., FastAPI), async/background processing, packaging, type hints, testing, and performance profiling. - LLM application architecture: hands-on experience with LLM integration patterns (workflow orchestration, tool/function calling, structured outputs, routing, caching, guardrails, fallbacks). - RAG + vector search expertise: embeddings, chunking strategies, metadata modeling, hybrid retrieval, reranking, index lifecycle, and retrieval tuning using evaluation feedback. - Evaluation and quality engineering for GenAI: building eval harnesses, golden datasets, regression tests, automated scorecards, A/B testing, and human review workflows. - Responsible AI and security controls: PII handling, data minimization, content safety, prompt-injection defenses, access controls, audit logging, and compliance-ready design. - MLOps/LLMOps practices: CI/CD for prompts/models, environment promotion, reproducibility, experiment tracking, and monitoring for quality/cost/latency. - Cloud and deployment experience (AWS preferred): containerization and orchestration (ECS/EKS), serverless where applicable (Lambda/Step Functions), IAM/KMS/Secrets, VPC/networking basics, and CloudWatch observability. - Data engineering fundamentals for AI systems: reliable batch/stream pipelines, data quality checks, feature/embedding pipelines, and integration with data stores (object storage + relational/warehouse as needed). - DevOps and operational excellence: infrastructure-as-code familiarity, release strategies, incident handling, SLO/SLI mindset, and production monitoring/alerting. - Communication and stakeholder management: translate ambiguous problems into technical plans, manage trade-offs (accuracy vs. latency vs. cost vs. safety), and align with Product/Security/Legal. - Mentorship and technical leadership: guide design decisions, review code/architecture, and uplift team standards. QUALIFICATION - Minimum education: Bachelor’s degree in any Engineering Stream - Specialized training, certifications, and/or other special requirements: Nice to have - Preferred education: Computer Science/Engineering. EXPERIENCE - Minimum relevant experience – 4 years in AI engineering. - Preferred total experience – 4 years SKILLS AND COMPETENCIES - Production GenAI delivery experience: proven track record shipping AI/LLM-enabled features to production (not just prototypes), including operating and improving them post-launch. - LLM integration & orchestration: hands-on with LLM application patterns—prompting, structured outputs (JSON schemas), tool/function calling, routing, multi-step workflows/agents, caching, and fallbacks. - RAG + vector search expertise: embeddings, chunking strategies, retrieval tuning, hybrid search/reranking, metadata filtering, index lifecycle, and grounding/attribution strategies. - Evaluation-first engineering: ability to design offline/online evaluation (golden datasets, automated scorecards, regression tests), and measure quality across accuracy, safety, latency, and cost. - Responsible AI & security: prompt-injection defenses, data/privacy controls (PII redaction/minimization), content safety/guardrails, access control, audit logs, and compliance-ready designs. - Model/service productionization: build and deploy inference services (Python APIs), manage latency/cost trade-offs, rate limiting, retries/timeouts, and resilience under load. - Observability for AI systems: tracing, structured logs, metrics for latency/tokens/cost, quality monitoring, error analysis loops, and SLO mindset for AI user journeys. - Data fundamentals for AI: building reliable data/embedding pipelines, data quality checks, and working knowledge of warehouses/lakes to support AI features. - Cloud & DevOps: AWS-based deployment (ECS/EKS/Lambda/Step Functions), CI/CD, IaC (Terraform/CloudFormation), and secure secrets/key management. - Strong Python engineering: clean code, testing (unit/integration/contract), code quality tooling, and maintainable service architecture. - System design & communication: ability to translate ambiguous product needs into scalable AI system designs, make trade-offs explicit, and collaborate with Product/Security/Legal. - Leadership: mentor engineers, lead design reviews, and establish standards for AI engineering (evaluation, safety, reliability, and release practices). THE CARELON PROMISE Aligning with our brand belief of ‘limitless minds are our biggest asset’, we offer a world of limitless opportunities to our associates. It is our strong belief that one is committed to a role when it is not just what the role entails, but also what lies in its periphery that completes the value circle for an associate. This world of limitless opportunities thrives in an environment that fosters growth and well-being, and gives you purpose and the feeling of belonging. LIFE @ CARELON - Extensive focus on learning and development - An inspiring culture built on innovation, creativity, and freedom. - Holistic well-being - Our culture and initiatives are underpinned by diversity, equity and inclusion - Varied opportunities for rewards and recognitions - Competitive health and medical insurance coverage - Best-in-class amenities and workspaces - Policies designed with associates at the center. EQUAL OPPORTUNITY EMPLOYER Carelon Global Solutions is committed to a diverse and inclusive workplace and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. Reasonable Accommodation Our inclusive culture empowers Carelon Global Solutions to deliver the best results for our customers. We not only celebrate the diversity of our workforce, but we also celebrate the diverse ways we work. If you have a disability and need accommodation such as an interpreter or a different interview format, please ask for the Reasonable Accommodation Request Form. Disclaimer: Offered designation titles differ* Job Type: Full time