Copilot Administrator - Large Language Models

Role Overview :

As a Co-pilot Admin, you will serve as the technical backbone for our enterprise-grade AI initiatives, ensuring the seamless deployment and optimization of intelligent assistants across the organization.

Your day-to-day involves managing the lifecycle of AI agents, fine-tuning retrieval mechanisms, and monitoring the performance of LLM-driven workflows to ensure they meet rigorous accuracy and latency standards.

You will collaborate closely with data science teams, product managers, and business stakeholders to translate complex operational requirements into scalable AI solutions.

By maintaining the integrity and efficiency of these systems, you directly influence the productivity of our workforce and the quality of the digital experiences we deliver to our customers, positioning the organization at the forefront of the generative AI revolution.

Key Responsibilities :

• Configure and maintain LLM-based co-pilot environments to ensure high availability and optimal response accuracy for end-users.

• Architect and refine RAG pipelines to improve the relevance of information retrieval, ensuring that AI agents provide contextually grounded and reliable answers.

• Orchestrate complex Agentic AI workflows by designing multi-agent interactions that automate multi-step business processes effectively.

• Monitor AI orchestration platforms to identify performance bottlenecks, proactively adjusting configurations to maintain system stability and cost-efficiency.

• Partner with cross-functional engineering teams to integrate AI capabilities into existing enterprise applications, driving measurable improvements in operational throughput.

• Establish governance frameworks and guardrails for AI usage, ensuring that all deployments adhere to security, privacy, and compliance standards.

Required Skillset:

• Demonstrated expertise in managing and fine-tuning Large Language Models (LLMs) within production environments, with a deep understanding of prompt engineering and model behavior.

• Proven ability to design and implement RAG architectures, including vector database management and semantic search optimization, to enhance data-driven decision-making.

• Hands-on experience with AI orchestration frameworks, enabling the seamless coordination of autonomous agents to execute sophisticated business logic.

• Strong analytical mindset to troubleshoot complex AI system failures and translate technical insights into actionable improvements for non-technical stakeholders.

• Exceptional communication skills to facilitate alignment between technical development teams and business leadership, ensuring project goals remain synchronized.

• A minimum of 6 to 8 years of professional experience in technical administration or AI operations, with a track record of managing scalable software solutions.

• Ability to thrive in a hybrid work environment across locations including Chennai, Hyderabad, Pune, Bangalore, Kolkata, and Gurgaon, maintaining high levels of autonomy and collaboration.

• A degree in Computer Science, Engineering, or a related quantitative field, complemented by a continuous learning mindset regarding the rapidly evolving AI landscape.