Senior AI Platform Engineer

At Instructure, we believe in the power of people to grow and succeed throughout their lives. Our goal is to amplify that power by creating intuitive products that simplify learning and personal development, facilitate meaningful relationships, and inspire people to go further in their education and careers.
We do this by giving smart, creative, passionate people opportunities to create awesome. And that's where you come in:

At Instructure, we empower teachers and learners to grow and succeed by creating intuitive products that simplify learning, facilitate meaningful relationships, and inspire innovation.

We are looking for AI Platform Engineers to build and maintain core LLM-powered services and APIs to power the next generation of online learning tools. On this team, you’ll design and implement services and infrastructure that will allow our feature teams to rapidly develop and deploy LLM-powered features that improve the teaching and learning experience of tens of millions of people around the world while maintaining our high standards for performance, security, and reliability.

What You’ll Do

• Design and implement APIs and domain services that abstract the complexity of using an LLM and enable rapid feature development from our product teams;

• Build scalable AWS infrastructure for LLM interactions, including prompt management, context handling, auditing, and response processing;

• Create developer tooling and documentation that makes integration with your services intuitive and easy;

• Establish best practices for AI and LLM use at Instructure, considering things like auditability, cost, and performance;

• Collaborate with feature teams to understand their needs and solve them with platform capabilities;

• Design, develop, and maintain scalable and performant APIs;

• Write clean, maintainable, and well-documented code;

• Participate in code reviews and provide and receive constructive feedback

What You’ll Need

• Prior software engineering experience with API design and distributed system development;

• Strong experience building backend services and REST or GraphQL APIs;

• Knowledge of API design best practices around security, performance monitoring, rate limiting, and more;

• Understanding of LLM integration and usage patterns;

• Strong collaboration and written and verbal communication skills;

• Past experience with cloud infrastructure, preferably on AWS;

• Experience with Node.js or a desire to learn;