AI Solution Architect
- Compensation
- Not disclosed
- Location
- Not listed
- Work setup
- Remote
- Seniority
- Not specified
- Employment
- Not specified
- Experience
- 7+ years
- Category
- Architecture
- Posted
Skills
Must have
- 7+ years of experience in a customer-facing, pre-sales technical role such as Solutions Architect, Pre-Sales Engineer, or a similar capacity.
- Deep, hands-on experience designing complex, large-scale enterprise systems (e.g., in AI/ML, HPC, Big Data, or enterprise software).
- Exceptional presentation, whiteboarding, and communication skills, with a demonstrated ability to present complex technical topics to both technical and nontechnical audiences.
- Deep, hands-on experience architecting and building solutions at the application and model layers of the AI stack, including generative AI, agentic AI, RAG, model integration, inference, and productio
- Proven ability to manage multiple, concurrent design and architecture projects in a fast-paced sales environment.
- Experience designing production-grade AI platforms and applications with considerations for security, governance, evaluation, observability, scalability, reliability, and cost optimization.
- A strong understanding of the interplay between software, hardware, and networking in modern data center environments.
Nice to have
- Deep technical expertise with the NVIDIA AI software stack (NVIDIA AI Enterprise, Triton Inference Server, NeMo, TensorRT-LLM, etc.) and underlying hardware platforms (e.g., DGX, HGX).
- Experience designing solutions for LLM inference, agentic AI systems, or other advanced AI workloads.
- Experience building enterprise AI solutions using comparable AI platforms and frameworks from major cloud or technology providers, such as Azure AI Foundry, AWS Bedrock/SageMaker, Google Vertex AI, Da
- Hands-on experience deploying and operationalizing AI/ML models in on-premises environments, including model serving, inference infrastructure, containerization, GPU acceleration, scaling, monitoring,
- Familiarity with MLOps principles, CI/CD, and container orchestration (Kubernetes).
Full description
At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.
Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.
Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.
At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.
Job Overview
As an AI Solution Architect, you will be the lead technical visionary in our pre-sales process, acting as the trusted advisor to our clients and the technical conscience for our sales team. You will be responsible for translating complex customer challenges into elegant, feasible, and compelling end-to-end AI solutions. This is a deeply technical, customer-facing role where you will have the opportunity to design cutting-edge agentic AI systems on the industry-leading NVIDIA AI Enterprise platform. If you are a master of the whiteboard, passionate about solving complex problems, and skilled at bridging the gap between business objectives and technical implementation, this role is for you.
Responsibilities
Lead Pre-Sales Technical Discussions
- Engage directly with prospective clients to lead deep technical discovery sessions. You will be responsible for understanding and documenting their business goals, technical requirements, and operational constraints.
Design End-to-End Solutions
- Act as the lead architect in designing comprehensive, end-to-end agentic AI solutions. Your designs will be centered on the NVIDIA AI Enterprise platform and will encompass the full stack, from hardware and networking to MLOps and application layers.