AI Software Engineering Manager
Hands-on engineering manager at Deloitte's NVIDIA-partnered AI team, leading AI software engineers to design, build, and deliver LLM/multimodal agentic systems optimized for NVIDIA GPUs. Combines people and project management, hands-on Python coding and architecture, and client-facing technical leadership.
- Compensation
- Not disclosed
- Location
- Haifa, North District
- Work setup
- Onsite
- Seniority
- Not specified
- Employment
- Full time
- Experience
- 2+ years
- Category
- Software engineering
- Posted
Skills
Must have
- BSc or MSc in Computer Science, Electrical Engineering, or related field
- 7+ years of hands-on software engineering
- Experience designing and developing complex systems across all software layers (AI pipelines, middleware, databases, backend, frontend)
- 2 years of experience leading people and project management, preferably with Agile methodologies
- 2+ years building AI and LLM-based software systems in the cloud (agentic workflows, reasoning systems, prompt engineering, harness engineering)
- Strong proficiency in Python and modern AI frameworks
- Deep knowledge of software engineering principles: architecture, design patterns, clean code, TDD, code quality, maintainability, observability
- Experience with system-level design, debugging, and performance optimization
Nice to have
- Experience with NVIDIA technologies (CUDA, TensorRT, Triton, NVIDIA NIM)
- Experience with GPU performance profiling and optimization
- Experience with multimodal LLM agents for text, image, audio, and video processing
- Experience with LangChain, LangGraph, React, TypeScript, Redis Pub/Sub, SQL, NoSQL, vector databases, containerized development, Git
- Experience with deep learning architectures (CNNs, Transformers)
- Background in high-performance or low-latency systems
- Experience leading and collaborating with distributed engineering teams across multiple countries
Full description
About UsWe are an NVIDIA partner, delivering professional services in advanced software development, artificial intelligence systems, and high-performance AI solutions. We build production-grade AI systems optimized for NVIDIA GPU platforms, working across multiple applied AI domains, including Generative AI / Agentic Systems.
Role OverviewWe are looking for an experienced AI Software Engineering Manager to take a leading role in designing, building, and delivering advanced AI systems for real-world applications.
This role is suited for a hands-on engineering manager with strong software engineering, project management and leadership skills and deep experience in applied AI, who enjoys solving complex problems, owning technical solutions end-to-end, mentoring team members, and engaging with customers.
Projects typically focus on LLM or Multimodal LLM based agentic systems.
What We Work On
Our work spans software engineering and AI domains:
- Design and implementation of agentic systems powered by Large Language Models (LLMs)
- Deployment of open-source LLMs on NVIDIA GPUs
- High-performance inference using NVIDIA technologies such as NVIDIA NIM (Inference Microservices)
- System-level design for reliability, scalability, and performance
- Multimodal agents for text, image, audio, and video processing
- Performance optimization on GPU platforms.
Key Responsibilities
- Lead, manage, and develop a high-performing team of AI Software Engineers, fostering a strong engineering culture, setting clear expectations, providing ongoing coaching and feedback, managing performance, and supporting individual career growth.
- Lead and manage AI software engineering projects end-to-end, from planning to deployment, while actively designing and hands-on coding core components of the solution.
- Lead or facilitate Agile execution, including sprint planning, backlog refinement, daily stand-ups, and retrospectives.
- Drive technical excellence through code reviews, design reviews, and architecture discussions, guiding the team in building scalable, reliable, maintainable, and secure software systems with clean code and rigorous software engineering practices.
- Serve as the primary technical point of contact for customers and/or product teams, translating requirements into effective technical solutions.
Requirements
- BSc or MSc in Computer Science, Electrical Engineering, or a related field
- 7+ years of hands-on Software Engineering
- experience in designing and developing complex systems across all software layers, including AI pipelines, middleware, databases, backend, and frontend