AI & Data Science Intern - GPSU/NE
A part-time, remote, paid 12-week internship with GuidePoint Security's Northeast DevSecOps team. The intern defines and runs evaluations of agentic AI harnesses, analyzes telemetry, tunes model/prompt performance, and helps build an internal AI governance pipeline, using Python, pandas/numpy, and LLM APIs.
- Compensation
- $20 / hr
- Location
- Remote
- Work setup
- Remote
- Seniority
- Intern
- Employment
- Internship
- Experience
- Not specified
- Category
- Data science
- Posted
Skills
Must have
- Currently enrolled or recently graduated with a degree or substantial coursework in data science, statistics, computer science, engineering, or a related field
- Proficiency or strong interest in Python, with exposure to data manipulation libraries (pandas, numpy) or LLM APIs
- Genuine curiosity about large language models, agentic systems, and how AI performs and fails in applied contexts
- Strong analytical and written communication skills, able to translate data findings into actionable observations
- Technical aptitude and comfort working with ambiguity in a fast-moving, practitioner-led environment
- Physically located within the United States for the entire duration of the internship
- Available to work 25-29 hrs/week Monday-Friday supporting the Eastern Time Zone
- Personal computing device and access to high-speed internet during working hours
- Not living in Alaska, California, Hawaii, New Mexico, New York, Oregon, Washington, or Wyoming
Nice to have
- Eastern/Central time zone
Full description
GuidePoint Security provides trusted cybersecurity expertise, solutions and services that help organizations make better decisions and minimize risk. By taking a three-tiered, holistic approach for evaluating security posture and ecosystems, GuidePoint enables some of the nation’s top organizations, such as Fortune 500 companies and U.S. government agencies, to identify threats, optimize resources and integrate best-fit solutions that mitigate risk.
Overview
As part of the GPSU program, we are seeking an AI & Data Science Intern to support GuidePoint Security’s Northeast region. In this role, you will work with the NE AI and AppSec teams as part of the NE DevSecOps team, contributing to the evaluation and governance infrastructure that supports GuidePoint’s agentic AI harnesses. This is a hands-on, practitioner-mentored role focused on defining and running evals, collecting and analyzing telemetry, tuning model performance, and building an internal governance pipeline for AI harness outputs. Prior professional experience is not required, but a data-oriented mindset and curiosity about applied AI systems are essential.
Currently enrolled, or recently graduated with a degree or substantial coursework in data science, statistics, computer science, engineering, or a related field is required. You will contribute to live AI systems that are in active use across the organization, working alongside experienced engineers to improve harness reliability and prevent output drift and performance regression over time. You will also participate in limited client-facing engagements under mentorship, observing how AI capabilities are communicated and demonstrated in a professional services context.
Responsibilities
- Evaluation & Performance
- Define and implement evaluation frameworks to measure the accuracy, reliability, and consistency of agentic AI harnesses
- Design and run structured evals against harness outputs to detect regressions, output drift, and behavioral degradation over time
- Build and maintain benchmark datasets and ground-truth corpora used to evaluate harness quality
- Analyze eval results, identify failure modes, and collaborate with the NE AI and AppSec teams to drive iterative improvements
- Research and apply prompt evaluation techniques and LLM benchmarking methodologies relevant to security-specific harnesses
- Telemetry, Tuning & Governance
- Instrument agentic harnesses with telemetry to capture latency, token usage, error rates, and output quality signals
- Analyze telemetry data to identify patterns, surface anomalies, and generate actionable insights for harness tuning