Machine Learning Research Expert, AI Evaluation (Remote, Contract, $115/hr) — AfterQuery via AI Gig Scout

AfterQuery, which builds the expert evaluation data frontier AI labs use to measure and improve their models, is hiring machine learning researchers as remote contractors, listed at $115/hr. You will author and solve the analysis problems those evaluations run on, drawn from your own research: experiment design, ablations, evaluation and model behavior. The work is fully remote and async with no fixed hours. It is aimed at researchers with hands-on ML research experience, not ML engineers focused on deployment, data engineers or data annotators.

What you will do: author realistic ML research problems drawn from your own work (experiment design, ablations, evaluation and failure analysis); work each problem through to a reference answer, with the reasoning behind every step; and catch the research mistakes that look reasonable but only a practitioner would spot.

Requirements: a Master's or PhD in computer science, statistics, mathematics or a related field; 3+ years of full-time ML research after your degree (a postdoc counts, PhD years don't); hands-on experience designing experiments, running ablations or evaluating models; strong Python and a deep learning framework such as PyTorch or JAX; and at least 10 hours per week. Preferred: publications at venues such as NeurIPS, ICML, ICLR, ACL or CVPR, experience at an industry research lab or university research group, and clear written English.

Details and apply link: https://aigigscout.com/jobs/afterquery/machine-learning-research-expert-machine-learning-research-expert?utm_source=kubernetesjobs&utm_medium=jobboard&utm_campaign=aigigscout_growth

Disclosure: posted by AI Gig Scout, an independent listing site (not AfterQuery). The apply link may be a referral link.