Overview

ML Research Expert Published First Author (Benchmark Authoring)

Responsibilities

• Design realistic and technically rigorous machine learning research tasks and problem sets within your area of expertise.
• Develop benchmark challenges that assess the ability of AI models to solve authentic ML research problems.Author expert-level reference solutions for assigned research tasks.
• Develop detailed grading rubrics that enable consistent evaluation of model performance.Apply hands-on machine learning research experience when designing and validating benchmark content.
• Ensure tasks are technically accurate, challenging, reproducible, and relevant to real ML research workflows.
• Validate research tasks and solutions against appropriate technical and methodological standards.

Qualifications

• Language ModelsDeep LearningReinforcement LearningComputer VisionGenerative AIRoboticsML SystemsEfficient Machine LearningOptimization & Learning TheoryClassical Machine LearningAdaptive LearningTime Series & ForecastingStructured ReasoningCausal ReasoningTrustworthy Machine LearningAI for ScienceCompensation & Engagement
• Compensation: $140$150/hourEngagement Type: Independent contractWork Arrangement: Fully remote and asynchronousHours: Flexible commitment of approximately 540 hours per weekProject Focus: Machine learning research benchmark authoring and AI evaluationExperience Level: 1+ years of hands-on ML research experience;
• no upper experience limit
• Candidates who meet the stated requirements and provide the requested materials may receive priority during the review process.The application process includes thorough background checks.About AfterQuery
• AfterQuery is a research lab investigating the boundaries of artificial intelligence through novel datasets and experimentation.
• The company is backed by leading investors, including Y Combinator and Box Group, and supports AI research across leading AI laboratories.
• Application Process
• Submit your application with your resume and requested research materials.Provide evidence of at least one first-author ML research publication.Demonstrate your relevant ML research experience, education, and hands-on coding background.Complete any required technical or research assessment.Complete the applicable background-check process.Complete onboarding and project orientation if selected.Begin authoring and validating machine learning benchmark tasks. .