Senior Research Engineer/Scientist
Job Description
What you'll do
• Own LLM mid-training and post-training research, including continued pretraining, SFT, preference optimization, and RL; make data-mixture and experimental decisions and determine how training changes affect downstream agent behavior.
• Research and prototype novel agentic architectures and algorithms across planning, reasoning, memory, skills, tool use, retrieval, and multi-agent collaboration, advancing beyond existing approaches where appropriate.
• Design and build research harnesses and experimentation methodologies that enable systematic experimentation, trajectory analysis, reproducibility, and rigorous comparison across models, checkpoints, and agent architectures.
• Define evaluation methodologies and develop novel benchmarks for measuring agent reasoning, planning, tool use, reliability, factuality, and safety; establish rigorous approaches for LLM-as-a-Judge, trajectory-based, and human evaluation.
• Identify systematic model and agent failure patterns, determine their root causes, and translate those insights into new research directions or improvements in training data, architecture, context, or evaluation.
• Independently identify research problems, formulate novel hypotheses, and drive projects from research idea to validated prototype and measurable impact, collaborating with engineering to transition successful approaches into production and communicating results through publications, patents, or open-source work.
Requirements
Department: Engineering, Infrastructure and Operations
Function: Engineering
Experience Level: Not Applicable