Staff AI Engineer
Job Description
As a Staff AI Engineer, your primary responsibility will be to design, build and ship LLM and agentic AI systems across Rapid7’s security products, owning the technical solutions for your area end to end. You understand LLMs from transformer internals to fine-tuning and inference optimization, stay hands-on with hard problems, and know where LLMs shine and where they fall short, choosing the right approach among LLMs, predictive AI and classical ML. Specifically, your focus will be to: • Lead the design and architecture of LLM and agentic AI systems within Detection and Response and Exposure and Remediation, contributing to the technical roadmap for your area • Recommend model strategy for your projects, including when to use frontier or open-source models and when to fine-tune, distill, or post-train • Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment • Apply and improve engineering practices for context engineering, inference optimization and evaluation, optimizing LLM inference to balance quality, latency and cost • Establish evals as the release gate for the AI systems you ship • Lead design reviews for your projects and work through complex technical trade-offs • Stay hands-on by prototyping and building critical model, training and inference code • Mentor engineers on your team and partner with Product and platform teams to align technical solutions with customer needs