Head of Engineering (Frontier Safety)
FAR.AI
Summary
FAR.AI is seeking a Head of Engineering for its Frontier Safety division, which runs one of the world's most impactful frontier AI testing programs. This role focuses on building the engineering and execution engine that enables and empowers the division's work across testing, evaluations, tools, products, services, and research.
Job description
About the Role
FAR.AI is seeking a Head of Engineering for its Frontier Safety division, which runs one of the world's most impactful frontier AI testing programs. This role focuses on building the engineering and execution engine that enables and empowers the division's work across testing, evaluations, tools, products, services, and research.
Key Responsibilities
- Build and scale red-teaming tools and products that improve speed, coverage, and importance of findings
- Operationalize and scale systems that advance state-of-the-art attacker simulation and output severity evaluation
- Maintain and evolve internal vulnerability databases, statistical analysis tools, and reporting infrastructure
- Develop agentic systems, including automated red-teaming agents that systematically explore the attack space, agents that identify and automatically integrate new public jailbreaks, and agents that automate workflows
- Build, test, and refine sandboxing architecture that enables rapid and thorough evaluation of the strongest AI systems
- Extend infrastructure and tooling to support CBRN and cyber evaluations and loss-of-control testing
- Design and implement architecture that enables external contributions to the platform and integration with the AI evaluation ecosystem
- Integrate systems with the overall division to empower velocity and quality of testing
- Mentor team members in engineering skills
- Manage team members, supporting and amplifying their impact
- Initially build and manage a team of ICs, then hire or grow managers over time
- Design and be hiring manager for pipelines to scale the engineering team
- Contribute to the overall technical and product strategy of the division
- Pair closely with Kellin on technical direction
- Work closely with and potentially manage the company engagements and testing team
- Partner closely with the rest of the division and with teams across FAR.AI
Required Qualifications
- Strong track record in software engineering, AI, or another computer engineering discipline (e.g. cybersecurity, MLOps)
- Strong track record of managing, growing, and leading technical teams, including both building start-ups (0 → 1) and scale ups (managing managers)
- Experience with parts of the tech stack we commonly use, such as coding agents, Python, LLM APIs, local LLM frameworks, evaluation frameworks, LLM agents, cloud infrastructure, compute clusters
- Have thrived in rapidly evolving environments
- Demonstrated drive for mission/impact and desire to create a real impact on frontier AI systems
- Can effectively communicate technical solutions to both technical and non-technical audiences
- Demonstrated relentlessness in achieving ambitious goals
Preferred Qualifications
- Experience building, red-teaming, or evaluating frontier LLMs or agentic systems, or building safeguards for them
- Experience building technical teams and products in an entrepreneurial environment
- Demonstrated ability to discover non-obvious, high-severity vulnerabilities in complex systems
- Other experience in closely related areas like adversarial ML or security
- Prior collaboration with AI labs, security teams, or government safety institutes
- Published work in AI safety, security, or robustness
Requirements
- Strong track record in software engineering, AI, or another computer engineering discipline (e.g. cybersecurity, MLOps)
- Strong track record of managing, growing, and leading technical teams, including both building start-ups (0 → 1) and scale ups (managing managers)
- Experience with parts of the tech stack we commonly use, such as coding agents, Python, LLM APIs, local LLM frameworks, evaluation frameworks, LLM agents, cloud infrastructure, compute clusters
- Have thrived in rapidly evolving environments
- Demonstrated drive for mission/impact and desire to create a real impact on frontier AI systems
- Can effectively communicate technical solutions to both technical and non-technical audiences
- Demonstrated relentlessness in achieving ambitious goals
Benefits
- Visa sponsorship
- Remote work
- Catered lunch and dinner
- Work-related travel expenses
- Equipment expenses
Company overview
FAR.AI is an independent nonprofit research organization founded in 2022 and based in Berkeley, California, dedicated to ensuring the safe development and deployment of advanced artificial intelligence systems. The organization focuses on frontier alignment research to make AI systems trustworthy, secure, and beneficial to society. FAR.AI operates through three main divisions: FAR.Research explores high-potential technical AI safety research directions including adversarial robustness, interpretability, and preference learning; FAR.Labs supports the San Francisco Bay Area AI safety research community through coworking spaces, events, and programs; and FAR.Futures delivers initiatives that bring together global leaders in AI academia, industry, and policy. The organization has secured over $30 million in funding from major supporters including Coefficient Giving, Schmidt Sciences, and the AI Safety Fund, enabling significant expansion of research capabilities and field-building initiatives. FAR.AI conducts rigorous technical research on AI safety challenges while building the field through workshops, fellowships, and collaborative initiatives, positioning itself as a critical institution addressing one of the most pressing technological challenges of our time.