Senior Research Engineer

FarAI

πŸ“ Remote (Global)β€ƒπŸ•” Full Time
πŸ’°$150,000–$250,000 USD/yearβ€ƒπŸ”„ Rolling Applications

FAR.AI is seeking a Senior Research Engineer to accelerate and scale-up our research. Your focus will be on tackling challenging engineering problems in one of our core safety agendas, mentoring and unblocking other staff members in their technical work, and increasing the depth and scale of our research work overall.

About Us

FAR.AI is a non-profit AI research institute dedicated to ensuring advanced AI is safe and beneficial for everyone. Our mission is to facilitate breakthrough AI safety research, advance global understanding of AI risks and solutions, and foster a coordinated global response.

Since our founding in July 2022, we've grown quickly to 30+ staff, producing over 40 influential academic papers, and establishing leading AI Safety events. Our work is recognized globally, with publications at premier venues such as NeurIPS, ICML, and ICLR, and features in the Financial Times, Nature News and MIT Technology Review.

We drive practical change through red-teaming with frontier model developers and government institutes. Most recently, we discovered major issues with Anthropic’s latest model the same day it was released, and worked with OpenAI to safeguard their latest model. Additionally, we help steer and grow the AI safety field through developing research roadmaps with renowned researchers such as Yoshua Bengio; running FAR.Labs, an AI safety-focused co-working space in Berkeley housing 40 members; and supporting the community through targeted grants to technical researchers.

About the Role

This role would be a good fit for an experienced machine learning engineer, or an experienced software engineer looking to transition to AI safety research. All candidates are expected to:

  • Have significant software engineering experience. Evidence of this may include prior work experience and open-source contributions.

  • Be fluent working in Python.

  • Be results-oriented and motivated by impactful research.

  • Bring prior experience mentoring other engineers or scientists in engineering skills.

Additionally, candidates are expected to bring expertise in one of the following areas corresponding to the core competencies our different research teams most need:

  • Option 1 – Machine Learning:

    • Substantial experience training transformers with common ML frameworks like PyTorch or jax.

    • Good knowledge of basic linear algebra, calculus, vector probability, and statistics.

  • Option 2 – High-Performance Computing:

    • Power user of cluster orchestrators such as Kubernetes (preferred) or SLURM

    • Experience building high-performance distributed-systems (e.g. multi-node training, large-scale numerical computation)

    • Experience optimizing and profiling code (ideally including on GPU, e.g. CUDA kernels).

  • Option 3 – Technical Leadership:

    • Experience designing large-scale software systems, whether as an architect in greenfield software development or leading a major refactor.

    • Comfortable project managing small teams, such as chairing stand-ups and developing detailed roadmaps to execute on a 3-6 month research vision.

About the Projects

As a Member of Technical Staff (Senior Research Engineer) you would join one of our existing workstreams and lead projects there:

  • Detecting and preventing deception. Under what conditions can we reliably detect deceptive behaviour from models, and can such behaviour be effectively mitigated at scale? This would focus on large-scale training of transformers.

  • Preventing catastrophic misuse. Apply our research insights to detect and mitigate vulnerabilities and other risks in frontier AI models. This would focus more on technical leadership

  • Accelerating our research. Build frameworks and infrastructure that allows us to ask bigger questions and more rapidly run new experiments, to deepen our research. This would focus more on high-performance computing.

As we continue to grow our research portfolio, additional workstreams may open up for contribution, for example in mechanistic interpretability.

About the Projects

As a Member of Technical Staff (Senior Research Engineer) you would join one of our existing workstreams and lead projects there:

  • Detecting and preventing deception. Under what conditions can we reliably detect deceptive behaviour from models, and can such behaviour be effectively mitigated at scale? This would focus on large-scale training of transformers.

  • Preventing catastrophic misuse. Apply our research insights to detect and mitigate vulnerabilities and other risks in frontier AI models. This would focus more on technical leadership

  • Accelerating our research. Build frameworks and infrastructure that allows us to ask bigger questions and more rapidly run new experiments, to deepen our research. This would focus more on high-performance computing.

As we continue to grow our research portfolio, additional workstreams may open up for contribution, for example in mechanistic interpretability.

Apply
FarAI

FAR.AI is a technical AI research and education non-profit, dedicated to ensuring the safe development and deployment of frontier AI systems

Previous
Previous

CBRN Biology Expert

Next
Next

Hackathons Program Manager