Jobs
Outstanding opportunities to do good with your career while remaining in New Zealand
Software Engineer
This position involves working with Bryan Parno, Max Tegmark and colleagues at the Beneficial AI Foundation on turbocharging formal verification of Rust code with AI tools as described here and in Towards Guaranteed Safe AI (a high-level introduction is given in the 2nd half of this TED talk).
Machine Learning Infrastructure Engineer
We’re seeking an ML Infra Engineer to build robust, scalable, and high-performance infrastructure for distributed inference and training. You’ll take specialized language models from our ML research team and transform them into fast and reliable services that scale from proof-of-concept to enterprise deployment.
Research Scientist
We are seeking expressions of interest from both experienced and first-time Research Scientists to develop and execute on a safety research agenda and/or accelerate our existing projects.
Research Engineer
We are seeking expressions of interest from research engineers looking to work on AI safety projects and red-teaming.
Research Intern
Contribute to cutting-edge research in scalable, distributed machine learning systems alongside experienced researchers and engineers. Explore new ways of building and verifying neural networks that operate across huge, decentralised, topologies of heterogenous devices.
Communications Director and Staff Director
CARMA is seeking an exceptional combined Communications Director and Staff Director, in one person, to play a pivotal role in advancing our mission. This position combines both strategic leadership and hands-on execution of communications with high-level organizational support to ensure CARMA operates effectively while communicating its critical work with clarity and impact.
Senior Economist, Effects of Transformative AI
CARMA seeks an innovative economist to join our Geostrategic Dynamics team, exploring how advanced AI systems will reshape global economic paradigms, incentive structures, and power dynamics. You'll develop models to analyze critical risks including labor obsolescence, economic instability, concentration of power, shocks to the financial system, and degraded living standards as AI capabilities accelerate.
AI Safety Operations Contractor
We're seeking an exceptional AI Safety Operations Contractor to serve as the operational backbone of our organization. This role combines executive assistant duties with strategic operations work, supporting our leadership team and research initiatives in the critical field of AI safety.
Research Engineer - Novel AI Platforms for Multiscale Alignment
The Alignment of Dynamical Cognitive Systems program seeks a Research Engineer to develop novel AI platforms addressing critical alignment challenges and practical LLM agents.
Senior Technical Specialist, AI Risk Assessment
We are seeking a Senior Technical Specialist to join our Comprehensive Risk Assessment team. This role combines original research in AI safety and technical governance with strong emphasis on conceptual depth and quality assurance leadership.
AI Offense-Defense Dynamics Lead Researcher
In this role, you'll lead research to decode these offense-defense dynamics, examining how specific attributes of AI technologies influence their propensity to either enhance societal safety or amplify risks.
Senior Economist, AI Geostrategic and Economic Mechanisms
CARMA seeks an innovative economist to join our Geostrategic Dynamics team, exploring how advanced AI systems will reshape global economic paradigms, incentive structures, and power dynamics. You'll develop models to analyze critical risks including labor obsolescence, economic instability, concentration of power, shocks to the financial system, and degraded living standards as AI capabilities accelerate.
Public Security Policy Researcher
CARMA's Public Security Policy (PSP) Program is seeking a Policy Researcher to advance our work on AI governance, risk mitigation, and emergency response frameworks. This role will focus on disaster preparedness planning for AI-related crises across multiple jurisdictional levels (national, state/provincial, multinational, and alliance-based), vulnerability assessments of critical societal systems, and development of robust governance approaches.
Digital Media Accelerator
The FLI Digital Media Accelerator program aims to help creators produce content, grow channels, spread the word to new audiences. We're looking to support creators who can explain complex AI issues - such as AGI implications, control problems, misaligned goals, or Big Tech power concentration - in ways that their audiences can understand and relate to.
Machine Learning Engineer
We’re looking for top-tier machine learning engineers to help develop cutting-edge AI security solutions. If you have a strong background in building, deploying, and scaling machine learning models and a passion for AI security, we’d love to hear from you.
Expression of Interest
If none of the open roles is a fit for you, but you think you'd be a great future member of the Harmony team, we'd still love to hear from you. In the future, we're likely to have openings spanning Engineering, Research, Sales, Marketing, Operations, People, and more.
Content Writer, Freelance
We’re looking for a freelance writer to help us produce educational articles about AI for our varied audiences. Audiences may include any groups who stand to be impacted by AI, from elections officials to trade unions to research scientists. Articles will often include interactive demonstrations, built by the CivAI engineering team, that convey some aspect of AI capabilities or risks. We’re aiming for the articles to be short and memorable, presenting unique viewpoints on AI that help people make sense of its far-flung impacts.
Cyber Researcher
As a cyber researcher at Pattern Labs, you will be at the forefront of research on AI models' cyber capabilities (such as AI’s ability to discover vulnerabilities and develop exploits, carry out network attacks, etc.). This role sits at a unique intersection of cybersecurity expertise and AI capabilities, where your background in vulnerability and cyber research will help shape the future of AI security.
AI Researcher
We are seeking a policy researcher excited about our AI security mission and eager to be part of our scaling up.
Policy Researcher
We are seeking a policy researcher excited about our AI security mission and eager to be part of our scaling up.