Software Engineer
Pattern Labs
📍 Remote (Global)
🕔 Full Time
🔄 Rolling Applications
As a software developer at Pattern Labs, you’ll touch all aspects of our product and business: making our product more reliable at scale, designing and implementing AI evaluations, creating dev tools, and running experiments to assess model capabilities. You’ll have a chance to understand the research context and your code’s impact and contribute as a meaningful part of a growing team.
Representative projects:
Building a tool to evaluate model risk levels continuously. From designing the APIs for frontier labs, to building analysis and visualization tools that summarize 10,000+ transcripts into specific conclusions.
Designing and building challenges that measure a model’s ability to evade discovery, allowing us to see if models can operate on remote systems while avoiding detection by common defensive security tools.
Building infrastructure that generates evaluations at scale. Given a specific evaluation, it must create 100+ challenges that an LLM can attempt to solve that are meaningfully different from each other.
Designing and building agents that improve a model’s ability to complete complex tasks. Includes many potential directions such as incorporating SOTA prompting practices creating tools for task delegation, and more.
You may be a good fit if you:
Have strong problem-solving and analytical skills
Have strong production programming skills
Work well in a multidisciplinary team and can adapt to rapidly evolving challenges
Are interested in AI and cybersecurity (experience in machine learning or cybersecurity is a plus but not necessary)
Care about the societal impacts of your work
