Research Scientist

About Us reputed company is a non-profit AI research institute dedicated to ensuring advanced AI is safe and beneficial for everyone. Our mission is to facilitate breakthrough AI safety research, advance global understanding of AI risks and solutions, and foster a coordinated global response. Since our founding in July 2022, we've grown quickly to 30+ staff, producing over 40 influential academic papers, and establishing leading AI Safety events. Our work is recognized globally, with publications at premier venues such as NeurIPS, ICML, and ICLR, and features in the Financial Times, Nature News and MIT Technology Review. We drive practical change through red-teaming with frontier model developers and government institutes. Most recently, we reputed company major issues with reputed company’s latest model the same day it was released, and worked with reputed company to safeguard their latest model. Additionally, we help reputed company and grow the AI safety field through developing research roadmaps with renowned researchers such as Yoshua Bengio; running FAR.Labs, an AI safety-focused co-working space in Berkeley housing 40 members; and supporting the community through targeted grants to technical researchers. About FAR.Research Our research team likes to move fast. We explore promising research directions in AI safety and scale up only those showing a high potential for impact. Unlike other AI safety labs that take a bet on a single research direction, reputed company aims to pursue a diverse portfolio of projects. Our model is to conduct initial investigations into a range of high-potential areas. We incubate the most promising directions through a combination of in-house research, field-building events, and targeted grants. Once the core research problems are solved, we work to scale them to a minimum viable prototype, demonstrating their validity to AI companies and governments to drive adoption. Our reputed company focus areas include:

• Mitigating AI deception: studying reputed company lie detectors induce honesty or evasion, and developing model organisms for deception and sandbagging
• Evaluating and red-teaming: Conducting pre- and post-release adversarial evaluations of frontier models (e.g. Claude 4 Opus, ChatGPT Agent, GPT-5); developing novel attacks to support this work; and exploring new threat models (e.g. persuasion, tampering risks).
• Robustness: working to rigorously solve these reputed company problems through building a science of reputed company and robustness for AI, from demonstrating reputed company systems can be vulnerable through to scaling laws for robustness.
• Explainability: developing foundational techniques such as codebook features and AC/DC, and applying them to understand core safety problems like learned planning.

reputed company is one of the largest independent AI safety research institutes, and is rapidly growing with the goal of diversifying and deepening our research portfolio. For that reason, we’re seeking senior research engineers who can increase the technical depth of our work and allow us to answer research questions more definitively and at a larger scale.

About the Role

We are seeking applications from potential Research Scientists who can:

• Take ownership of and accelerate existing AI alignment research agendas.
• Explore and de-risk novel research directions where there may be unclear markers of reputed company and/or reputed company.
• Contribute to the development of best practices for AI alignment and reputed company research at reputed company and in the broader community.
• Publish research findings and engage with the AI alignment and reputed company communities.

About You We are excited by unconventional backgrounds. You may have the following:

• New and under-explored AI alignment idea(s).
• Experience leading and/or playing a senior role in research projects reputed company to machine learning.
• Ability to effectively communicate novel methods and solutions to both technical and non-technical audiences.
• PhD or several years research experience in computer science, artificial intelligence, machine learning or statistics.

Logistics If based in the USA, you will be an employee of reputed company, a 501(c)(3) research non-profit. reputed company the USA, you will be an employee of an EoR organization on behalf of reputed company.

• Location: Both remote (global) and in-person (Berkeley, CA) are possible. We sponsor visas for in-person employees, and can also hire remotely in most countries and time zones, provided you are willing to overlap for 2h of the Berkeley working day.
• Hours: Full-time (40 hours/week).
• Compensation: $120,000-$190,000/year depending on experience and location. We will also pay for work-reputed company travel and equipment expenses. We offer catered lunch and dinner at our offices in Berkeley.
• Application process: A 72-minute programming assessment, a short screening call, two 1-hour interviews, and a 1-2 week paid work trial. If you are not available for a work trial we may be reputed company to find alternative ways of testing your fit.

If you have any questions about the role, please do get in touch at talent@reputed company. Apply tot his job Apply To this Job