At AISS, we believe that existential risks from artificial intelligence are among the most pressing challenges facing humanity. However, with the field of AI alignment and existential risk reduction still in its infancy, we urgently need more researchers and thinkers working on these problems.

That's why we're raising funds to build a community of researchers working on these issues, providing career coaching, resources, networking opportunities and support to early career, independent and transitioning researchers. Your donation to AISS will help us achieve this goal, and reduce the likelihood of existential risks from AI.

Together, we can create a safer and more resilient future for all. Please donate to AISS today, and help us make a difference. Thank you for your support.

AI Safety Support

**LEGAL IMPACT FOR CHICKENS**

[Legal Impact for Chickens](http://legalimpactforchickens.org/) (LIC) works to make factory-farm cruelty a liability. LIC brings strategic lawsuits for chickens and other farmed animals. We develop and refine creative methods to civilly enforce existing cruelty laws in factory farms, and to sue companies that break animal-welfare commitments. 

You may have seen our first case, the [Costco shareholder derivative suit](https://www.legalimpactforchickens.org/costco-lawsuit), in [The Washington Post](https://www.washingtonpost.com/food/2022/06/23/costco-chicken-lawsuit/), [Fox Business](https://www.foxbusiness.com/lifestyle/costco-rotisserie-chickens-tied-bird-mistreatment-lawsuit), [CNN Business](https://amp.cnn.com/cnn/2022/06/24/business/costco-rotisserie-chicken-lawsuit/index.html), or [Meatingplace](https://www.meatingplace.com/Industry/News/Details/105095).

Companies don’t follow laws if they aren’t enforced. And prosecutors almost never enforce cruelty laws on factory farms, even when animal protection groups urge them to. As a result, while several state cruelty laws technically cover farms, factory farms ignore them. Investigations in such states show rampant, unlawful neglect and abuse. Similarly, the animal movement’s effort to pass confinement bans may be wasted if those new bans aren’t enforced. Strategic civil litigation offers a solution. Several little-known laws—like the fiduciary duty to act lawfully—let plaintiffs sue for violation of another law.

Even when companies voluntarily agree to make an animal welfare commitment, like going cage-free, the companies often break their promise. Civil litigation offers a potential solution for that, too, by suing companies over their broken promises. 

LIC picks cases pragmatically, based on likelihood of a win and precedent potential. 

LIC was founded by Alene Anello, an experienced lawyer and animal advocate with a degree from Harvard Law School and a federal clerkship. Also on our team is litigator Sarah Gold, a Berkeley Law graduate who previously worked in BigLaw. LIC’s board includes Alicia Rodriguez, director at The Humane League; Tyler Lobdell, staff attorney at Food & Water Watch; Stephanie Ahart, founding engineer at CoactiveAI; and Sami Nabulsi, cofounder of Voltaire Foundation of North America. 

LIC subscribes to an effective altruist philosophy, working to do the most good for the most number of sentient beings. 

Now, we're looking for help on our next lawsuit.

Please reach out—We'd love to [hear](https://www.legalimpactforchickens.org/contact) from you!

Sincerely,
Alene & LIC 🐥⚖️

Legal Impact for Chickens 🐥⚖️ Let's make factory-farm cruelty a liability!

Faunalytics' mission is to empower animal advocates with access to research, analysis, strategies, and messages that maximize their effectiveness to reduce animal suffering.

We conduct essential research, maintain an online research library, and directly support advocates and organizations in their work to save lives. The range of data we offer helps our movement understand how people think about and respond to advocacy, providing advocates with the best strategies to inspire change for animals.

Our **[Original Studies]([url](https://faunalytics.org/completed-projects/) )** are carefully selected, designed, and conducted to provide actionable and insightful data for the animal protection movement. Our research [prioritization process]([url](https://faunalytics.org/prioritization/) ) helps us identify studies that have a high potential impact for animals, and our commitment to transparency and rigorous methodology ensures that our studies are of the [highest quality]([url](https://faunalytics.org/quality-research/) ). Our studies have been covered in hundreds of publications across animal advocacy circles as well as in mainstream media, and have been used by animal advocacy groups worldwide.

The **[Faunalytics Library]([url](https://faunalytics.org/library/) )** houses summaries of over 5,000 peer-reviewed research articles, public opinion surveys, gray literature, and blog posts offering deep analysis on every animal issue you can think of. It’s the world’s biggest, free online collection of opinion and behavior research about animal issues. 

We also offer comprehensive overviews of a particular topic area in our **[Faunalytics Fundamentals]([url](https://faunalytics.org/fundamentals/) )**, a series that provides infographics and visualizations of data to help you get informed and stay informed. The Fundamentals series has everything you need to get started or update your knowledge in a familiar area, and the visuals are highly shareable beyond an advocacy audience.

Have a research question that you don’t know how to solve? Want to dive deep into a particular issue but don’t know where to start? [Just ask us! ]([url](https://faunalytics.org/ask-us/) )Faunalytics’ Office Hours give you the opportunity to connect with us directly and get one-on-one help with research design, strategy, and general knowledge questions. We also engage in select partner projects with advocacy groups. 

Our 2022 Community Survey (an annual survey we conduct among global animal advocates who utilize our work) found that 97% of advocates who use our resources agreed that our work is high-quality, while 82% thought our work is extremely or very valuable to improving animal advocacy. 

Faunalytics has been named a Top Charity by Animal Charity Evaluators, but our success relies on your support! Please donate today to help us produce new research and resources for animal advocates.


Faunalytics

The [Campaign for AI Safety](https://www.campaignforaisafety.org/) has the following objectives: 

- To increase public understanding of existential risks related to AI (artificial intelligence).
- To promote regulation of AI safety.
- To encourage R&D and other efforts to achieve AI safety and alignment.

Our primary activities are in:

- broadcast messaging about AI x-risk using [billboards](https://www.campaignforaisafety.org/billboard-campaign/) and radio globally,
- [research that supports x-risk messaging](https://www.campaignforaisafety.org/tag/research/),
- outreach to specific groups of people (lawyers and scientists) globally, including via [student competitions](https://www.campaignforaisafety.org/law-competition/),
- social media presence ([LinkedIn](https://www.linkedin.com/company/campaign-for-ai-safety/), [Instagram](https://www.instagram.com/campaignforaisafety/), and [Facebook](https://www.facebook.com/campaignforaisafety)), with emphasis on female audiences,
- [stakeholder/policy engagement](https://www.campaignforaisafety.org/policy-recommendations/) in the Asia-Pacific region.

We are a mix of paid staff and volunteers. We value effectiveness and efficiency and will aim to use the money with the best return (i.e. help/convince maxium number of people of the AI risks and need for strong action to prevent them).

Campaign for AI Safety

## Short description

AI Safety Events is an organization supporting the realization of events for the field of AI safety. (https://aisafetyevents.org/)

## Summary

AI Safety Events is a solution to the following problem, through being an organization dedicated to event operations for the field.

Problem: The research fields of AI safety are up-and-coming. There is insufficient dedicated support for research, such as service providers for event operations. Organizations and researchers desiring events (workshops, socials, retreats, etc) face an operational burden.

By way of the activities listed below, we expect an improvement in the fields of AI safety in terms of opportunities, social networking, and professionalism, as well as for more events and operations capability.

Activities of the organization:
- Organize events, such as side events at academic AI conferences
- Provide event operations servicesfor individuals, groups, orgs, etc
- Maintain an up-to-date list of upcoming events related to AI risk
- Maintain a Youtube channel of talk recordings
- Skill-up folks in event operations
- Maintain a knowledge base of event operations that is field-specific

## Project goals

The goal is building the fields of AI safety through realizing high quality events.

### Track record
We previously organized the following events (https://aisafetyevents.org/events/):
- ML Safety Social at NeurIPS 2022 (New Orleans)
- AI Safety Unconference at NeurIPS 2022 (New Orleans)
- AI Safety Unconference at NeurIPS 2019 (Vancouver) 
- AI Safety Unconference at NeurIPS 2018 (Montréal)

AI Safety Events


RCG spearheads and supports research and policy co-creation efforts in Spanish-speaking countries to take mitigating action against global catastrophic risks, including: nuclear winter, biosecurity and artificial intelligence.
We aim to benefit humanity’s long-term prospects through work to reduce the risk that global and existential catastrophes take place or originate in Spanish-speaking countries. We seek to achieve this through the translation of scientific evidence and expert advice into policies co-created by working with GCR / X-risk experts and Spanish-speaking government stakeholders. Two examples of this method follow: 

Through collaboration with ALLFED and other experts we have created a report on policies to increase resilience to nuclear winter in the most high-potential region (Argentina), thus increasing the chance of an adequate response in the Latin-American region to reduce the risk of civilizational collapse. These have been presented to Argentina government risk management officials, and through continuous engagement we seek to have them implemented.
Through collaboration with experts from various organizations (e.g. GovAI, FHI, CSER), we are collating a set of policies into a report to be used as the starting point for stakeholder engagement in the most high-potential region (Spain, due to the European AI policy Sandbox). We will soon be presenting this to key government stakeholders, with the ultimate aim to influence policies implemented during the sandbox period, which could affect the European Union, and potentially the world through the Brussels effect.


Current plan:
Creation of six deliverables of two types: A) a report on policy recommendations based on expert advice from the fields of GCR and X-risk, and B) a network of experts and government stakeholders as a form of science-policy interface. These two outputs would be created for each of our three risk priority areas: 1) global catastrophic food shocks from e.g. nuclear winter or volcanic winter (a draft is out and we want to polish it), 2) biorisk from e.g. natural and engineered pandemics, 3) risks from advanced artificial intelligence. In addition, we would run a policy co-creation workshop involving GCR / X-risk experts and government stakeholders for the most promising out of the 3 lines of work.


Riesgos Catastróficos Globales: GCR policy work in Spanish

Animal Advocacy Africa works to empower animal advocates who are (interested in) doing work to reduce farmed animal suffering in African countries. We share knowledge, provide connections, and help them build the skills to run an impactful animal advocacy organisation.

**What does AAA do?** 

Having identified insufficient capacity as a key bottleneck among animal advocacy organisations in Africa, AAA [currently supports](https://www.animaladvocacyafrica.org/our-programme/) up to [17 organisations across 8 African countries](https://www.animaladvocacyafrica.org/our-reach/) in 2023, helping them build the critical components of effective, evidence-based charities, ranging from strategy, operations to communications.

AAA provides stipends to help organisations professionalise and cover their operational costs and technical infrastructure, e.g. internet upgrades, website costs and IT equipment. AAA has also begun regranting larger amounts to highly promising groups, allowing donors to support grassroots animal advocacy charities in African countries with tax-deductible donations.

AAA has [published research](https://www.animaladvocacyafrica.org/reports) about the animal advocacy landscape in Africa. Our current project attempts to determine the possibility of avoiding/preventing the wider spread of industrial animal agriculture in Africa as much as possible, with the aim of saving billions of future animals that would otherwise be born to live in factory farming conditions. Our key uncertainty, however, is whether preventing or mitigating factory farming is possible. Therefore, we consider our intervention high-risk, high-reward.

**Why Africa?** 

- The human population of Africa is expected to [nearly triple by 2100](https://www.statista.com/statistics/272789/world-population-by-continent/). Global meat production in Africa has [nearly doubled since 2000](https://ourworldindata.org/grapher/global-meat-production?time=2000..2020), and this rate is expected to increase to match the growing population and growing wealth of the continent.
- Of all continents, Africa has the [highest growth rate in aquatic farming](https://www.mdpi.com/2077-1312/10/3/417).
- Farmed animal welfare is incredibly neglected in Africa - only an [estimated $1 million](https://www.effectivealtruism.org/articles/lewis-bollard-lessons-learned-in-farm-animal-welfare) went towards farmed animal advocacy work in Africa in 2020.
- AAA believes now is a critical time to help build the animal movement in Africa before animal farming practices become more intensive.
- AAA is one of the first effective altruism aligned organisations dedicated to building the capacities of organisations in Africa by focusing on funding and organisational effectiveness.

Animal Advocacy Africa

Very few organizations are focused on AI Strategy. This will be a mix between governance, onboarding, and alignment plans. The goal is to assemble a team who can navigate the path of all three of these, finding optimal ways to steer forward in the coming years. Strategy is the [third head of the dragon](https://jaesonbooker.medium.com/the-three-heads-of-the-dragon-99133281c480), and it is currently incredibly neglected. There is almost no one currently working full time on this. For now, workers are volunteer-based, pending funding.

The goal of this organization is to improve the odds of good outcomes for humans in the coming years, and even decades. The end goal is to navigate a path toward an adequate stable equilibrium as machine intelligence continues to rise. What I mean by this is steering toward a path that has a stable trajectory for humanity’s survival and flourishing. This means finding safer solutions for AIs as they become increasingly powerful, lengthening timelines to make building those systems more likely, policies that reduce chaos within our current systems so that coordination can be done effectively and quickly in the future, and finding win/win solutions that diminish the incentive for rogue actors or violence from power-seeking. We are entering uncharted waters, and no one is currently at the helm of the ship. But one of the most undervalued members on any vessel are the navigators. They chart the course forward. We aim to be those navigators.  
 
**Lengthen Timelines**: Crafting and implementing sound policies that lengthen timelines. This could be a pivotal single legislation that dramatically shifts timelines, or it could be many small policies that add more time aggregated together. Finding people with sound understanding of drafting policies, and those who can effectively put them forward is critical.
 
**Accelerate Alignment**: This will likely mean working with many different organizations to better speed progress. Some onboarding organizations are starting to develop, and I am already working closely with them and inviting them into our ecosystem. I am already connecting people I have personally advised with these orgs. I intend to also connect alignment organizations with them, so that an effective pipeline can be created, where new recruits know where to go for onboarding, those onboarding them understand what alignment orgs want, and alignment orgs know where to go to hire new talent. This could also involve connecting to orgs like Charity Entrepreneurship to speed-up individuals creating their own research orgs. A number of part-time helpers, or advisors would be very useful for this, ideally from each of the mentioned domains.
 
**Coordination**: There is a mix of coordination failures occurring right now, and different types might require different tactics. There is coordination between governments for international cooperation building. Coordination between different AI companies for safety building and avoiding hazardous rogue actors. There is coordination between different groups within governments to pass effective legislation. These are all tall orders. But almost no one is currently working full time on building this, and some of these might interconnect. For instance, this might sometimes involve coordinating AI companies and governments to work together on creating effective monitoring agencies. Or it might involve connecting legislators with AI Safety researchers for advising risk assessment, or developing requirements for independent audits. This might involve a few part-time helpers, and perhaps a full time hire with a strong background in International Relations. 
 
**Long-Term Plans**: If we get a safe pathway to AGI and beyond, what then? Where do we want to steer humanity, and how do we find a solution that will reduce the risk of violence between different parties wanting to get to AGI (or ASI) first? Finding stable solutions to this early have two benefits. It reduces the risk of violence (or other bad outcomes) in the future, and it potentially makes slowing capabilities and coordinating on safety easier, since parties will have less incentive to try to go rogue or try to outcompete the other. People for this might be someone with deep experience in game theory or ethical philosophy, with potentially a board of advisors.
 
If you are interested in this, and think you can contribute, you can join our Discord or contact me directly.
 
Current progress:
[Discord](https://discord.gg/e8mAzRBA6y)
[Website](https://ai-safety-strategy.org/)
[Projects board (can send me your github handle for invite)](https://github.com/users/jaebooker/projects/3/views/2)
[First policy report](https://drive.google.com/file/d/15_vMHibbhXalPJ86MECIc519cR_0n5Qd/view?usp=sharing)



AI Safety Strategy - A New Organization for Better Timelines

My goal is to create a mobile application that will help maintain mental health balance of its users.

Because mental health is balanced differently by everybody, my app will be extremely flexible in terms of adapting to its users. 
For example: for one, it can be a simple simulator of anti-stress bubble wrap, for another it will be a digital therapeutic support, and for a third, it will remind you to take your medications. 
In other words, my app will be able to reprogram itself to the needs of its users.

My goal is also to make the app as scientifically accurate solution as possible. 
I have already a team of around 10 experts from different fields, eg. mental disabilities, inclusivity, transhumanism, psychotherapy or ML.

My dream is that in future my app were to be prescribed by GPs/psychiatrists to its patients.



Improving mental health of AI safety researchers

Hello, we're working on ai-plans.com

Currently, it takes a very long time to get an understanding of who is doing what in the field of AI Alignment and how good each plan is, what the problems are, etc. Hi, I'm working on ai-plans.com - a contributable compendium of alignment plans and criticisms against them. We believe it's a way to make finding the best and worst plans for alignment a lot easier!


Stage 1: A contributable compendium of alignment plans and their criticisms 
Estimated time left for this to be done: 1 week - adding ~5 plans a day now
Projected benefits: Easily seeing what plans there are, what problems there are, what the most common problems there are

Stage 2: In addition to everything from Stage 1, there is now a scoring system for criticisms and a ranking system for plans- where plans are ranked from top to bottom based on the total scores of their criticisms. Each new plans start with 0 bounty, and lower bounty plans give the most points- so each new plan gets a lot of opportunity and incentive for criticism.
Estimated time left for this to be done: 15 days
Projected benefits: makes it easier to see which plans have the worst problems and regulation against them can be pushed, lets people (including talented scientists and engineers) see which companies have the least problematic plans and the most problematic plans- going to work with aisafety.careers on this- who wants to work for the company on the bottom of the leaderboard?, increases incentives to criticize plans well

Stage 3: In addition to everything from Stage 1 and 2, there are now monthly cash prizes for the highest ranking plan that's 1 week old (since new plans start out at the top automatically) and for the user/users with the most criticism points that month. 
Estimated time left for this to be done: 1-3 months, depending on how quickly we raise funding
Projected benefits: This supercharges everything from stage 2 and attracts more smart people to the platform who are interested in a chance to make money but maybe don't care much about alignment. We can also say to policymakers- hey look, they even get money if they can come up with a plan with less problems, but they didn't!

Alignment plans: Finding the best, worst, and the in between (ai-plans.com)

Videos about Artificial Intelligence Safety Research, for everyone.

AI is leaping forward right now, it's only a matter of time before we develop true Artificial General Intelligence, and there are a lot of different ways that this could go badly wrong for us. Putting aside the science fiction, this channel is about AI Safety research - humanity's best attempt to foresee the problems AI might pose and work out ways to ensure that our AI developments are safe and beneficial.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]

Robert Miles AI Safety

[Apart Lab](https://apartresearch.com/#Lab) collaborates with scholars in AI safety to publish technical research into safer and more aligned machine learning systems.

## Recent accepted papers from the Apart Lab

### Neuron to Graph: Interpreting Language Model Neurons at Scale

Alex Foote, Neel Nanda, Esben Kran, Ionnis Konstas, Shay Cohen, Fazl Barez

[Read paper](https://arxiv.org/abs/2305.19911 "‌") | [Visit project site](https://n2g.apartresearch.com/ "‌")

May 5, 2023  |  RTML workshop at ICLR 2023

### Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark

Jason Hoelscher-Obermaier, Julia Persson, Esben Kran, Ionnis Konstas, Fazl Barez

[Visit project site](https://specificityplus.apartresearch.com/ "‌")

July 10, 2023  |  ACL 2023

Apart Lab

A weekend of intense, fun, and collaborative research on the most interesting questions of our day from machine learning safety. With speakers from top institutions and companies in artificial intelligence development, you will get a chance to work on impactful research.

Alignment Jams happen across the world in:

- USA
- EU
- UK
- Mexico
- Brasil
- India
- Vietnam
- Israel
- Australia and
- Canada

[Website](https://alignmentjam.com/ "")

[Next hackathon](https://alignmentjam.com/jam/benchmarks "‌")

[Discord community](https://discord.gg/dYUWDm7Ben "‌")

[Add to your calendar](https://calendar.google.com/calendar/u/0?cid=ZjViYmMzNjlhNDFmZjg5MmY5ZTkxOWJjMGVkMmFlNjRmOTBjMmVjNTMzZDVhMTZhMWNkMjY4ZjU1M2JhMTBlY0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t "‌")

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]

Alignment Jam

The [AI Safety Ideas platform](https://aisafetyideas.com/) is a public Apart tool used for collecting research in AI safety, collaborate on projects, and facilitate mentorship.

## Team

The [Apart Research](https://apartresearch.com/ "‌") team, we have multiple volunteers and collaborators that have joined on our [Discord](https://apartresearch.com/join "‌") and in our other projects.

## Open impact metrics of AI Safety Ideas

The AI safety research ideas platform commits to transparency and sharing our metrics. We hope this enables easier evaluation of the platform's impact. Read the [forum post](http://forum.effectivealtruism.org/posts/nxeL7XFvtQCx7hpxo/everyone-show-us-your-numbers "‌") for more details.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




AI Safety Ideas

*Truth-seeking, science, technology, the future, and more. With animations!*

We aim to help humanity safely transition to a world with artificial general intelligence (AGI) and artificial super intelligence (ASI). In particular, we want to make it less likely for AGI and ASI to cause human extinction or astronomical suffering while ensuring they benefit every sentient being. AGI and ASI should enable a future in which we prosper and fulfill our potential.

In addition, we strive to help present and future sentient beings flourish under a "business as usual" scenario. This goal complements the former objective: it's a way for us to be still helpful even if some of our assumptions are wrong. 

We will pursue these objectives using the tools we can best leverage: knowledge, animation, art, and platforms that let us communicate with large and small audiences.

Rational Animations

[In this show](https://www.youtube.com/@TheInsideView), Michaël Trazzi discuss why experts believe what they believe about the future of AI progress. You can listen to the audio recordings and read the transcripts at [theinsideview.ai](https://theinsideview.ai).

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




The Inside View

We are the only organization that focuses on reducing AI existential risk by informing the public. Higher public awareness about AI existential risk should lead to appropriate AI regulation and more AI Safety research. We achieve our goals by publishing articles in traditional media (track record: 25 media items including two in [TIME](https://time.com/6258483/uncontrollable-ai-agi-risks/) [Magazine](https://time.com/6295879/ai-pause-is-humanitys-best-bet-for-preventing-extinction/)), doing communication research (track record: the [first paper](https://forum.effectivealtruism.org/posts/fqXLT7NHZGsLmjH4o/paper-summary-the-effectiveness-of-ai-existential-risk)s on the topic), organizing events (track record: debates with [Stuart Russell](https://www.youtube.com/watch?v=vGQDctxwy2E), [Connor Leahy](https://www.youtube.com/watch?v=M8YGDTTzivw), and several MPs), and lobbying (track record: a [unanimous motion](https://www.tweedekamer.nl/kamerstukken/moties/detail?id=2023Z05424&did=2023D12809) passed through Dutch parliament asking for more AI Safety research). More information can be found on our [website](https://www.existentialriskobservatory.org/).

We are currently active in the Netherlands, the UK and the US. More resources would allow us to scale up and increase effectiveness significantly.

Existential Risk Observatory: inform the public about AI x-risk (track record in TIME)

On this podcast, I ([Daniel Filan](https://danielfilan.com/ "‌")) have conversations with researchers about their papers. We discuss the paper and hopefully get a sense of why it’s been written and how it might reduce the risk of artificial intelligence causing an [existential catastrophe](https://en.wikipedia.org/wiki/Global_catastrophic_risk "‌"): that is, permanently and drastically curtailing humanity’s future potential.

This podcast launched in December 2020. [Finan Adamson](https://www.finanadamsonvoice.com/ "‌") edited the podcast between February 2021 and February 2022, and remains the audio consultant. Starting in March 2022, editing is done by Jack Garrett. As of August 2022, Amber Dawn Ace helps with transcription.

You can subscribe to AXRP by searching for it in your favourite podcast provider. To receive transcripts, you can subscribe to this website’s [RSS feed](https://axrp.net/feed.xml "‌"). You can also follow AXRP on twitter at [\@AXRPodcast](https://twitter.com/AXRPodcast "‌").

If you like AXRP, you might like its sister podcast, [The Filan Cabinet](https://thefilancabinet.com/ "‌"), where I interview people about a wide range of topics I’m interested in.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




AI X-risk Research Podcast

[QACI](https://www.lesswrong.com/posts/4RrLiboiGGKfsanMF/the-qaci-alignment-plan-table-of-contents) is a plan for aligning AI in a way which is robust to superintellgent optimization, under development by [Orthogonal](https://orxl.org/), an agent foundations research organization which is searching for formal goals which cause good things when maximized.

Our current best aligned formal goal is [QACI](https://www.alignmentforum.org/posts/CYtzXadXFtBSBYm3J/a-narrative-explanation-of-the-qaci-alignment-plan "‌") (see also [a story of how it could work](https://www.alignmentforum.org/posts/CYtzXadXFtBSBYm3J/a-narrative-explanation-of-the-qaci-alignment-plan "‌") and [a tentative sketch at formalizing it](https://www.alignmentforum.org/posts/qeRqmdadsdj8Frvyn/a-rough-sketch-of-formal-aligned-ai-using-qaci "‌")), which implements something [like coherent extrapolated volition](https://carado.moe/cev-coherent-enough.html "‌") by extending a ["past user"](https://carado.moe/outer-alignment-past-user.html "‌")'s reflection to be simulated/considered arbitrarily many times, until alignment is solved.




Question-Answer Counterfactual Interval (QACI)

The Simon Institute for Longterm Governance (SI) is a nonprofit based in one of the few hubs for global governance: Geneva, Switzerland. While most think tanks focus on supplying information, SI specialises in supporting policy networks in processing information overload, with a focus on the world’s most pressing problems.

Specifically, SI:

- Supports international civil servants and diplomats with training programmes that both facilitate group decision-making by practising key skills and tools, and foster an understanding of extreme risks and the significance of their mitigation. (See SI's [theory of change.](https://www.simoninstitute.ch/blog/post/our-theory-of-change/ "‌"))
- Supports longtermist actors in their engagement with [international policy processes](https://www.simoninstitute.ch/blog/post/setting-expectations-for-extreme-risk-mitigation-through-policy-change/ "‌") through research, training, and networking.
- [Analyses international policy processes](https://www.simoninstitute.ch/blog/post/setting-expectations-for-extreme-risk-mitigation-through-policy-change/ "‌") and how to improve their consideration of future generations.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Simon Institute for Longterm Governance

Longview Philanthropy designs and executes bespoke giving strategies for major donors. Its grant recommendations are driven by the conviction that we can use evidence and reason to find the highest-impact opportunities in the world.

Everything Longview Philanthropy offers is free, independent, and reviewed by external experts, and is guided by its [core values](https://www.longview.org/about "‌"):

- Longtermism: Our collective future could be extraordinarily good or inordinately bad. Longview believes this generation has the power to influence which path humanity takes, and it is essential that we act responsibly.
- A scientific mindset: Wherever possible, Longview is informed by the latest research from the natural and social sciences, and it acts on the best available balance of evidence.
- Intellectual honesty: Informed by world-class expertise, Longview only makes the grant recommendations that it thinks are best. It does not merely tell its philanthropists what they want to hear.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Longview Philanthropy

The Forethought Foundation is especially interested in the idea that the primary determinant of the value of our actions today is how those actions influence the very long-run future. It believes that by making the right decisions today, humanity has the opportunity to positively steer civilisation’s trajectory for thousands of years to come.

To this end, the Forethought Foundation is interested in [supporting excellent research](https://www.forethought.org/research-overview "‌") that:

- Defends or criticises the idea that we should primarily care about the very long-run impact of our actions.
- Works out the implications of a long-term view for our decisions today.
- Is of importance for the long-run future of civilisation, even if the research is not directly about the idea of long-term impact.

It supports such research through scholarships and fellowships to students in global priorities research, as well as research grants and prizes for established scholars.

The Forethought Foundation is a project of [Effective Ventures](https://ev.org/ "‌") (as is Giving What We Can — see our [transparency page](https://www.givingwhatwecan.org/transparency "‌")), and works in close collaboration with the Global Priorities Institute at Oxford University.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Forethought Foundation for Global Priorities Research

The Evaluations project is a new team led by Beth Barnes, working to build capability evaluations (and in the future, alignment evaluations) for advanced ML models. You can learn more at evals.alignment.org

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Alignment Research Center: Evaluations Project (ARC Evals)

The Theory team is led by Paul Christiano, furthering the research initially laid out in our report on Eliciting Latent Knowledge. At a high level, we’re trying to figure out how to train ML systems to answer questions by straightforwardly “translating” their beliefs into natural language rather than by reasoning about what a human wants to hear. We expect to use funds donated via this fundraiser towards supporting the Theory project.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Alignment Research Center: Theory Project

We are a dynamic community of researchers and policymakers from across Europe, united in our efforts to advance AI safety. Our network brings together experts from over 13 countries and counting, all working towards a common goal: ensuring that artificial intelligence systems are safe, ethical, and positively impactful for humanity. ENAIS (pronounced e-nice) distinguishes itself from related organizations by its focus on existential risks from AI.

At ENAIS, we believe that as AI technology continues to advance, it's important to consider the potential risks and challenges that come with it. That's why we are dedicated to researching and promoting best practices in AI safety, ensuring that advanced AI systems are developed and deployed responsibly.

Join us in our mission to make AI a force for good. Together, we can shape the future of this exciting and rapidly evolving field.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




European Network for AI Safety (ENAIS)

The Swiss Existential Risk Initiative (CHERI) supports bachelors, masters and PhD students looking to have a positive impact with their career in global catastrophic risk mitigation.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Swiss Existential Risk Initiative

CAIS exists to ensure the safe development and deployment of AI

AI risk has emerged as a global priority, ranking alongside pandemics and nuclear war. Despite its importance, AI safety remains remarkably neglected, outpaced by the rapid rate of AI development. Currently, society is ill-prepared to manage the risks from AI. CAIS exists to equip policymakers, business leaders, and the broader world with the understanding and tools necessary to manage AI risk.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Center for AI Safety

The Global Priorities Institute exists to develop and promote rigorous, scientific approaches to the question of how appropriately motivated actors can do good more effectively, with a particular focus on areas that are not already well addressed by existing academic research.

This line of thought motivates the following vision and mission:

Our Vision: A world in which global priorities are set by using evidence and reason to determine what will do the most good.

Our Mission: To conduct and promote world-class, foundational academic research on how most effectively to do good.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Global Priorities Institute

The Median Group, formed in early 2018, is a 501(c)(3) non-profit dedicated to research on global catastrophic risks. Our focus is on technological and geopolitical changes over the next century, and our aim is to model what such changes may look like and how their most detrimental effects might be mitigated or averted. Current research efforts include models of past and future progress in AI, presented at the [Center for Human-Compatible AI](http://humancompatible.ai/ "‌"), and of the impact climate change will have on global social and political dynamics.

See our [Research](http://mediangroup.org/research "‌") section for more details on specific projects, or follow our [RSS](http://mediangroup.org/feed/rss.xml "‌")/[ATOM](http://mediangroup.org/feed/atom.xml "‌") feed to be notified of work as it’s published.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]




Median Group

The Future Society (TFS) is an independent 501(c)(3) nonprofit organization based in the US and Europe. Our mission is to **align artificial intelligence through better governance** to ensure that AI systems are safe and adhere to fundamental human values. We develop, advocate for, and facilitate the implementation of AI governance mechanisms, ranging from laws and regulations to voluntary frameworks such as global principles, norms, standards, and corporate policies.

[Our work](https://thefuturesociety.org/our-work/ "‌") spans a range of governance themes, including [AI and the Rule of Law](https://thefuturesociety.org/theme/ai-and-rule-of-law/ "‌"), [European AI Governance](https://thefuturesociety.org/theme/european-ai-governance/ "‌"), and [Global & Corporate AI Governance](https://thefuturesociety.org/theme/global-corporate-ai-governance/ "‌"). Through our work, we collaborate with intergovernmental organizations, governments, companies, academic institutions, and other civil society organizations.

[This project was created by the Impact Markets team. Please visit the website of the organization for more information on their work.]


