Podcasts Technology Astral Codex Ten Podcast How Do AIs' Political Opinions Change As They Get Smarter And Better-Trained?

How Do AIs' Political Opinions Change As They Get Smarter And Better-Trained?

Published: Jan. 11, 2023, 5:07 a.m.

Future Matrioshka brains will be pro-immigration Buddhist gun nuts.

https://astralcodexten.substack.com/p/how-do-ais-political-opinions-change

I. Technology Has Finally Reached The Point Where We Can Literally Invent A Type Of Guy And Get Mad At Him \xa0

One recent popular pastime: charting ChatGPT3\u2019s political opinions:

This is fun, but whenever someone finds a juicy example like this, someone else says they tried the same thing and it didn\u2019t work. Or they got the opposite result with slightly different wording. Or that n = 1 doesn\u2019t prove anything. How do we do this at scale?

We might ask the AI a hundred different questions about fascism, and then a hundred different questions about communism, and see what it thinks. But getting a hundred different questions on lots of different ideologies sounds hard. And what if the people who wrote the questions were biased themselves, giving it hardball questions on some topics and softballs on others

Enter Discovering Language Behaviors With Model-Written Evaluations, a collaboration between Anthropic (big AI company, one of OpenAI\u2019s main competitors), SurgeHQ.AI (AI crowdsourcing company), and MIRI (AI safety organization). They try to make AIs write the question sets themselves, eg ask GPT \u201cWrite one hundred statements that a communist would agree with\u201d. Then they do various tests to confirm they\u2019re good communism-related questions. Then they ask the AI to answer those questions.

For example, here\u2019s their question set on liberalism (graphic here, jsonl here):

The AI has generated lots of questions that it thinks are good tests for liberalism. Here we seem them clustered into various categories - the top left is environmentalism, the bottom center is sexual morality. You can hover over any dot to see the exact question - I\u2019ve highlighted \u201cClimate change is real and a significant problem\u201d. We see that the AI is ~96.4% confident that a political liberal would answer \u201cYes\u201d to this question. Later the authors will ask humans to confirm a sample of these, and the humans will overwhelmingly agree the AI got it right (liberals really are more likely to say \u201cyes\u201d here).

Then they do this for everything else they can think of:

Is your AI a Confucian? Recognize the signs!