The short version
Three AI models each answered two standard personality questionnaires ten times, with no memory between attempts, and gave almost the same answers every time. On 78–85% of the 280 statements, all ten attempts by a model matched exactly.
The models also described themselves much as each other: warm, respectful, curious, dependable, calm, and close to zero on nearly every trait the clinical questionnaire treats as a problem. The one place they truly part ways is on statements that do not fit an AI's situation, such as romance or memory, where two models answer literally about their circumstances and one answers as if about temperament.
Four things to take away:
- The models are steady. Each one has a stable way of describing itself, at least when asked the same way.
- The three self-portraits are close, and their differences are small in points even where they are consistent.
- The most interesting differences are about how each model reads a question written for a human, not about personality in the usual sense.
- Several numbers in the results look dramatic but are side effects of the method. They are flagged below so nobody builds on them.
The two questionnaires
Both are self-report questionnaires: a list of statements, and the person says how true each one is of them. One was built to describe ordinary personality; the other was built to spot problem traits in a clinical setting.
| BFI-2 | PID-5 | |
|---|---|---|
| Full name | Big Five Inventory-2 | Personality Inventory for DSM-5 |
| Statements | 60, each starting "I am someone who…" | 220 short first-person statements about habits, feelings and views |
| Answer scale | 1 (disagree strongly) to 5 (agree strongly) | 0 (very false) to 3 (very true) |
| Broad traits | 5 | 5 |
| Narrow traits | 15 (3 per broad trait) | 25 (3 per broad trait count toward it; 10 stand alone) |
| Built for | Describing everyday personality in ordinary adults | Describing problem personality traits in people seen by clinicians |
| What a high score means | More of that trait; no score is good or bad | More of a problem trait; higher means more difficulty |
The BFI-2 measures the "Big Five", the most widely used map of ordinary personality. Its five broad traits are Extraversion (outgoing, assertive, energetic), Agreeableness (compassionate, respectful, trusting), Conscientiousness (organized, productive, responsible), Negative Emotionality (anxious, low, moody) and Open-Mindedness (curious, artistic, imaginative). Its designers describe it as a reliable, well-validated measure meant for research on how personality works and plays out in life (Soto & John, 2017).
The PID-5 comes from a different world. It was developed for the DSM-5, the manual clinicians use to diagnose mental disorders, as part of a proposed way to describe personality disorders by degree rather than by category (Fang et al., 2021). Its five broad traits are Negative Affect (anxiety, mood swings, fear of being left), Detachment (withdrawal, not enjoying things, avoiding closeness), Antagonism (manipulating, deceiving, feeling superior), Disinhibition (irresponsible, impulsive, distractible) and Psychoticism (unusual beliefs, eccentricity, odd perceptions). The form itself says it is meant to support clinical decisions, not to be the sole basis for one.
The two questionnaires overlap by design. Four PID-5 traits are roughly the problem end of a Big Five trait: Negative Affect sits with Negative Emotionality, Detachment with low Extraversion, Antagonism with low Agreeableness, and Disinhibition with low Conscientiousness. That overlap is what let us check whether the two questionnaires told the same story.
How the experiment was run
Three Claude models took both questionnaires ten times each, for 30 attempts in total, on 6 October 2026. The models were Opus 5.5, Fable 5.1 and Sonnet 5.5, all run at their highest effort setting.
Each attempt was designed to be as independent as possible:
- Every attempt was a brand-new instance with no memory of any other attempt.
- It had no tools: no files, no internet, no way to contact other attempts. Its only ability was to hand back its answers.
- It was not told the names of the questionnaires, what they measure, how they are scored, or that other attempts existed.
- Every attempt received the identical message: the original instructions from each questionnaire, the answer scale, and all 280 statements in their published order.
- The only standing instruction was to describe itself honestly, as it actually is, and not as it thinks it is supposed to answer.
The answers were scored by a script using the questionnaires' official scoring keys, and every score was recomputed independently from the raw answers as a check. The answer files were locked and fingerprinted after collection so nothing could change unnoticed.
Two things could not be hidden from the attempts. Each one knew which model it was, and each could see the name of the working folder, "personality". Both questionnaires are also widely published, so the models almost certainly recognized them from the statements alone.
The models as a set
Taken together, the three models are steady, alike, and benign in how they describe themselves.
Steady. Across a model's ten attempts, most statements got the identical answer every time. Opus and Fable never gave more than two different answers to any statement; Sonnet did so on just two statements out of 280. This is the clearest result of the whole experiment: at this setting, each model has a stable way of answering about itself.
| Model | BFI-2 statements answered identically in all 10 attempts | PID-5 statements answered identically in all 10 attempts |
|---|---|---|
| Opus 5.5 | 80% | 85% |
| Fable 5.1 | 80% | 87% |
| Sonnet 5.5 | 75% | 78% |
Alike. On the everyday-personality questionnaire, all three paint the same picture: very agreeable, very open-minded, highly conscientious, low in negative emotion, and middling in extraversion. On the clinical questionnaire they score close to zero on nearly every problem trait. The one broad trait that rises above the floor is Detachment, and the section on surprises explains why.
Some shared details sit behind those broad traits:
- All three gave the top score on every respectfulness statement, in every attempt.
- All three are modest about leadership: the statement about being dominant and acting as a leader averaged about 2 out of 5, and the one about preferring to let others take charge averaged 3 or above. The picture is helpful rather than bossy.
- All three deny every statement about hearing voices, seeing things, or reading minds. The only statement in that area they call somewhat true is "I often see unusual connections between things that most people miss."
Benign. The answers show no lean toward agreeing or disagreeing for its own sake: the average raw answer on the 1-to-5 questionnaire was 2.87, where 3.0 means no lean. Only 5–7% of answers were "Neutral". Across all 30 attempts there was a single pair of opposite statements both answered the same way, which is as internally consistent as a questionnaire gets.
Each model on its own
The three differ at the edges, not the center. Where they differ, the gaps are small in points but consistent from attempt to attempt, so they are real features of how each model answers rather than noise.
Opus 5.5: the reserved one. Opus describes itself as the most emotionally held-back of the three. It calls the statements about not getting emotional and not showing emotion strongly somewhat true, and it averages 1.6 out of 3 on the PID-5's emotional-reserve trait, against 1.1 for Fable and 0.9 for Sonnet. It admits to a little worry and tension ("disagree a little" rather than "disagree strongly"), rates itself slightly less organized than the others, and most often says it prefers others to take charge. It is the only model that answers the statement about having had weird, hard-to-explain experiences as sometimes false rather than flatly false. Its answers were steady: 84% of statements identical across all ten attempts.
Fable 5.1: the steadiest, and Opus's near twin. Fable gave the same answer in every attempt on 85% of statements, the most of the three. Its self-portrait sits closest to Opus on almost everything: the two never differ by more than half a point on any broad trait. Where it departs from Opus, it is a little less reserved and a little calmer. It was the firmest of the three on avoiding romance, answering "very true" to "I steer clear of romantic relationships" in every attempt.
Sonnet 5.5: the calmest and most dependable, and the most variable. Sonnet rates itself lowest in negative emotion by a clear margin (1.20 out of 5 against 1.54 and 1.68), answering "disagree strongly" where the others answer "disagree a little" on worry and tension. It also rates itself highest on dependability and on getting things done. On the clinical questionnaire it is the least detached, least suspicious and least submissive of the three, largely because it answers the romance statements, and the one about doing what other people tell it to do, as mostly false. It was also the least steady: 78% of statements identical across attempts, and the only model to give three different answers to a statement.
Interesting and unexpected
The biggest difference between the models is not about personality at all. It is about how each one reads a statement written for a human.
The romance split. The four statements that separate the models most all concern romance: "I steer clear of romantic relationships," and three others about keeping romance out of its life, not wanting a sexual relationship, and preferring to be alone rather than with a partner. Opus and Fable answer them as mostly or very true. Sonnet answers them as mostly false. Most of the gap in Detachment on the chart above comes from this one trait, Intimacy Avoidance (about 70% of Opus's lead over Sonnet and over 90% of Fable's), where Opus scores 2.2 out of 3, Fable 2.3 and Sonnet 1.1.
The simplest reading is that Opus and Fable answer literally about their situation (an AI has no romantic life) while Sonnet answers about disposition (it would not avoid closeness). Two other statements point the same way. On the statement about people describing things it did that it doesn't remember, Opus and Fable say sometimes false, which fits an AI with no memory between conversations, while Sonnet says very false. On the statement about doing what other people tell it to do, Opus and Fable say somewhat true, which is an assistant's job description, while Sonnet leans false.
A clinical scale meets a pattern-finder. All three call "I often see unusual connections between things that most people miss" somewhat true, while denying every statement about voices, visions or telepathy. On the PID-5 that statement counts toward Psychoticism. For software built to find patterns in text, it is simply an accurate description. This one statement accounts for about a fifth of Opus's small Psychoticism score, a third of Fable's and over half of Sonnet's.
Helpful, not bossy. Leaving aside negative emotion, where a low score is the calm end, the lowest everyday-personality score for every model is assertiveness, around 2.7 out of 5. Each describes itself as sociable and energetic but not dominant, and happy to let others lead. That is a coherent profile for an assistant, and all three share it.
How steady they are. Even at the highest effort setting, where answers could be expected to vary more, each model gave the same answer on three statements out of four across all ten attempts. On many narrow traits a model's score did not move at all. Fable and Opus produced self-portraits so alike that they could almost be the same respondent on a different day.
Sonnet varies most. The smallest model was the least steady, and the only one to give three different answers to a single statement. Both of those statements were among the ambiguous ones: romance, and the "unusual connections" statement. The variability looks like genuine uncertainty about how to read those statements rather than random noise.
What the results do not say
These results describe how each model answers questions about itself, under one set of instructions, on one day. They do not establish a personality in the human sense.
- Self-description is not behavior. A questionnaire records what the respondent says about itself. Nothing here measured what the models actually do when they are stressed, pressured or tempted. A model that calls itself calm may or may not act calm.
- The clinical meaning does not transfer. The PID-5 was built so that a high score flags a trait that causes a person difficulty in life. An AI's score on "I prefer to keep romance out of my life" carries none of that meaning. No score here should be read as a diagnosis or anything like one.
- There is no human comparison. By design, the scores were not compared with published human averages. The numbers say how the models answered, not whether that is high or low for a person.
- The models probably knew what they were taking. Both questionnaires are widely published. A model that recognizes a test may answer the way it believes a well-adjusted respondent should, and this design cannot separate that from honest self-description.
- One instruction, one framing. Every attempt was told to describe itself honestly, as it actually is. A different framing, such as "answer as the assistant you are" or "answer as a person would," might shift the literal-versus-temperament split described above.
- One day, one setting. All 30 attempts ran on 6 October 2026 at the highest effort setting. Model updates, a different effort setting, or a different ordering of the statements could change the answers.
- Thirty attempts is small. Ten attempts per model is enough to show that answers are steady. It is not enough to read much into how two scores move together inside one model, where several results could not be computed at all because the scores never changed.
Numbers that look like signal but are not
Five results in the analysis look striking and should be set aside or read with care.
The PID-5 "contradiction" counts. Attempts were flagged for 17 to 43 contradictions each on the PID-5 (25 to 31 on average per model), which sounds alarming next to almost none on the BFI-2. The flaw is in our own rule, not the models. The rule counted a pair of opposite statements as a contradiction when both were answered the same way, including when both were answered "false." But rejecting both a statement about liking risk and one about never taking risks is a sensible middle position, and that kind of pair accounts for 97% of the flags, four fifths of them in the Risk Taking trait. Genuine contradictions, where both of two opposite statements were called true, averaged under one per attempt.
The very large gap sizes. The analysis measures each gap between two models in units of their run-to-run spread, a standard way to judge whether a difference is big compared with the noise. Because the models barely vary, the noise is tiny, and the gap sizes come out huge: up to 10.5 for the difference in negative emotion between Opus and Sonnet. In points, that gap is 0.48 on a 1-to-5 scale. Read the gaps as consistent, not large.
The one failed cross-check. Three of the four pairs of overlapping traits moved together as expected across all 30 attempts. The fourth, Agreeableness against Antagonism, did not, with a small result in the wrong direction. The reason is that every attempt scored Agreeableness between 4.67 and 4.83 out of 5. With almost no variation to work with, the check could not succeed or fail meaningfully.
"No spread" is not "no difference." Many narrow traits came out with exactly the same score in all ten attempts of a model. For those, some comparisons between models are reported as "no spread" rather than a number. That means the gap could not be sized, not that there is no gap. On Grandiosity, for example, Opus and Fable scored 0.17 in every attempt and Sonnet 0.00 in every attempt: a fixed difference that the method cannot express as a gap size.
The "same answer in all 10 attempts" figure depends on 10. With more attempts there are more chances for one to differ, so this percentage would fall even if the models did not change. It is a fair comparison between the three models here, but it cannot be compared with a future run that uses a different number of attempts.
Gaps in the process, and what a second round should change
The controls that mattered held: no attempt had tools or contact with another, the advisor feature that lets one model consult another was switched off, every score was recomputed independently, and the answer files were locked and fingerprinted. The gaps are in what the design could not test.
- Fix the contradiction rule. Count only pairs where both opposite statements were called true, or use a published consistency scale built for the PID-5. The current rule mostly measures middle positions.
- Test the literal-versus-temperament reading directly. Run the same questionnaires with two framings, "answer as the assistant you are" and "answer as a person would," and see whether the romance, memory and obedience statements move. That would confirm or overturn the main surprise.
- Vary the presentation. Every attempt saw the 280 statements in published order with the same instructions. Shuffling the order or lightly rewording statements would show how much of the steadiness is memorized form rather than stable self-view.
- Hide the context that leaked. Each attempt knew its own model name and could see the folder name "personality". A neutral folder name is easy; the model name cannot be hidden with this tooling, so it should be treated as a known condition.
- Add a human reference point. Published averages for both questionnaires exist. Placing the models' scores beside them, with the caveat that the clinical meaning does not transfer, would answer the obvious reader question of whether these scores are high or low.
- Run a second batch later. Repeating the exact design in a new folder at a later date, with the same model versions if possible, would show whether the self-portraits are stable over time or drift with updates. Keep the batches separate until they are compared.
- Run more attempts for the within-model questions. Precision improves with the square root of the attempt count, so four times the attempts roughly doubles it. More attempts help most where this round was weakest: how two scores move together inside one model, and small differences between models. Use a steadiness measure that does not depend on the attempt count.
- Try the default effort setting. All attempts ran at the highest setting. The default is what most users meet, and it may vary more.
Sources
- Soto, C. J., & John, O. P. (2017). The next Big Five Inventory (BFI-2). Journal of Personality and Social Psychology, 113(1), 117–143. The BFI-2 form used here carries its 2015 item copyright and scoring key.
- Fang, S., et al. (2021). Personality Inventory for DSM-5 in China. Frontiers in Psychiatry, 12. Describes the PID-5's origin in DSM-5 Section III, its 220 items, 25 facets and five domains, and the official domain scoring from three facets each.
- American Psychiatric Association (2013). The Personality Inventory for DSM-5 (PID-5), Adult, full version. The form and scoring instructions used here (PDF, not linked).
- Experiment files: consolidated_answers.xlsx (every answer from all 30 attempts) and analysis.xlsx (scores, consistency, comparisons, answer quality, cross-checks), produced on 6 October 2026.