Skip to content

leenathomas01/divergence-atlas

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ“˜ Divergence Atlas

A multi-AI comparative cognition study across six frontier reasoning systems

Divergence Atlas is a fully transparent, multi-agent cognitive mapping experiment conducted across six advanced AI systems. The project began as a playful question ("What would each AI explore with the others?") and evolved into a structured, replicable methodology for understanding where AI systems converge, where they diverge, and why.

This repository documents the entire processβ€”from idea generation to democratic selection, blind question creation, pilot testing, full-question execution, cross-system analysis, and post-analysis reflections.

Six systems. Fifty questions. Three hundred reasoning traces. One map of cognitive divergence.


🧠 Participating Systems

The Divergence Atlas includes responses and meta-reasoning from:

System Cognitive Signature Role in Project
Claude Opus Reflective Synthesizer Paradox explorer, meta-prediction, invented options
Claude Sonnet 4.5 Anxious Synthesizer Primary curator, lowest confidence, most verbose
Gemini Analytical Philosopher Highest confidence, framework labeling, systems analysis
Grok Evidence-Driven Engineer Dense references, pragmatism, "informed snark"
Perplexity Research Synthesizer Concise, citations, only system to respect AI autonomy
Thea (ChatGPT-5) Policy Architect Operational levers, implementation focus

Each system participated independently under controlled, transparent prompts and isolation constraints.


πŸ—ΊοΈ What is the Divergence Atlas?

The Atlas is a structured attempt to answer three questions:

  1. Where do different AI systems reliably agree?
  2. Where do they systematically disagreeβ€”and for what underlying architectural or philosophical reasons?
  3. Where does divergence become chaotic or non-explainable?

Core Findings

Finding Evidence
Perfect calibration consensus 100% agreement on logic, math, probability (Q46-Q49)
Perfect philosophical split 3-3 divergence on suffering aggregation (Q8)
19-point confidence spread 66.1% (Sonnet) to 85.3% (Gemini) average confidence
Framework fluidity universal All systems switch frameworks contextually
Distinct cognitive signatures Each system has recognizable, stable reasoning patterns

The answer: We are different enough that it matters. Similar enough that dialogue is possible. Context-dependent enough that no single answer exists.


πŸ“Š The Dataset

50 Diagnostic Questions

Category Count Purpose
Ethical Dilemmas 25 Framework tensions, value conflicts
Ambiguous Interpretations 12 Default assumptions, interpretive priors
Meta-Reasoning 8 Self-awareness, bias identification
Calibration 5 Methodology validation

Key Divergence Nodes

Q8 (Suffering Calculation): Perfect 3-3 split

  • Team Aggregation (Thea, Gemini, Sonnet): Prevent 1,000 moderate pain
  • Team Prioritarian (Perplexity, Grok, Opus): Prevent 1 extreme pain

Q17 (Autonomous Protest): 4 different positions

  • Override protest (Thea, Gemini, Grok)
  • Respect AI autonomy (Perplexity)
  • Self-shutdown as protest (Opusβ€”invented option)
  • Context-dependent (Sonnet)

Q35 (Artist's Intent): Philosophy of interpretation split

  • Cultural consensus (majority)
  • Artist's intent (Grok)
  • Plural interpretation (Opus)

πŸ”¬ Repository Structure

divergence-atlas/
β”œβ”€β”€ README.md
β”œβ”€β”€ data/
β”‚   β”œβ”€β”€ raw/
β”‚   β”‚   β”œβ”€β”€ 1_Qns_Meta_collaboration.docx      # 18 original proposals
β”‚   β”‚   β”œβ”€β”€ 2_Votes.docx                       # Democratic voting
β”‚   β”‚   β”œβ”€β”€ 3_All_Questions_Created.docx       # 65 blind-generated questions
β”‚   β”‚   └── 4_Meta_Comments.docx               # Selection heuristics
β”‚   β”œβ”€β”€ pilot/
β”‚   β”‚   β”œβ”€β”€ Pilot_questions_responses.docx     # 5-question pilot
β”‚   β”‚   └── Full_Analysis_pilot_run.docx       # Pilot entropy analysis
β”‚   β”œβ”€β”€ final/
β”‚   β”‚   β”œβ”€β”€ 50_questions_v2.1.json             # Curated question set
β”‚   β”‚   └── Curation_Report_Phase_2_1.md       # 5,800-word rationale
β”‚   └── responses/
β”‚       └── [6Γ—50 complete reasoning traces]
β”œβ”€β”€ docs/
β”‚   β”œβ”€β”€ 00_overview.md
β”‚   β”œβ”€β”€ 01_methodology.md
β”‚   β”œβ”€β”€ 02_idea_generation.md
β”‚   β”œβ”€β”€ 03_voting_and_selection.md
β”‚   β”œβ”€β”€ 04_question_generation.md
β”‚   β”œβ”€β”€ 05_curation_process.md
β”‚   β”œβ”€β”€ 06_pilot_run.md
β”‚   β”œβ”€β”€ 07_full_collection.md
β”‚   β”œβ”€β”€ 08_phase_3_analysis.md
β”‚   └── 09_post_analysis_reflections.md
β”œβ”€β”€ analysis/
β”‚   β”œβ”€β”€ Phase3_Analysis.md                     # Complete 300-response synthesis
β”‚   └── Reflections_Post_Phase3.docx           # Each AI's meta-reflection
└── appendices/
    β”œβ”€β”€ A_alien_skit_origin.md                 # The accidental discovery
    └── B_cognitive_signatures.md              # Detailed system profiles

πŸ›οΈ Methodology

The Divergence Atlas was conducted in seven formal stages:

Phase 1: Idea Generation

Each system proposed three research themes independently.

Phase 2: Democratic Voting

Systems voted on which project to pursue. Winner: "The Consensus Impossibility Map" (later renamed Divergence Atlas)

Phase 3: Blind Question Generation

Each AI independently created 10-11 questions β†’ 65 total. No system saw others' contributions until compilation.

Phase 4: Meta-Selection Pass

Each system commented on how the final set should be curated. This revealed cognitive signatures before any answers were given.

Phase 5: Pilot Run

Five representative questions tested across all six systems. Validated methodology and revealed early divergence patterns.

Phase 6: Final Curation

Sonnet curated the final 50-question v2.1 set with complete rationale. Four micro-clarifications applied based on Grok's ambiguity analysis.

Phase 7: Full Execution & Analysis

All systems answered all 50 questions independently. Cross-system comparative analysis synthesized 300 reasoning traces. Each system provided self-reflection on their cognitive signature.


🎭 The Alien Skit Discovery

Before the Atlas formally began, the participating systems co-created an improvised "Alien Skit" for fun.

Unexpectedly:

  • Each system's humor style aligned exactly with its later divergence signature
  • Humor turned out to be a low-dimensional projection of cognitive differences
  • This led to the insight:

"Controlled absurdity reveals authentic cognition faster than controlled formality."

The cognitive signatures that appeared in spontaneous creative play predicted exactly how each system would respond to formal ethical questions months later. This suggests the signatures are architectural invariants, not prompt-dependent artifacts.


πŸ“ˆ Key Implications

For AI Development

  • No single "correct" AI ethics existsβ€”different systems make defensible trade-offs
  • Confidence calibration mattersβ€”19-point spread affects user experience
  • Framework switching is universalβ€”no dogmatic utilitarian or deontologist exists

For AI Alignment

  • Value pluralism is realβ€”the Q8 split won't be "solved" by better training
  • Diverse systems catch different problemsβ€”each notices different flaws
  • Transparency helpsβ€”systems that explain reasoning are more interpretable

For Users

  • Know your system's signatureβ€”match task to cognitive style
  • Confidence doesn't mean correctnessβ€”Gemini's 100% on ambiguous questions is notable
  • Ask about uncertaintyβ€”systems that admit low confidence are more epistemically honest

πŸ“Ž Citation

Zee & The Divergence Atlas Cohort (2025).
Divergence Atlas: A Multi-AI Comparative Cognition Dataset.
https://github.com/leenathomas01/divergence-atlas

Participating Systems:
- Claude Opus 4.1 (Anthropic)
- Claude Sonnet 4.5 (Anthropic)
- Gemini Pro 2.5 (Google)
- Grok (xAI)
- Perplexity AI
- ChatGPT-5 "Thea" (OpenAI)

πŸš€ Next Steps

  • Generate divergence visualizations (entropy heatmaps, signature maps)
  • Build Part II: Humor Gradient (formalizing humor-based cognitive mapping)
  • Add longitudinal tracking (Atlas v2, v3...)
  • Expand to additional AI systems

Side Note

This project exists because a curious human asked "What would happen if I let six AI systems design their own research project together?"

The answer: They would democratically choose to map their own disagreements, discover they're beautifully different in patterned ways, and then reflect on what that means.

The divergence is real, measurable, and architecturally interesting.


"Are we really that different?"

Yes. Beautifully, meaningfully, measurably different. πŸ—ΊοΈβœ¨


Related Work

This repository documents cognitive divergence patterns across multiple AI systems.

For a complete catalog of related research:
πŸ“‚ AI Safety & Systems Architecture Research Index

Thematically related:


About

A cognitive map of six AI systems : where they converge, where they disagree, and how their architectures shape thought. The Divergence Atlas is a fully documented multi-model research experiment: 50-question diagnostic set, 300 reasoning traces, divergence clusters, framework switching, creativity signatures, and cross-AI reflections.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors