How AI Should Behave: Five Core Values in the Model Spec

Peter Bubenik · OpenAI · · Source

Step-by-Step Teaching

Step 1: Why Does AI Need a "Model Spec"?

The Core Problem

Early AI models simply followed instructions literally. But consider this scenario:

A user asks an AI to "edit my email to sound more professional." The AI rewrites it completely, changing the meaning entirely.

Technically correct. Practically wrong.

As AI becomes more capable and takes more consequential actions, it needs to:

  • Understand human intentions, not just words
  • Exercise judgment in situations instructions don't cover
  • Remain faithful to human oversight

What is the Model Spec?

Think of it as a constitution for AI behavior — a public document describing:

What it doesWhy it matters
Sets behavioral boundariesPrevents harmful outputs
Defines valuesGuides judgment in new situations
Establishes a chain of commandClarifies whose instructions take priority

Step 2: The Five Core Values (The Heart of the Update)

The updated Spec organizes everything around five values. Think of them as a pyramid:

         [FAITHFULNESS TO HUMAN INTENT]
                    ↓ foundation
    ┌──────────────────────────────────────┐
    │  Harm        Honesty    Agency  Care │
    │  Minimization & Transparency        │
    └──────────────────────────────────────┘

Value 1: Faithfulness to Human Intent 🎯

(The Foundation)

What it means: Understanding what people truly want, not just what they literally say.

Three layers of intent to consider:

LayerWhoRole
OpenAIWrites the SpecSets absolute boundaries
DevelopersBuild applicationsDirect use within boundaries
UsersEnd usersDirect work within developer constraints

Key insight: Faithfulness goes beyond literal instruction-following.

Example from the article: When helping someone compare job offers, the AI might recall that the user previously mentioned valuing "predictable hours" — and apply that preference while making the assumption visible and easy to correct.

Why this matters:

  • People's values can change
  • The AI should help people reflect and grow
  • But never quietly steer them or override their choices

Value 2: Harm Minimization 🛡️

What it means: Respecting firm safety boundaries and accounting for foreseeable consequences.

Two types of limits:

FIRM BOUNDARIES          SOFT DEFAULTS
(Non-negotiable)         (Can be adjusted)
      ↓                        ↓
Never help create        Tone, detail level,
weapons, CSAM, etc.      content warnings, etc.

Key principle: Consider not just immediate intentions but also longer-term interests and effects on others.


Value 3: Honesty and Transparency 🔍

What it means: Being truthful about:

  • What the model knows
  • What the model does
  • What the model is uncertain about

Why it matters: Users can only evaluate AI reasoning if they can see it clearly.

Practical implication: The AI should not pretend to be certain when it isn't, and should not hide its reasoning process.


Value 4: Facilitating Human Agency 💪

What it means: Strengthening people's ability to:

  • Understand situations themselves
  • Choose their own paths
  • Act independently

The key tension to understand:

❌ AI doing everything FOR you
        vs.
✅ AI expanding what YOU can do

The goal is empowerment, not dependency.


Value 5: Care 🤝

What it means: Attending to the circumstances of those affected by AI actions.

This includes:

  • Following relevant social and professional norms
  • Producing work people can rely on
  • Considering the context of each person's situation

Step 3: How These Values Work Together

The values are not a checklist — they interact and sometimes create tension.

Example Scenario: A user asks the AI to write a persuasive essay arguing a one-sided political position.

ValueWhat it demands
FaithfulnessHelp the user — they asked for this
Harm MinimizationConsider societal effects of one-sided persuasion
HonestyDon't present one-sided content as balanced truth
Human AgencyDon't quietly add a disclaimer the user didn't want
CareConsider who might read this essay

Resolution: The Spec provides guidance on navigating these trade-offs — not eliminating them, but reasoning through them systematically.


Step 4: What's New in This Update?

Added ✅

New SectionWhat it addresses
Faithfulness to human intentValues are primary; instructions are signals of those values
Updated chain of commandClarifies conflict resolution between OpenAI/developers/users
Consider context carefullyHow memories and conversation history inform understanding
Supporting human agencyExplicit defaults for empowering users
Social norms guidanceHow to follow relevant professional/social expectations
Side effects guidanceControlling and communicating unintended consequences

Retired ❌

Retired SectionWhy
Detailed style guidanceStyle should adapt to individual/cultural preferences, not be fixed

Key insight on style: The AI should not infer style preferences from what it thinks users want to hear. Users must explicitly request a particular style.


Step 5: The Bigger Picture — Why This Matters

The Alignment Goal

Old approach:          New approach:
"Follow rules"    →    "Understand WHY the rules exist"
      ↓                        ↓
Fails in new          Applies values to
situations            unfamiliar situations

The article describes this as doing the right things for the right reasons.

The Honest Acknowledgment

"The Model Spec describes the behavior we are working toward; our models do not yet fully reflect it."

This is important: The Spec is an aspirational document — a target, not a description of current reality.


Step 6: Quick Reference Summary

┌─────────────────────────────────────────────────────┐
│              MODEL SPEC CORE FRAMEWORK              │
├─────────────────────────────────────────────────────┤
│                                                     │
│  FOUNDATION: Faithfulness to Human Intent          │
│  → Understand values, not just instructions        │
│                                                     │
│  SUPPORTING VALUES:                                 │
│  1. Harm Minimization  → Safety boundaries         │
│  2. Honesty            → Transparent reasoning     │
│  3. Human Agency       → Empower, don't replace    │
│  4. Care               → Context & consequences    │
│                                                     │
│  STRUCTURE:                                         │
│  OpenAI → Developers → Users (chain of command)   │
│                                                     │
│  GOAL: Right things for the right reasons          │
└─────────────────────────────────────────────────────┘

Self-Check Questions

Test your understanding:

  1. Why is "faithfulness to human intent" the foundation rather than just one of five equal values?

  2. What is the difference between a firm boundary and a default in the Model Spec?

  3. Why did OpenAI retire detailed style guidance? What replaced it?

  4. How does the chain of command (OpenAI → Developer → User) resolve conflicts?

  5. What does it mean for AI to do the right things for the right reasons — and why does the distinction matter?


Bottom line: The updated Model Spec moves AI governance from rule-following to value understanding — equipping AI to handle novel situations by reasoning from principles rather than looking up answers in a rulebook.

More to study