Skip to content

Updated default model from openai-codex/gpt-5.3-codex to openai-codex/gpt-5.4 in tests.#44367

Merged
dvrshil merged 2 commits intoopenclaw:mainfrom
jrrcdev:fix/openai-codex-auth-test
Mar 13, 2026
Merged

Updated default model from openai-codex/gpt-5.3-codex to openai-codex/gpt-5.4 in tests.#44367
dvrshil merged 2 commits intoopenclaw:mainfrom
jrrcdev:fix/openai-codex-auth-test

Conversation

@jrrcdev
Copy link
Contributor

@jrrcdev jrrcdev commented Mar 12, 2026

Summary

  • Problem: Two tests in models/auth.test.ts expected the old default model openai-codex/gpt-5.3-codex and the old log text. The codebase default was already openai-codex/gpt-5.4 (in openai-codex-model-default.ts), so the tests were out of date and failing.
  • Why it matters: Keeps CI green and keeps test expectations aligned with the current default so future changes don’t hide real regressions.
  • What changed: In src/commands/models/auth.test.ts, updated the two Codex login tests to assert on openai-codex/gpt-5.4 and the matching “Default model available” / “Default model set to” log messages.
  • What did NOT change (scope boundary): No production code, no change to OPENAI_CODEX_DEFAULT_MODEL, no user-facing behavior, and no other test files.

Change Type (select all)

  • Bug fix
  • Feature
  • Refactor
  • Docs
  • Security hardening
  • Chore/infra

Scope (select all touched areas)

  • Gateway / orchestration
  • Skills / tool execution
  • Auth / tokens
  • Memory / storage
  • Integrations
  • API / contracts
  • UI / DX
  • CI/CD / infra

Linked Issue/PR

  • Closes #
  • Related #

User-visible / Behavior Changes

None. Test-only change; default model and CLI behavior are unchanged.

Security Impact (required)

  • New permissions/capabilities? No
  • Secrets/tokens handling changed? No
  • New/changed network calls? No
  • Command/tool execution surface changed? No
  • Data access scope changed? No
  • If any Yes, explain risk + mitigation: N/A

Repro + Verification

Environment

  • OS: Any
  • Runtime/container: Node/Bun (repo test env)
  • Model/provider: N/A (tests are mocked)
  • Integration/channel: N/A
  • Relevant config: N/A

Steps

  1. Before change: run npx vitest run src/commands/models/auth.test.ts.
  2. Observe failures in “supports built-in openai-codex login without provider plugins” and “applies openai-codex default model when --set-default is used” (expected gpt-5.3-codex, received gpt-5.4).
  3. After change: run the same command; both tests pass.

Expected

  • Tests pass and assert on the current default openai-codex/gpt-5.4 and its log messages.

Actual

  • Same as expected after the fix.

Evidence

Attach at least one:

  • Failing test/log before + passing after
  • Trace/log snippets
  • Screenshot/recording
  • Perf numbers (if relevant)

(Optional) Paste the before-fix test failure (AssertionError on gpt-5.3-codex vs gpt-5.4) and the after-fix “Tests 6 passed” (or equivalent) output.

Human Verification (required)

  • Verified scenarios: Ran vitest run src/commands/models/auth.test.ts (or full pnpm test for models auth); the two updated tests pass; no other tests in that file were changed or broken.
  • Edge cases checked: None beyond “tests match current default.”
  • What you did not verify: No manual CLI login or gateway run; mocks only.

Review Conversations

  • I replied to or resolved every bot review conversation I addressed in this PR.
  • I left unresolved only the conversations that still need reviewer or maintainer judgment.

Compatibility / Migration

  • Backward compatible? Yes
  • Config/env changes? No
  • Migration needed? No
  • If yes, exact upgrade steps: N/A

Failure Recovery (if this breaks)

  • How to disable/revert: Revert the single-file test-assertion change in src/commands/models/auth.test.ts.
  • Files/config to restore: src/commands/models/auth.test.ts only.
  • Known bad symptoms reviewers should watch for: None; change is test-only.

Risks and Mitigations

None. Test expectations were updated to match existing production default; no behavior or defaults were changed.

@openclaw-barnacle openclaw-barnacle bot added commands Command implementations size: XS labels Mar 12, 2026
@greptile-apps
Copy link
Contributor

greptile-apps bot commented Mar 12, 2026

Greptile Summary

This PR is a test-only chore that synchronizes two failing test assertions in src/commands/models/auth.test.ts with the current production default model value (openai-codex/gpt-5.4), which is already defined in src/commands/openai-codex-model-default.ts. No production code, default values, or user-facing behavior was changed.

Changes:

  • Updated 3 string literals across 2 tests from openai-codex/gpt-5.3-codexopenai-codex/gpt-5.4 to match OPENAI_CODEX_DEFAULT_MODEL in production code.
  • The fix is narrowly scoped: only the two Codex login tests were touched, and no other test or source file was modified.

Confidence Score: 5/5

  • This PR is safe to merge — it is a test-only change that corrects stale string literals to match the already-live production default.
  • The change is minimal (3 string replacements in one test file), entirely non-production, and the new values are exactly what OPENAI_CODEX_DEFAULT_MODEL exports in openai-codex-model-default.ts. There is no risk of regression.
  • No files require special attention.

Last reviewed commit: 5adb355

@dvrshil dvrshil self-assigned this Mar 13, 2026
Copy link
Member

@dvrshil dvrshil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified locally.

corepack pnpm vitest run src/commands/models/auth.test.ts currently fails in exactly the two stale assertions this PR updates:

  • Default model available: openai-codex/gpt-5.3-codex ...
  • Default model set to openai-codex/gpt-5.3-codex

Current production default is already openai-codex/gpt-5.4 in src/commands/openai-codex-model-default.ts, so this keeps the test file aligned with shipped behavior without changing runtime code.

@dvrshil dvrshil force-pushed the fix/openai-codex-auth-test branch 2 times, most recently from c41b8fc to bda9e28 Compare March 13, 2026 07:09
jrrcdev and others added 2 commits March 13, 2026 00:13
- Updated default model from openai-codex/gpt-5.3-codex to openai-codex/gpt-5.4 in tests.
@dvrshil dvrshil force-pushed the fix/openai-codex-auth-test branch from bda9e28 to c372ba6 Compare March 13, 2026 07:13
@dvrshil dvrshil merged commit 5b06619 into openclaw:main Mar 13, 2026
12 checks passed
@dvrshil
Copy link
Member

dvrshil commented Mar 13, 2026

Merged via squash.

Thanks @jrrcdev!

frankekn pushed a commit that referenced this pull request Mar 13, 2026
…/gpt-5.4 in tests. (#44367)

Merged via squash.

Prepared head SHA: c372ba6
Co-authored-by: jrrcdev <[email protected]>
Co-authored-by: dvrshil <[email protected]>
Reviewed-by: @dvrshil
frankekn pushed a commit to jmcte/openclaw that referenced this pull request Mar 13, 2026
…/gpt-5.4 in tests. (openclaw#44367)

Merged via squash.

Prepared head SHA: c372ba6
Co-authored-by: jrrcdev <[email protected]>
Co-authored-by: dvrshil <[email protected]>
Reviewed-by: @dvrshil
Jerry-Xin pushed a commit to Jerry-Xin/openclaw that referenced this pull request Mar 13, 2026
…/gpt-5.4 in tests. (openclaw#44367)

Merged via squash.

Prepared head SHA: c372ba6
Co-authored-by: jrrcdev <[email protected]>
Co-authored-by: dvrshil <[email protected]>
Reviewed-by: @dvrshil
ecochran76 pushed a commit to ecochran76/openclaw that referenced this pull request Mar 14, 2026
…/gpt-5.4 in tests. (openclaw#44367)

Merged via squash.

Prepared head SHA: c372ba6
Co-authored-by: jrrcdev <[email protected]>
Co-authored-by: dvrshil <[email protected]>
Reviewed-by: @dvrshil
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

commands Command implementations size: XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants