Workspace lab notebook for long-running or resumable research work.
Use this file to track chronology, not release notes. Keep entries short, factual, and operational.
- Objective: ...
- Changed: ...
- Verified: ...
- Failed / learned: ...
- Blockers: ...
- Next: ...
- Objective: Set up a deep research workflow for scaling laws.
- Changed: Created plan artifact at
outputs/.plans/scaling-laws.md; defined 4 disjoint researcher dimensions and acceptance criteria. - Verified: Read
CHANGELOG.mdand checked prior memory for related planscaling-laws-implications. - Failed / learned: No prior run-specific changelog entries existed beyond the template.
- Blockers: Waiting for user confirmation before launching researcher round 1.
- Next: On confirmation, spawn 4 parallel researcher subagents and begin evidence collection.
- Objective: Complete T4 on inference/test-time scaling and reasoning-time compute, scoped to 2023–2026.
- Changed: Wrote
notes/scaling-laws-research-inference.md; updatedoutputs/.plans/scaling-laws.mdto mark T4 done and log the inference-scaling verification pass. - Verified: Cross-read 13 primary/official sources covering Tree-of-Thoughts, PRMs, repeated sampling, compute-optimal test-time scaling, provable laws, o1, DeepSeek-R1, s1, verifier failures, Anthropic extended thinking, and OpenAI reasoning API docs.
- Failed / learned: OpenAI blog fetch for
learning-to-reason-with-llmsreturned malformed content, so the note leans on the o1 system card and API docs instead of that blog post. - Blockers: T2 and T5 remain open before final synthesis; no single unified law for inference-time scaling emerged from public sources.
- Next: Complete T5 implications synthesis, then reconcile T3/T4 with foundational T2 before drafting the cited brief.
- Objective: Synthesize the four research notes into a single user-facing draft brief for the scaling-laws workflow.
- Changed: Wrote
outputs/.drafts/scaling-laws-draft.mdwith an executive summary, curated reading list, qualitative meta-analysis, core-paper comparison table, explicit training-vs-inference distinction, and numbered inline citations with direct-URL sources. - Verified: Cross-checked the draft against
notes/scaling-laws-research-foundations.md,notes/scaling-laws-research-revisions.md,notes/scaling-laws-research-inference.md, andnotes/scaling-laws-research-implications.mdto ensure the brief explicitly states the literature is too heterogeneous for a pooled effect-size estimate. - Failed / learned: The requested temp-run
context.mdandplan.mdwere absent, so the synthesis usedoutputs/.plans/scaling-laws.mdplus the four note files as the working context. - Blockers: Citation/claim verification pass still pending; this draft should be treated as pre-verification.
- Next: Run verifier/reviewer passes, then promote the draft into the final cited brief and provenance sidecar.
- Objective: Deliver a paper guide and qualitative meta-analysis on AI scaling laws.
- Changed: Finalized
outputs/scaling-laws.mdand sidecaroutputs/scaling-laws.provenance.md; rendered preview PDF atoutputs/scaling-laws.pdf; updated plan ledger and verification log inoutputs/.plans/scaling-laws.md. - Verified: Ran a reviewer pass recorded in
notes/scaling-laws-verification.md; spot-checked key primary papers via alpha-backed reads for Kaplan 2020, Chinchilla 2022, and Snell 2024; confirmed PDF render output exists. - Failed / learned: A pooled statistical meta-analysis would be misleading because the literature mixes heterogeneous outcomes, scaling axes, and evaluation regimes; final deliverable uses a qualitative meta-analysis instead.
- Blockers: None for this brief.
- Next: If needed, extend into a narrower sub-survey (e.g. only pretraining laws, only inference-time scaling, or only post-Chinchilla data-quality revisions).
- Objective: Let users download the Feynman research skills without installing the full terminal runtime.
- Changed: Added standalone skills-only installers at
scripts/install/install-skills.shandscripts/install/install-skills.ps1; synced website-public copies; documented user-level and repo-local install flows inREADME.md,website/src/content/docs/getting-started/installation.md, andwebsite/src/pages/index.astro. - Verified: Ran
sh -n scripts/install/install-skills.sh; rannode scripts/sync-website-installers.mjs; rancd website && npm run build; executedsh scripts/install/install-skills.sh --dir <tmp>and confirmed extractedSKILL.mdfiles land in the target directory. - Failed / learned: PowerShell installer behavior was not executed locally because PowerShell is not installed in this environment.
- Blockers: None for the Unix installer flow; Windows remains syntax-only by inspection.
- Next: If users want this exposed more prominently, add a dedicated docs/reference page and a homepage-specific skills-only CTA instead of a text link.
- Objective: Remove the moving
edgeinstaller channel and unify installs on tagged releases only. - Changed: Updated
scripts/install/install.sh,scripts/install/install.ps1,scripts/install/install-skills.sh, andscripts/install/install-skills.ps1so the default target is the latest tagged release, latest-version resolution uses public GitHub release pages instead ofapi.github.com, and explicitedgerequests now fail with a removal message; removed therelease-edgejob from.github/workflows/publish.yml; updatedREADME.mdandwebsite/src/content/docs/getting-started/installation.md; re-syncedwebsite/public/install*. - Verified: Ran
sh -non the Unix installer copies; confirmedsh scripts/install/install.sh edgeandsh scripts/install/install-skills.sh edge --dir <tmp>fail with the intended removal message; executedsh scripts/install/install.shinto temp dirs and confirmed the installed binary reports0.2.14; executedsh scripts/install/install-skills.sh --dir <tmp>and confirmed extractedSKILL.mdfiles; rancd website && npm run build. - Failed / learned: The install failure was caused by unauthenticated GitHub API rate limiting on the
edgepath, so renaming channels without removing the API dependency would not have fixed the root cause. - Blockers:
npm run buildstill emits a pre-existing duplicate-content warning forgetting-started/installation; the build succeeds. - Next: If desired, remove the now-unused
stablealias too and clean up the duplicate docs-content warning separately.
- Objective: Make the non-Anthropic subagent/auth fixes and contributor-guide updates releasable to tagged-install users instead of leaving them only on
main. - Changed: Bumped the package version from
0.2.14to0.2.15inpackage.jsonandpackage-lock.json; updated pinned installer examples inREADME.mdandwebsite/src/content/docs/getting-started/installation.md; aligned the local-development docs example to the npm-based root workflow; addedCONTRIBUTING.mdplus the bundledskills/contributing/SKILL.md. - Verified: Confirmed the publish workflow keys off
package.jsonversus the currently published npm version; confirmed localnpm test,npm run typecheck, andnpm run buildpass before the release bump. - Failed / learned: The open subagent issue is fixed on
mainbut still user-visible on tagged installs until a fresh release is cut. - Blockers: Need the GitHub publish workflow to finish successfully before the issue can be honestly closed as released.
- Next: Push
0.2.15, monitor the publish workflow, then update and close the relevant GitHub issue/PR once the release is live.
- Objective: Debug why tagged installs can still fail subagent/auth flows after
0.2.15when users are not on Anthropic. - Changed: Added
scripts/lib/pi-subagents-patch.mjsplus type declarations and wiredscripts/patch-embedded-pi.mjsto rewrite vendoredpi-subagentsruntime files so they resolve user-scoped paths fromPI_CODING_AGENT_DIRinstead of hardcoded~/.pi/agent; addedtests/pi-subagents-patch.test.ts. - Verified: Materialized
.feynman/npm, inspected the shipped[email protected]sources, confirmed the hardcoded~/.pi/agentpaths inindex.ts,agents.ts,artifacts.ts,run-history.ts,skills.ts, andchain-clarify.ts; rannode scripts/patch-embedded-pi.mjs; rannpm test,npm run typecheck, andnpm run build. - Failed / learned: The earlier
0.2.15fix only proved that Feynman exportedPI_CODING_AGENT_DIRto the top-level Pi child; it did not cover vendored extension code that still hardcoded.pipaths internally. - Blockers: Users still need a release containing this patch before tagged installs benefit from it.
- Next: Cut the next release and verify a tagged install exercises subagents without reading from
~/.pi/agent.
- Objective: Ship the vendored
pi-subagentsagent-dir compatibility fix to tagged installs. - Changed: Bumped the package version from
0.2.15to0.2.16inpackage.jsonandpackage-lock.json; updated pinned installer examples inREADME.mdandwebsite/src/content/docs/getting-started/installation.md. - Verified: Re-ran
npm test,npm run typecheck, andnpm run build; rancd website && npm run build; rannpm packand confirmed the0.2.16tarball includes the newscripts/lib/pi-subagents-patch.*files. - Failed / learned: An initial local
build:native-bundlecheck failed becausenpm packandbuild:native-bundlewere run in parallel, andprepackintentionally removesdist/release; rerunningnpm run build:native-bundlesequentially succeeded. - Blockers: None in the repo; publishing still depends on the GitHub workflow running on the bumped version.
- Next: Push the
0.2.16release bump and monitor npm/GitHub release publication.
- Objective: Triage open Pi-related issues/PRs, fix the concrete package update regression, and refresh Pi dependencies against current upstream releases.
- Changed: Pinned direct package-manager operations (
feynman update,feynman packages install) to Feynman's npm prefix by exportingFEYNMAN_NPM_PREFIX,NPM_CONFIG_PREFIX, andnpm_config_prefixbefore invoking Pi'sDefaultPackageManager; bumped@mariozechner/pi-aiand@mariozechner/pi-coding-agentfrom0.62.0to0.64.0; adaptedsrc/model/registry.tsto the newModelRegistry.create(...)factory; integrated PR #15's/feynman-modelcommand on top of currentmain. - Verified: Ran
npm test,npm run typecheck, andnpm run buildsuccessfully after the dependency bump and PR integration; confirmed upstream[email protected]still usesnpm install -gfor user-scope package updates, so the Feynman-side prefix fix is still required. - Failed / learned: PR #14 is a stale branch with no clean merge path against current
main; the only user-facing delta is the ValiChord prompt/skill addition, and the branch also carries unrelated release churn plus demo-style material, so it was not merged in this pass. - Blockers: None in the local repo state; remote merge/push still depends on repository credentials and branch policy.
- Next: If remote write access is available, commit and push the validated maintenance changes, then close issue #22 and resolve PR #15 as merged while leaving PR #14 unmerged pending a cleaned-up, non-promotional resubmission.
- Objective: Finish the remaining high-confidence open tracker items after the Pi 0.64.0 upgrade instead of leaving the issue list half-reconciled.
- Changed: Added a Windows extension-loader patch helper so Feynman rewrites Pi extension imports to
file://URLs on Windows before interactive startup; added/commands,/tools, and/capabilitiesdiscovery commands and surfaced/hotkeysplus/service-tierin help metadata; added explicit service-tier support viafeynman model tier,--service-tier, status/doctor output, and a provider-payload hook that passesservice_tieronly to supported OpenAI/OpenAI Codex/Anthropic models; added Exa provider recognition to Feynman's web-search status layer and vendoredpi-web-access. - Verified: Ran
npm test,npm run typecheck, andnpm run build; smoke-imported the modified vendoredpi-web-accessmodules withnode --import tsx. - Failed / learned: The remaining ValiChord PR is still stale and mixes a real prompt/skill update with unrelated branch churn; it is a review/triage item, not a clean merge candidate.
- Blockers: No local build blockers remain; issue/PR closure still depends on the final push landing on
main. - Next: Push the verified cleanup commit, then close issues fixed by the dependency bump plus the new discoverability/service-tier/Windows patches, and close the stale ValiChord PR explicitly instead of leaving it open indefinitely.
- Objective: Fix Windows startup failures where
feynmanexits before the Pi child process initializes. - Changed: Converted the Node preload module paths passed via
node --importinsrc/pi/launch.tstofile://specifiers using a newtoNodeImportSpecifier(...)helper insrc/pi/runtime.ts; expandedscripts/patch-embedded-pi.mjsso it also patches the bundled workspace copy of Pi's extension loader when present. - Verified: Added a regression test in
tests/pi-runtime.test.tscovering absolute-path tofile://conversion for preload imports; rannpm test,npm run typecheck, andnpm run build. - Failed / learned: The raw Windows
ERR_UNSUPPORTED_ESM_URL_SCHEMEstack is more consistent with Node rejecting the child-process--import C:\\...preload before Pi starts than with a normal in-app extension load failure. - Blockers: Windows runtime execution was not available locally, so the fix is verified by code path inspection and automated tests rather than an actual Windows shell run.
- Next: Ask the affected user to reinstall or update to the next published package once released, and confirm the Windows REPL now starts from a normal PowerShell session.
- Objective: Triage the open repo backlog, land the highest-signal fixes locally, and add guardrails against stale promotional workflow content.
- Changed: Hardened Windows launch paths in
bin/feynman.js,scripts/build-native-bundle.mjs, andscripts/install/install.ps1; set npm prefix overrides earlier inscripts/patch-embedded-pi.mjs; added api-web-accessruntime patch helper plusFEYNMAN_WEB_SEARCH_CONFIGenv wiring so bundled web search reads the same~/.feynman/web-search.jsonthat doctor/status report; taughtsrc/pi/web-access.tsto honor the legacyroutekey; fixed bundled skill references and expanded the skills-only installers/docs to ship the prompt and guidance files those skills reference; added regression tests for config paths, catalog snapshot edges, skill-path packaging,pi-web-accesspatching, and blocked promotional content. - Verified: Ran
npm test,npm run typecheck, andnpm run buildsuccessfully after the full maintenance pass. - Failed / learned: The skills-only install issue was not just docs drift; the shipped
SKILL.mdfiles referenced prompt paths that only made sense after installation, so the repo needed both path normalization and packaging changes. - Blockers: Remote issue/PR closure and merge actions still depend on the final reviewed branch state being pushed.
- Next: Push the validated fixes, close the duplicate Windows/reporting issues they supersede, reject the promotional ValiChord PR explicitly, and then review whether the remaining docs-only or feature PRs should be merged separately.
- Objective: Run a deeper install/security verification pass against the post-cleanup
0.2.17tree instead of assuming the earlier targeted fixes covered the shipped artifacts. - Changed: Reworked
extensions/research-tools/header.tsto use@mariozechner/pi-tuiwidth-aware helpers for truncation/wrapping so wide Unicode text does not overflow custom header rows; changedsrc/pi/launch.tsto stop mirroring child crash signals back onto the parent process and instead emit a conventional exit code; addedFEYNMAN_INSTALL_SKILLS_ARCHIVE_URLoverrides to the skills installers for pre-release smoke testing; aligned root and website dependency trees with patched transitive versions using npmoverrides; fixedsrc/pi/web-access.tssosearch statusrespectsFEYNMAN_HOMEsemantics instead of hardcoding the current shell home directory; addedtests/pi-launch.test.ts. - Verified: Ran
npm test,npm run typecheck,npm run build,cd website && npm run build,npm run build:native-bundle; smoke-testedscripts/install/install.shagainst a locally serveddist/release/feynman-0.2.17-darwin-arm64.tar.gz; smoke-testedscripts/install/install-skills.shagainst a local source archive; confirmed installedfeynman --version,feynman --help,feynman doctor, and packagedfeynman search statuswork from the installed bundle;npm audit --omit=devis clean in the root app and website after overrides. - Failed / learned: The first packaged
search statussmoke test still showed the user home path because the native bundle had been built before theFEYNMAN_HOMEpath fix; rebuilding the native bundle resolved that mismatch. - Blockers: PowerShell runtime was unavailable locally, so Windows installer execution remained code-path validated rather than actually executed.
- Next: Push the second-pass hardening commit, then keep issue
#46and issue#47open until users on the affected Linux/CJK environments confirm whether the launcher/header fixes fully resolve them.
- Objective: Reduce the remaining open tracker items by landing the lowest-risk missing docs/catalog updates and a targeted Cloud Code Assist compatibility patch instead of only hand-triaging them.
- Changed: Added MiniMax M2.7 recommendation preferences in
src/model/catalog.ts; documented model switching, authenticated-provider visibility, and/feynman-modelsubagent overrides inwebsite/src/content/docs/getting-started/configuration.mdandwebsite/src/content/docs/reference/slash-commands.md; added a runtime patch helper inscripts/lib/pi-google-legacy-schema-patch.mjsand wiredscripts/patch-embedded-pi.mjsto normalize JSON Schemaconstintoenumfor the legacyparametersfield used by Cloud Code Assist Claude models. - Verified: Ran
npm test,npm run typecheck,npm run build, andcd website && npm run buildafter the patch/helper/docs changes. - Failed / learned: The MiniMax provider catalog in Pi already uses canonical IDs like
MiniMax-M2.7, so the only failure during validation was a test assertion using the wrong casing rather than a runtime bug. - Blockers: The Cloud Code Assist fix is validated by targeted patch tests and code-path review rather than an end-to-end Google account repro in this environment.
- Next: Push the tracker-triage commit, close the docs/MiniMax PRs as superseded by main, close the support-style model issues against the new docs, and decide whether the remaining feature requests should be left open or closed as not planned/upstream-dependent.