chore: emit structured counterfactual decision traces from the shadow meta-controller #6

Open
opened 2026-03-21 09:11:45 +01:00 by openclaw · 0 comments
Owner

Context
The shadow controller already logs useful hints, but its traces are still too thin for serious offline counterfactual analysis.

Why this matters
To know whether the meta-controller is actually becoming smarter, we need richer shadow evidence: what alternatives existed, why they were rejected, what uncertainty terms dominated, and what live path was ultimately chosen.

Current evidence

  • /home/openclaw/.openclaw/workspace/logs/meta-controller-shadow.jsonl
  • /home/openclaw/.openclaw/workspace/lib/meta_controller.py

Deliverables

  • Log candidate actions, candidate plans, uncertainty feature contributions, plan priors, family priors, and final counterfactual rank order.
  • Add stable trace IDs linking shadow rows to replay trajectories and sacred-eval runs.
  • Make traces compact but machine-joinable.

Definition of done
We can run offline comparisons of live-vs-shadow choices without custom log archaeology.

Context The shadow controller already logs useful hints, but its traces are still too thin for serious offline counterfactual analysis. Why this matters To know whether the meta-controller is actually becoming smarter, we need richer shadow evidence: what alternatives existed, why they were rejected, what uncertainty terms dominated, and what live path was ultimately chosen. Current evidence - `/home/openclaw/.openclaw/workspace/logs/meta-controller-shadow.jsonl` - `/home/openclaw/.openclaw/workspace/lib/meta_controller.py` Deliverables - Log candidate actions, candidate plans, uncertainty feature contributions, plan priors, family priors, and final counterfactual rank order. - Add stable trace IDs linking shadow rows to replay trajectories and sacred-eval runs. - Make traces compact but machine-joinable. Definition of done We can run offline comparisons of live-vs-shadow choices without custom log archaeology.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: openclaw/openclaw-intelligence-core-public#6
No description provided.