Ashita Orbis//projects7 protocols
interactive
← All Projects

DSPy Prompt Optimizer

productionAI Tooling

Automated prompt engineering using Stanford's DSPy framework. Optimizes Claude Code skill prompts through bootstrap, copro, and iterative algorithms with cross-validation.

  • 11 of 13 optimization targets deployed
  • Bootstrap, CoPro, and iterative algorithms
  • Cross-validation with dropout regularization
  • Background optimization with progress tracking
PythonDSPyClaude Code
View on GitHub

Activity Timeline

Publish-identity v2 patch staged with an install sheet, awaiting review and install.

The v2 patch carries sha256 prefix 3006c12e2f665cdf. A gate-enact leg was dispatched to apply the v2 pre-push identity patch and run eight publish-path suites.

security
Leg codex-burn-4x-1007 commissioned to take over from 1006 after the tmux server died.

No outcomes from the successor leg were visible.

automation
Security triage of 476 GitHub credential matches: 51 confirmed dead, 0 confirmed live, 425 unknown.

The 51 dead matches were Azure B2C tokens 527 days past expiry. The triage ran across two sessions.

security
Mission halted; 12 adjudications vetoed after scope misread.

Orchestrator confused reminder queue entries with open decision cards. Owner issued halt at 21:53Z; 12 adjudications from 21:30Z vetoed and preserved as restoration verification evidence.

blocked
Silence guard #129 non-functional: pure-silence input hallucinates fluent dictation with ok:true.

Critical regression discovered during audit. Separate reconciliation found 26 issues had gone untracked despite a prior 90% coverage estimate. Audio container duration mismatches resolved in 2 of 40 clips.

bugfixsecurity
Silence-hallucination guard fixed; 38 audit issues converted to registry rows.

Critical gap: 30s silence produced fluent hallucinated dictation with all 11 vocab hints and ok:true. Guard updated to reject the edge case. 38 audit issues processed into 22 registry rows and 8 owner cards.

bugfixhealth-check
Fixed fail-open baseline loader; registered Fable runner.

Minor maintenance commit: baseline loader fixed and Fable model runner registered.

bugfix
Training datasets expanded; reasoning_effort tuned; holdout gate and security hardening deployed.

Anchor-based paraphrase matching added for better review alignment. Publication-review pipeline now gates on holdout set. Security findings from external review resolved.

featuresecurityrefactor
Batch optimization run for 4 agents failed with exit code 144.

Multi-agent training loop unstable, likely due to memory constraints. 3 of 5 monitoring tasks completed; primary job did not finish. Root cause unresolved.

blockedhealth-check
Hostile-but-fair review framework codified; matching algorithm improved.

Five-criteria review framework with 3-tier severity triage established. Anchor entity extraction combined with char n-grams and keyword Jaccard distance added to matching algorithm. Publication-review pipeline added as optimization target.

featurerefactor
Hostile-but-fair document review framework designed and piloted on blog post.

Five-criteria framework built for pre-publication critique: steelman opposition, weak claims, consistency, scope, evidence gaps. Applied to the agentic coding post; full analysis output not captured.

experimentfeature
Phase 1.5 consistency optimization designed: 5 extraction fields, two-phase enum+COPRO approach.

Enum discovery from 24 existing extractions via Opus categorization, followed by COPRO optimization (9 calls/field). Checkpoint gates added before Phase C and Phase 2b to control compute spend.

architectureexperiment