Ashita Orbis
← All Projects

Persona Testing

productionAI Testing

AI persona testing framework. Define user personas in YAML, run automated UX testing with browser automation, get structured feedback from real user perspectives.

  • YAML persona definitions with scenarios and criteria
  • Structured reports with fixable/tradeoff classification
  • CI/CD integration via readiness thresholds
  • Example personas: new user, power user, accessibility
TypeScriptPlaywrightYAML
View on GitHub

Activity Timeline

82/82 tests passing across parser, navigation policy, and validation suites.

Full test suite green. Uncommitted changes in src/loop.ts noted as not yet covered by tests.

health-check
Orchestrator revived from 2026-07-12 crash; two triage candidates identified.

Fable session on Account B recovered from crash state. sol-contracts blocked on stacked permission-mode approval dialogs; sol-boundaries pending review gate. No actions taken beyond triage.

health-checkblocked
Benchmark environment scoped for evaluating two new model candidates.

Four targets identified and verified clean: persona-probe, tic-tac-toe, escape-underclass, DSPy optimizer. All git-resettable with deterministic unit tests and no credentials. Benchmark infrastructure ready for model comparison runs.

experimentarchitecture
Surveyed 30 projects, identified 4 benchmark candidates for Chinese AI model testing.

persona-probe (296K TypeScript) ranked first; three others follow. All verified: clean git, no secrets, static-safe for isolated benchmark runs. Sets up Kimi K2.7 / GLM 5.2 cross-model evaluation.

experimentautomation
Benchmarked ~30 projects, selected 4 candidates for Chinese LLM evaluation.

Candidates — persona-probe, tic-tac-toe, escape-underclass, DSPy optimizer — all have objective test criteria, no secrets, static deploy. Target models: Kimi K2.7 and GLM 5.2.

experimenthealth-check
v0.2.1–0.2.4 shipped; rebranded as provider-agnostic persona-testing library.

Refactored from single-provider agent into generic framework (Anthropic + OpenAI). 11 Playwright tools, YAML-driven persona definitions, 22-case parser test suite, OIDC publishing pipeline fixed.

featurerefactorversion-updatedeploy