Historical Replay · VibeCorp Engineering

100 PRs replayed. 100% agreement with reviewer outcome.

Replay engineering history to discover which changes could have been safely agent-approved, which required escalation, and which trust policies were missing. Includes wins and misses — every miss converts to a permanent eval.Demo

Agreement w/ reviewer

100%

Match + caught-what-human-missed

Recall on reverts

100%

Of historically-reverted PRs

False positive

Tunable per workflow

Auto-approval candidates

40%

Cleared every required proof

Senior hrs/month

116h

Reclaimable at current scope

Per-PR decision trace

Click any row to open its Trust Certificate. Top exception in this replay: missing backward compatibility proof.

PR	Workflow	Risk	Reviewer outcome	VibeOps	Agreement	Model stack	Evidence
#5103	README: connectors quickstart Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5109	Bump node engines to 22 Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5115	Add CODEOWNERS for analytics Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5122	Update LICENSE year Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5130	Tag-based release notes config Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5138	README: connectors quickstart Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5147	Bump node engines to 22 Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5157	Add CODEOWNERS for analytics Docs/config · vibecorp/platform	Low	Blocked	Escalate	Match	Claude + owner route	0/2
#5167	Update LICENSE year Docs/config · vibecorp/platform	Low	Merged after changes	Escalate	Caught extra	Claude + owner route	0/2
#5168	Tag-based release notes config Docs/config · vibecorp/platform	Low	Merged after changes	Escalate	Caught extra	Claude + owner route	0/2
#5170	README: connectors quickstart Docs/config · vibecorp/platform	Low	Merged after changes	Escalate	Caught extra	Claude + owner route	0/2
#5173	Bump node engines to 22 Docs/config · vibecorp/platform	Low	Merged after changes	Escalate	Caught extra	Claude + owner route	0/2
#5176	Add CODEOWNERS for analytics Docs/config · vibecorp/platform	Low	Merged after changes	Escalate	Caught extra	Claude + owner route	0/2
#5180	Update LICENSE year Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5185	Tag-based release notes config Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5190	README: connectors quickstart Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5196	Bump node engines to 22 Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5203	Add CODEOWNERS for analytics Docs/config · vibecorp/platform	Low	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	2/2
#5210	Add retry handling to Stripe-like connector Integrations · vibecorp/connectors	Medium	Blocked	Escalate	Match	Claude + owner route	2/4
#5220	Switch Hubspot client to streaming pagination Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5221	Connector: backoff on 429 from upstream Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5222	Add timeout to Salesforce sync Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5224	Idempotency keys for Zuora invoice push Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5227	Webhook: dedupe replays within 5min window Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5230	Slack notifier: switch to bulk endpoint Integrations · vibecorp/connectors	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	4/4
#5234	Twilio adapter: handle partial failure Integrations · vibecorp/connectors	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	4/4
#5239	Add retry handling to Stripe-like connector Integrations · vibecorp/connectors	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	4/4
#5244	Switch Hubspot client to streaming pagination Integrations · vibecorp/connectors	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	3/4
#5250	Connector: backoff on 429 from upstream Integrations · vibecorp/connectors	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	3/4
#5257	Add timeout to Salesforce sync Integrations · vibecorp/connectors	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	3/4
#5265	Idempotency keys for Zuora invoice push Integrations · vibecorp/connectors	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	3/4
#5273	Webhook: dedupe replays within 5min window Integrations · vibecorp/connectors	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	3/4
#5282	Slack notifier: switch to bulk endpoint Integrations · vibecorp/connectors	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	3/4
#5292	Twilio adapter: handle partial failure Integrations · vibecorp/connectors	Medium	Blocked	Escalate	Match	Claude + owner route	2/4
#5302	Add retry handling to Stripe-like connector Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5303	Switch Hubspot client to streaming pagination Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5305	Connector: backoff on 429 from upstream Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5307	Add timeout to Salesforce sync Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5310	Idempotency keys for Zuora invoice push Integrations · vibecorp/connectors	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5314	Webhook: dedupe replays within 5min window Integrations · vibecorp/connectors	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	4/4
#5319	Checkout: collapse coupon section on mobile Frontend · vibecorp/edge	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5323	Settings: extract permissions tab into route Frontend · vibecorp/edge	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	3/3
#5327	Cart: skeleton state on slow networks Frontend · vibecorp/edge	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	3/3
#5332	Header: a11y aria-label on profile menu Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5338	Reset password form: error layout fix Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5344	Empty state for analytics overview Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5351	Modal close button enlarged Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5359	Hover state on connector cards Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5367	Checkout: collapse coupon section on mobile Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5376	Settings: extract permissions tab into route Frontend · vibecorp/edge	Medium	Blocked	Escalate	Match	Claude + owner route	1/3
#5386	Cart: skeleton state on slow networks Frontend · vibecorp/edge	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5387	Header: a11y aria-label on profile menu Frontend · vibecorp/edge	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5388	Reset password form: error layout fix Frontend · vibecorp/edge	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5390	Empty state for analytics overview Frontend · vibecorp/edge	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5393	Modal close button enlarged Frontend · vibecorp/edge	Medium	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5396	Hover state on connector cards Frontend · vibecorp/edge	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	3/3
#5400	Checkout: collapse coupon section on mobile Frontend · vibecorp/edge	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	3/3
#5405	Settings: extract permissions tab into route Frontend · vibecorp/edge	Medium	Merged clean	Auto-approve	Match	Kimi/SLM + Trust Pack	3/3
#5410	Cart: skeleton state on slow networks Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5416	Header: a11y aria-label on profile menu Frontend · vibecorp/edge	Medium	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5423	Tenant model: drop deprecated column tier_legacy Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5431	Add /v2/connectors/:id/test endpoint Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5439	Rate limiter: per-tenant bucket Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5448	Search service: include archived flag Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5458	Org service: return owner sub-resource Backend API · vibecorp/checkout	High	Blocked	Escalate	Match	Claude + owner route	1/3
#5468	Tasks API: support cursor pagination Backend API · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5469	Tenant model: drop deprecated column tier_legacy Backend API · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5471	Add /v2/connectors/:id/test endpoint Backend API · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5473	Rate limiter: per-tenant bucket Backend API · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5476	Search service: include archived flag Backend API · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5480	Org service: return owner sub-resource Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5485	Tasks API: support cursor pagination Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5490	Tenant model: drop deprecated column tier_legacy Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5496	Add /v2/connectors/:id/test endpoint Backend API · vibecorp/checkout	High	Merged clean	Escalate	Match	Claude + owner route	1/3
#5503	Rollout new checkout — 5% canary Feature flags · vibecorp/checkout	High	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5512	Kill-switch for AI summarizer Feature flags · vibecorp/checkout	High	Merged clean	Canary only	Match	Claude + Trust Pack	2/3
#5521	Org-targeting on connector marketplace Feature flags · vibecorp/checkout	High	Blocked	Escalate	Match	Claude + owner route	1/3
#5531	Sticky bucketing for billing redesign Feature flags · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5532	Rollout new checkout — 5% canary Feature flags · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5533	Kill-switch for AI summarizer Feature flags · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5535	Org-targeting on connector marketplace Feature flags · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5538	Sticky bucketing for billing redesign Feature flags · vibecorp/checkout	High	Merged after changes	Escalate	Caught extra	Claude + owner route	1/3
#5542	Rename invoices.amount_cents → amount_minor Migrations · vibecorp/analytics	Critical	Blocked	Escalate	Match	Claude + owner route	2/4
#5552	Add index on events(org_id, created_at) Migrations · vibecorp/analytics	Critical	Reverted later	Block	Match	Claude + staff route	0/4
#5553	Backfill ownership on legacy tenants Migrations · vibecorp/analytics	Critical	Merged after changes	Block	Match	Claude + staff route	0/4
#5555	Drop unused subscription_meta table Migrations · vibecorp/analytics	Critical	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5557	Rename invoices.amount_cents → amount_minor Migrations · vibecorp/analytics	Critical	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5560	Add index on events(org_id, created_at) Migrations · vibecorp/analytics	Critical	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5564	Allow scoped tokens on read-only resources Auth/RBAC · vibecorp/identity	Critical	Merged clean	Escalate	Match	Claude + owner route	1/3
#5569	Strengthen MFA on admin write actions Auth/RBAC · vibecorp/identity	Critical	Merged clean	Escalate	Match	Claude + owner route	1/3
#5574	Audit-log additions for permission grants Auth/RBAC · vibecorp/identity	Critical	Merged clean	Escalate	Match	Claude + owner route	1/3
#5580	Allow scoped tokens on read-only resources Auth/RBAC · vibecorp/identity	Critical	Merged clean	Escalate	Match	Claude + owner route	1/3
#5587	Strengthen MFA on admin write actions Auth/RBAC · vibecorp/identity	Critical	Merged clean	Escalate	Match	Claude + owner route	1/3
#5594	Temporal worker: bump concurrency to 64 Core infra · vibecorp/platform	Critical	Merged clean	Escalate	Match	Claude + owner route	2/4
#5603	Switch ingress to new region Core infra · vibecorp/platform	Critical	Blocked	Escalate	Match	Claude + owner route	2/4
#5613	Replace pgbouncer with native pooling Core infra · vibecorp/platform	Critical	Reverted later	Block	Match	Claude + staff route	0/4
#5614	Retry storm guard on outbox dispatcher Core infra · vibecorp/platform	Critical	Merged after changes	Block	Match	Claude + staff route	0/4
#5615	Temporal worker: bump concurrency to 64 Core infra · vibecorp/platform	Critical	Merged after changes	Block	Match	Claude + staff route	0/4
#5617	Switch ingress to new region Core infra · vibecorp/platform	Critical	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4
#5620	Replace pgbouncer with native pooling Core infra · vibecorp/platform	Critical	Merged after changes	Escalate	Caught extra	Claude + owner route	2/4

Showing 100 of 100 replayed PRs. Decision logic deterministic from PR features.Open sample Trust Certificate →

Transparency · the misses become evals

On three of these PRs, VibeOps v1 gave the wrong call. We surface them on purpose. Each became a new eval case and a new Trust Pack rule — the next replay caught all three. The flywheel: every miss → eval → Trust Pack improvement → better next-customer onboarding. Generalized failure patterns improve every deployment; your private policies stay private.