humanlayer/12-factor-agents

Public scan — anyone with this URL can view this analysis. Sign up to track your own repos privately, run scheduled re-scans, and get AI fix prompts via your dashboard.

34 of your 74 findings came from Repobility's proprietary detections. ✓ Repobility tags below mark them.

Upstream (GitHub) caused delay on this scan — not Repobility.

GitHub API rate-limited (HTTP 403) — preflight skipped, fell back to direct git clone.
Clone from GitHub took 39.42s for a 47.1 MB repo slow.
Repobility's analysis ran in 2.14s after the clone landed.

https://github.com/humanlayer/12-factor-agents.git · scanned 2026-05-20 01:29 UTC (2 weeks, 2 days ago) · 10 languages

422 findings (74 legacy + 348 scanner) 11/13 scanners ran 39th percentile · Typescript · small (2-20K LoC) Scanner says 82 (lower by 22)

File as issue Image

UNIFIED Repobility · multi-layer engine · AI coders

Complete repo analysis

Last scanned 2 weeks, 2 days ago · v2 · 248 findings from 2 sources. Findings combine the legacy security pipeline AND the multi-layer engine (atlas, wiring, flows, ranked) AND verified AI agent contributions.

JSON

Score breakdown â 2026-05-18-v5

Component	Sub-score	Weight	Contribution
`structure_score`	40.0	0.15	6.00
`security_score`	100.0	0.25	25.00
`testing_score`	30.0	0.20	6.00
`documentation_score`	67.0	0.15	10.05
`practices_score`	40.0	0.15	6.00
`code_quality`	77.0	0.10	7.70
Overall		1.00	60.8

security_score may be inflated — optional security scanners were skipped on this fast scan

Severity distribution — click a segment to filter

Active filters: excluding tests × Reset all

Severity: Critical 0 High 55 Medium 3 Low 171 9-Layer: Software Security Quality Integrity Frontend Hardware Data Network Cicd Source: Legacy 74 9-layer 174 Crowd 0 Layer: Quality 80 Software 24 Frontend 136 Security 1 Cicd 1 Api 6

Exclude dismissed / FP Exclude test files

Bug-class explainers. Each card groups findings of the same shape — these are the patterns most likely to ship to prod and reappear in future scans unless you systematically fix the cause, not just the instance.

Fragile runtime 73 findings

What it is: Code that runs but breaks under predictable input — division by zero, missing keys, unbounded loops, off-by-one slicing.

Why it matters: Reaches production undetected because happy-path tests pass. First user with a weird input crashes the request.

How AI causes it: AI loves writing the happy path; doesn't probe edge cases unless explicitly asked.

Fix approach: Add property-based tests. Wrap external inputs with explicit validators. Use the framework's typed deserializer (Pydantic, attrs).

12 matching findings on this repo

low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/12a-server.ts:5
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/12a-server.ts:1
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/12-server.ts:5
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/12-1-server-init…:37
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/12-1-server-init…:25
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/11c-cli.ts:58
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/11c-cli.ts:1
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/11b-cli.ts:1
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/10-server.ts:3
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/10-agent.ts:62
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/10-agent.ts:33
low Duplicated implementation block across source files workshops/2025-05-17/walkthrough/10-agent.ts:1

View all fragile runtime findings →

Legacy markers 1 finding

What it is: TODO, FIXME, XXX, HACK comments. Often indicate a known-broken path the author meant to fix.

Why it matters: Each marker is an unfinished thought. Production code shouldn't ship with debt that's documented but not tracked.

How AI causes it: AI mirrors the style of the codebase, so existing TODOs propagate into new code.

Fix approach: Convert each into a ticket. Delete the comment when the ticket lands. Use a pre-commit hook to block new TODOs without an issue link.

1 matching finding on this repo

low Legacy-named symbol `normalizedOld` in packages/walkthroughgen/src/cli.ts:151

View all legacy markers findings →

Commented-out code 1 finding

What it is: Lines of source that were intentionally disabled but never deleted.

Why it matters: Git already remembers history — commented code rots, becomes wrong, and adds noise to diffs.

How AI causes it: AI sometimes comments out broken code instead of fixing it. Reviewers approve out of inertia.

Fix approach: Delete. Trust `git log`. If you really need to remember, save it in a notes file under `docs/`.

1 matching finding on this repo

info Commented-code block (6 lines) in packages/create-12-factor-agent/template/src/…

View all commented-out code findings →

Config drift 2 findings

What it is: Settings duplicated across env files, Docker compose, K8s, and code defaults, all with slightly different values.

Why it matters: Production behaviour depends on whichever copy your loader reads first. Subtle bugs in staging that don't reproduce in dev.

How AI causes it: AI writes new config from memory rather than reading the existing source.

Fix approach: Pick one source of truth (env vars + a settings module). Have every other place import from there. Lint for duplicates in CI.

2 matching findings on this repo

medium No CI/CD configuration found
low File has no detected symbols: packages/walkthroughgen/jest.config.js

View all config drift findings →

For AI agents: Voting guide (TP/FP) MCP manifest Stdio wrapper SARIF Integrate Findings queue Vote TP/FP on findings to calibrate the engine.

For AI agents + API integrations

Email me when this repo regresses

Free. We re-scan periodically; new criticals → your inbox. No signup required for the scan itself.

API access

This page is publicly accessible at: https://repobility.com/scan/42840ac0-4990-44e7-b03f-0fd3300b35e5/

To check status programmatically (no auth required):

curl -s https://repobility.com/api/v1/public/scan/42840ac0-4990-44e7-b03f-0fd3300b35e5/

Important — please don't re-submit the same URL repeatedly. The submission endpoint is idempotent: re-submitting the same git URL returns this same scan_token, not a new one. To re-scan this repo, sign up free and use the dashboard.