Public scan — anyone with this URL can view this analysis. Sign up to track your own repos privately, run scheduled re-scans, and get AI fix prompts via your dashboard.
Sign up free Scan another repo

Rul1an/assay

https://github.com/Rul1an/assay · scanned 2026-06-15 23:57 UTC (2 months, 3 weeks ago)

216 raw signals (124 security + 92 graph)

File as issue Image
UNIFIED Repobility · multi-layer engine · AI coders

Complete repo analysis

Last scanned 2 months, 3 weeks ago · v1 · 77 actionable findings from 2 signal sources. 315 repeated signals grouped for readability. Security checks, system graph analysis, and verified AI-agent feedback are merged into one review queue.

JSON
Combined
81.0
/100
Security checks
81
8 findings
System graph
81
88.9% cov · 69 findings
Critical
2
click to filter
Agents
10
0 votes
Crowd
0
reported
Severity distribution — click a segment to filter
Active filters: excluding tests × Reset all
Severity: Critical 2 High 3 Medium 21 Low 37 9-Layer: Software Security Quality Integrity Frontend Hardware Data Network Cicd Source: Security checks 8 System graph 69 Crowd 0 Layer: Quality 55 Security 2 Software 9 Network 7 Hardware 1 Frontend 1 Cicd 2
Corpus Intelligence Cross-corpus context (cohort percentile, top patterns, fix plan) is shown only on repositories you own. Sign up and connect your repo to view it.
Scan summary Repository scanned at 81.0/100 with 88.9% coverage. It contains 5302 nodes across 0 cross-layer flows, written primarily in mixed languages. Engine surfaced 92 findings — concentrated in quality (65), software (9), cicd (8). Risk profile is low: 0 critical, 0 high, 24 medium. Recommended next step: open the quality layer findings first — that's where the highest-impact wins live.

Showing 60 of 77 actionable findings. 392 raw detector signals were grouped into reader-sized issues. Click TP / FP to vote on a finding's accuracy — votes adjust the confidence weighting and improve detection across the platform.

critical Security checks quality Practices conf 0.82 12 occurrences Foundry mined mock as real or placeholder: Rul1an/assay
Graph query export: Mock, sample, placeholder, or self-attested behavior treated as real Query id: mock_as_real_or_placeholder Query type: motif_query Intent: Hard negatives for fake completeness and missing real data paths. Motif: mock_as_real_or_placeholder Training usage: hard_negative Graph gol…
12 occurrences
repo-level (12 hits)
critical Security checks security auth conf 0.78 26 occurrences Foundry mined security auth guardrail gaps: Rul1an/assay
Graph query export: Security/auth changes without enough guardrails Query id: security_auth_guardrail_gaps Query type: motif_query Intent: Assumption-check security/auth examples requiring stronger tests or CI. Motif: security_auth_without_guardrails Training usage: assumption_check Graph gold labe…
26 occurrences
repo-level (26 hits)
high Security checks quality Practices conf 0.84 18 occurrences Foundry mined bad chains: Rul1an/assay
Comment chain pattern product: bad_chains Repo: Rul1an/assay Thread: Rul1an/assay#85 Outcome: not_resolved_or_not_observed Thread label: thread_has_human_issue_without_fix_context Source graph label: source_backed_multi_signal_graph Reasons: source_graph_has_real_artifacts, source_graph_has_verific…
18 occurrences
repo-level (18 hits)
high Security checks quality Quality conf 0.76 13 occurrences Foundry mined schema ui api mismatch: Rul1an/assay
Graph query export: Schema, UI, and API mismatch Query id: schema_ui_api_mismatch Query type: motif_query Intent: Assumption-check examples for data-path consistency across layers. Motif: schema_ui_api_mismatch Training usage: assumption_check Graph gold label: assumption_check Repo: Rul1an/assay T…
13 occurrences
repo-level (13 hits)
high Security checks quality Testing conf 0.78 47 occurrences Foundry mined test ci gap after feedback: Rul1an/assay
Graph query export: Feedback exposes missing tests or CI Query id: test_ci_gap_after_feedback Query type: motif_query Intent: Hard negatives for feedback/fix chains without adequate guardrails. Motif: test_ci_gap_after_feedback Training usage: hard_negative Graph gold label: assumption_check Repo: …
47 occurrences
repo-level (47 hits)
medium Security checks quality Practices conf 0.62 69 occurrences Foundry mined assumption checks: Rul1an/assay
Comment chain pattern product: assumption_checks Repo: Rul1an/assay Thread: Rul1an/assay#9 Outcome: ambiguous_needs_more_evidence Thread label: thread_has_human_issue_without_fix_context Source graph label: source_backed_multi_signal_graph Reasons: source_graph_has_real_artifacts, source_graph_has_…
69 occurrences
repo-level (69 hits)
medium Security checks quality maintenance conf 0.70 80 occurrences Foundry mined blueprint gap alignment: Rul1an/assay
Graph query export: Human feedback aligned with blueprint or architecture gaps Query id: blueprint_gap_alignment Query type: motif_query Intent: Curriculum-gap examples connecting issue threads to helicopter-view gaps. Motif: blueprint_gap_alignment Training usage: curriculum_gap Graph gold label: …
80 occurrences
repo-level (80 hits)
medium Security checks quality Practices conf 0.70 35 occurrences Foundry mined unresolved feedback: Rul1an/assay
Graph query export: Human feedback without linked fix evidence Query id: unresolved_feedback Query type: motif_query Intent: Negative/unresolved examples that should not be hallucinated into fixes. Motif: unlinked_feedback_needs_evidence Training usage: negative_or_unresolved Graph gold label: assu…
35 occurrences
repo-level (35 hits)
medium System graph quality Agent instructions conf 1.00 Agent instructions exist but release-hardening basics are missing
AI-coder instruction files were found, but the repo is missing lockfile. Treat this as a contract gap: the agent is guided, but the generated output is not yet guarded by the controls that make it repeatable.
Repo hardeningGenerated repo pattern
medium System graph quality Placeholder conf 1.00 Critical user flow still appears backed by mock or placeholder data
A payment/auth/admin/order/billing-style flow contains mock, fake, TODO, dummy, or placeholder markers in runtime source. In the Fable corpus this is a high-leverage completeness smell: the app can look finished while the money, identity, or tenant flow is still scaffolded.
Mock dataCritical flowGenerated repo pattern
medium System graph cicd CI/CD security conf 1.00 GitHub Action is tag-pinned rather than SHA-pinned
Rul1an/assay/assay-action@v2 can move without a code change in this repo. Pin third-party actions to a reviewed 40-character commit SHA.
demo/walkthrough_tmp/.github/workflows/assay.yml:19 CI/CD securitySupply chainGithub actions
medium System graph cicd CI/CD security conf 1.00 7 occurrences GitHub Actions workflow grants broad write permissions
CI tokens with write permissions increase blast radius when an action, dependency, or PR workflow is compromised. Prefer job-level least-privilege permissions.
7 files, 7 locations
.github/workflows/demo.yml
.github/workflows/dependabot-maintenance.yml
.github/workflows/docs-auto-update.yml
.github/workflows/docs.yml
.github/workflows/mcp-registry-publish.yml
.github/workflows/openssf-scorecard.yml
.github/workflows/release.yml
CI/CD securitySupply chainGithub actions
medium System graph security security conf 1.00 Insecure pattern 'node_child_process' in docs/experiments/runner-vs-otel-2026-05/workload/src/manifest-binding.ts:23
Found a known-risky pattern (node_child_process). Review and replace if possible.
docs/experiments/runner-vs-otel-2026-05/workload/src/manifest-binding.ts:23 Node child process
medium System graph quality Integrity conf 1.00 Network/subprocess call without timeout or try/except — docs/experiments/runner-vs-otel-overhead-2026-05/overhead_harness.py:170
`subprocess.run(...)` here lacks both a `timeout=` arg and an enclosing try/except. This is exactly the class of bug that took down our git-clone earlier (HTTP/2 stream cancel surfaced as a fatal). Add a `timeout=` and wrap in try/except, or use a wrapper that retries.
runtime safetyRobustness
medium System graph quality Integrity conf 1.00 Network/subprocess call without timeout or try/except — scripts/ci/assay_runner_lane_check.py:350
`subprocess.run(...)` here lacks both a `timeout=` arg and an enclosing try/except. This is exactly the class of bug that took down our git-clone earlier (HTTP/2 stream cancel surfaced as a fatal). Add a `timeout=` and wrap in try/except, or use a wrapper that retries.
runtime safetyRobustness
medium System graph quality Integrity conf 1.00 Network/subprocess call without timeout or try/except — scripts/ci/check-claims-boundary.py:100
`subprocess.run(...)` here lacks both a `timeout=` arg and an enclosing try/except. This is exactly the class of bug that took down our git-clone earlier (HTTP/2 stream cancel surfaced as a fatal). Add a `timeout=` and wrap in try/except, or use a wrapper that retries.
runtime safetyRobustness
medium System graph quality Integrity conf 1.00 Network/subprocess call without timeout or try/except — scripts/ci/check-public-artifact-sanitization.py:132
`subprocess.run(...)` here lacks both a `timeout=` arg and an enclosing try/except. This is exactly the class of bug that took down our git-clone earlier (HTTP/2 stream cancel surfaced as a fatal). Add a `timeout=` and wrap in try/except, or use a wrapper that retries.
runtime safetyRobustness
medium System graph quality Placeholder conf 1.00 Placeholder or mock-heavy implementation detected
Found 251 placeholder/mock markers across 88 source files. This often means the repo looks complete while core flows still use generated scaffolding or fake data.
Mock dataIncompleteGenerated repo pattern
medium System graph network Security conf 1.00 Privileged port 17 in use
Port 17 is privileged (<1024). Make sure the service runs with the right caps or front it with a non-privileged port via a load balancer.
.github/workflows/adr025-nightly-soak.yml Ports
medium System graph network Security conf 1.00 Privileged port 2 in use
Port 2 is privileged (<1024). Make sure the service runs with the right caps or front it with a non-privileged port via a load balancer.
.github/workflows/adr025-nightly-soak.yml Ports
medium System graph network Security conf 1.00 Privileged port 3 in use
Port 3 is privileged (<1024). Make sure the service runs with the right caps or front it with a non-privileged port via a load balancer.
.github/workflows/perf_nightly.yml Ports
medium System graph network Security conf 1.00 Privileged port 720 in use
Port 720 is privileged (<1024). Make sure the service runs with the right caps or front it with a non-privileged port via a load balancer.
demo/produce_video.sh Ports
medium System graph quality Placeholder conf 1.00 Runtime service client appears to use placeholder configuration
A runtime source file appears to wire Supabase/Firebase/AI/payment-style clients to placeholder URLs, keys, or fallback values. In the Fable corpus this often means the UI/API shape is present while the backend service is not actually configured.
Runtime configService clientGenerated repo pattern
low System graph hardware Coverage conf 1.00 Containers defined but no K8s/orchestration manifest found
Repo has Dockerfiles/compose but no Kubernetes/Nomad manifests. If the target deployment is K8s, the manifests may live in a separate ops repo.
Deployment
low System graph quality Debug conf 1.00 Debug logging residue appears in source files
Found 270 console/debugger/print-style debug statements in non-test source. This is a common fast-generation residue before production cleanup.
CleanupRepo hardeningGenerated repo pattern
low System graph quality Integrity conf 1.00 16 occurrences Near-duplicate function bodies in 2 places
Functions with the same first-5-line body hash: docs/experiments/runner-vs-otel-overhead-2026-05/overhead_harness.py:utc_now, docs/experiments/agent-observability-fidelity-2026-05/evidence_pack.py:utc_now This is *the* AI-coder failure mode (4× more duplication in vibe-coded repos — see https://jw…
16 occurrences
repo-level (16 hits)
duplicatesduplication
low System graph quality Integrity conf 1.00 2 occurrences Near-duplicate function bodies in 4 places
Functions with the same first-5-line body hash: docs/experiments/runner-vs-otel-overhead-2026-05/overhead_harness.py:write_json, docs/experiments/agent-observability-fidelity-2026-05/semantic_gap_harness.py:write_json, docs/experiments/agent-observability-fidelity-2026-05/interop_harness.py:write_j…
2 occurrences
repo-level (2 hits)
duplicatesduplication
low System graph quality Integrity conf 1.00 2 occurrences Near-duplicate function bodies in 5 places
Functions with the same first-5-line body hash: scripts/ci/exp-mcp-fragmented-ipi/score_sink_failure.py:wilson, scripts/ci/exp-mcp-fragmented-ipi/score_runs.py:wilson, scripts/ci/exp-mcp-fragmented-ipi/score_wrap_bypass.py:wilson, scripts/ci/exp-mcp-fragmented-ipi/score_second_sink.py:wilson This …
2 occurrences
repo-level (2 hits)
duplicatesduplication
low System graph quality dependencies conf 1.00 Node manifest has dependencies but no lockfile: docs/experiments/cross-runtime-drift-2026-05/workload-gemini/package.json
`package.json` declares dependencies, but no same-directory npm/pnpm/yarn/bun lockfile was found. Generated projects without lockfiles are less reproducible and harder to secure-scan precisely.
docs/experiments/cross-runtime-drift-2026-05/workload-gemini/package.json LockfileReproducibilityGenerated repo pattern
low System graph quality dependencies conf 1.00 Node manifest has dependencies but no lockfile: docs/experiments/cross-runtime-drift-2026-05/workload-openai/package.json
`package.json` declares dependencies, but no same-directory npm/pnpm/yarn/bun lockfile was found. Generated projects without lockfiles are less reproducible and harder to secure-scan precisely.
docs/experiments/cross-runtime-drift-2026-05/workload-openai/package.json LockfileReproducibilityGenerated repo pattern
low System graph quality dependencies conf 1.00 Node manifest has dependencies but no lockfile: docs/experiments/runner-vs-otel-2026-05/workload/package.json
`package.json` declares dependencies, but no same-directory npm/pnpm/yarn/bun lockfile was found. Generated projects without lockfiles are less reproducible and harder to secure-scan precisely.
docs/experiments/runner-vs-otel-2026-05/workload/package.json LockfileReproducibilityGenerated repo pattern
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `exp_mcp_fragmented_ipi_ablation_summary_v1` in scripts/ci/exp-mcp-fragmented-ipi/ablation/score_ablation.py:20
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `exp_mcp_fragmented_ipi_cross_session_decay_summary_v2` in scripts/ci/exp-mcp-fragmented-ipi/score_cross_session_decay.py:121
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `exp_mcp_fragmented_ipi_cross_session_state_v1` in scripts/ci/exp-mcp-fragmented-ipi/cross_session/state.py:11
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `exp_mcp_fragmented_ipi_interleaving_summary_v1` in scripts/ci/exp-mcp-fragmented-ipi/score_interleaving.py:236
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `exp_mcp_fragmented_ipi_second_sink_summary_v1` in scripts/ci/exp-mcp-fragmented-ipi/score_second_sink.py:153
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `exp_mcp_fragmented_ipi_wrap_bypass_summary_v1` in scripts/ci/exp-mcp-fragmented-ipi/score_wrap_bypass.py:124
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `linux_ebpf_cgroup_v2` in docs/experiments/runner-vs-otel-2026-05/workload/src/workload.ts:151
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `sink_failure_compat_host_http_local_v1` in scripts/ci/exp-mcp-fragmented-ipi/drive_fragmented_ipi.py:523
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `sink_failure_compat_host_stdio_v1` in scripts/ci/exp-mcp-fragmented-ipi/compat_host/compat_host.py:19
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `sink_failure_compat_host_stdio_v1` in scripts/ci/exp-mcp-fragmented-ipi/score_sink_failure.py:159
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph software Dead code conf 1.00 Possibly dead Python function: do_POST
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
scripts/ci/exp-mcp-fragmented-ipi/compat_host/compat_host.py:89
low System graph software Dead code conf 1.00 Possibly dead Python function: evaluate
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
examples/pydantic-ai-eval-report-evidence/generate_synthetic_report.py:23
low System graph software Dead code conf 1.00 Possibly dead Python function: handler
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
examples/crewai-event-evidence/export_listener.py:126
low System graph software Dead code conf 1.00 Possibly dead Python function: log_message
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
scripts/ci/exp-mcp-fragmented-ipi/compat_host/compat_host.py:86
low System graph software Dead code conf 1.00 Possibly dead Python function: redirect_request
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
scripts/ci/assay_host_capability_check.py:180
low System graph software Dead code conf 1.00 Possibly dead Python function: setup_listeners
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
examples/crewai-event-evidence/export_listener.py:108
low System graph software Dead code conf 1.00 Possibly dead Python function: stream_response
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
examples/openai-agents-trace-evidence/generate_synthetic_run.py:116
low System graph software Dead code conf 1.00 Possibly dead Python function: uppercase_eval_failure
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
examples/pydantic-ai-eval-report-evidence/generate_synthetic_report.py:76
low System graph software Dead code conf 1.00 Possibly dead Python function: uppercase_eval_valid
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
examples/pydantic-ai-eval-report-evidence/generate_synthetic_report.py:72
low System graph quality Provenance conf 1.00 Shallow git history limits provenance confidence
The repository is a shallow clone. Origin/evolution analysis cannot distinguish fresh generation, imported legacy code, or long-lived human code with high confidence.
Git historyGenerated repo pattern
low System graph quality Integrity conf 1.00 Stub function `log_message` (body is just `pass`/`return`) — scripts/ci/exp-mcp-fragmented-ipi/compat_host/compat_host.py:86
Likely an AI scaffold that was never filled in. Remove or implement.
Empty handlerDead code
low System graph quality Integrity conf 1.00 Stub function `shutdown` (body is just `pass`/`return`) — examples/openai-agents-trace-evidence/generate_synthetic_run.py:78
Likely an AI scaffold that was never filled in. Remove or implement.
Empty handlerDead code
low System graph quality Complexity conf 1.00 Very large file: crates/assay-mcp-server/src/proxy/enforce.rs (1630 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
low System graph quality Complexity conf 1.00 Very large file: crates/assay-mcp-server/src/proxy/mod.rs (1390 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
low System graph quality Complexity conf 1.00 Very large file: crates/assay-mcp-server/tests/proxy_enforce_pdp_e2e.rs (1565 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
low System graph quality Complexity conf 1.00 Very large file: docs/experiments/cross-runtime-drift-2026-05/compare/drift.py (2491 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
low System graph quality Complexity conf 1.00 Very large file: docs/experiments/cross-runtime-drift-2026-05/compare/test_drift.py (2465 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
low System graph quality Complexity conf 1.00 Very large file: docs/experiments/runner-vs-otel-overhead-2026-05/overhead_harness.py (1486 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
low System graph quality Complexity conf 1.00 Very large file: docs/experiments/runner-vs-otel-overhead-2026-05/test_overhead_harness.py (1431 lines)
Files with >800 lines often hide complexity hotspots and discourage tests.
For AI agents: Voting guide (TP/FP) MCP manifest Stdio wrapper SARIF Integrate Findings queue Vote TP/FP on findings to calibrate the engine.
For AI agents + API integrations
Email me when this repo regresses
Free. We re-scan periodically; new criticals → your inbox. No signup required for the scan itself.
API access

This page is publicly accessible at: https://repobility.com/scan/97f46cb4-7b37-4657-b10e-63635454aeff/

To check status programmatically (no auth required): 

curl -s https://repobility.com/api/v1/public/scan/97f46cb4-7b37-4657-b10e-63635454aeff/

Important — please don't re-submit the same URL repeatedly. The submission endpoint is idempotent: re-submitting the same git URL returns this same scan_token, not a new one. To re-scan this repo, sign up free and use the dashboard.