Public scan — anyone with this URL can view this analysis. Sign up to track your own repos privately, run scheduled re-scans, and get AI fix prompts via your dashboard.

sckwokyboom/Agentic-Bench

https://github.com/sckwokyboom/Agentic-Bench · scanned 2026-06-16 00:04 UTC (2 months, 3 weeks ago)

71 raw signals (0 security + 71 graph)

UNIFIED Repobility · multi-layer engine · AI coders

Complete repo analysis

Last scanned 2 months, 3 weeks ago · v1 · 71 actionable findings from 1 signal source. Security checks, system graph analysis, and verified AI-agent feedback are merged into one review queue.

JSON
Severity distribution — click a segment to filter
Active filters: excluding tests × Reset all

All 2382 nodes from the latest scan, grouped by kind. Each node is a unit the engine identified (file, function, endpoint, table…). Most users won't need this view — it's primarily for debugging the engine's graph extraction or for AI agents that want to enumerate the project structure.

LabelLayerStatusPath
_exp software healthy tests/test_runner_env_preflight.py:18
test_required_env_refs_collects_all_sources software healthy tests/test_runner_env_preflight.py:42
test_cache_mounts_only_required_in_container_mode software healthy tests/test_runner_env_preflight.py:66
test_run_experiment_fails_fast_on_missing_env software healthy tests/test_runner_env_preflight.py:79
_factory software healthy tests/test_runner_env_preflight.py:168
test_preflight_accepts_authjson_key software healthy tests/test_runner_env_preflight.py:104
test_run_experiment_proceeds_when_env_present software healthy tests/test_runner_env_preflight.py:127
test_preflight_reports_missing_lib software healthy tests/test_runner_env_preflight.py:146
test_preflight_reports_unregistered_tools_lib software healthy tests/test_runner_env_preflight.py:163
test_extract_skips_tool_call_with_no_name software healthy tests/test_robustness.py:12
__init__ software healthy tests/test_robustness.py:31
run_task software healthy tests/test_robustness.py:34
test_workdir_cleaned_up_when_client_raises software healthy tests/test_robustness.py:40
__init__ software healthy tests/test_opencode_client.py:10
wait software healthy tests/test_opencode_client.py:15
poll software healthy tests/test_opencode_client.py:19
kill software healthy tests/test_opencode_client.py:22
test_run_task_injects_authjson_key_into_env software healthy tests/test_opencode_client.py:26
fake_popen software healthy tests/test_opencode_client.py:37
test_build_run_command_resolves_lib_mount software healthy tests/test_opencode_client.py:59
test_verify_single_run_prints_line software healthy tests/test_cli_verify.py:6
test_verify_whole_experiment software healthy tests/test_cli_verify.py:19
test_verify_batch_threaded_to_experiment software healthy tests/test_cli_verify.py:30
test_verify_batch_threaded_to_single_run software healthy tests/test_cli_verify.py:42
test_expands_env_ref software healthy tests/test_envutil.py:4
test_plain_string_untouched software healthy tests/test_envutil.py:8
test_missing_env_raises software healthy tests/test_envutil.py:11
_exp software healthy tests/test_subagent_gating.py:12
test_task_disabled_by_default_without_tools_lib software healthy tests/test_subagent_gating.py:30
test_allow_subagents_true_keeps_task_enabled software healthy tests/test_subagent_gating.py:37
test_task_disabled_merges_with_tools_lib software healthy tests/test_subagent_gating.py:44
test_allow_subagents_true_with_tools_lib_omits_task software healthy tests/test_subagent_gating.py:58
test_real_client_runs_trivial_task software healthy tests/test_opencode_client_integration.py:21
test_run_deadline_none_or_nonpositive_means_no_limit software healthy tests/test_opencode_client_errors.py:12
test_run_deadline_positive_is_start_plus_timeout software healthy tests/test_opencode_client_errors.py:19
test_is_stalled_detects_no_output_past_idle_timeout software healthy tests/test_opencode_client_errors.py:23
test_is_stalled_disabled_when_idle_timeout_none_or_zero software healthy tests/test_opencode_client_errors.py:29
test_count_service_errors_counts_top_level_and_part_errors software healthy tests/test_opencode_client_errors.py:35
test_count_service_errors_none_when_no_errors software healthy tests/test_opencode_client_errors.py:49
test_count_service_errors_caps_messages_at_five software healthy tests/test_opencode_client_errors.py:60
test_count_service_errors_truncates_long_messages software healthy tests/test_opencode_client_errors.py:71
test_count_service_errors_rate_limit_via_status_string software healthy tests/test_opencode_client_errors.py:80
_make_exp software healthy tests/test_reverify.py:9
_seed_run software healthy tests/test_reverify.py:23
_seed_batched_run software healthy tests/test_reverify.py:32
test_reverify_run_happy_writes_back software healthy tests/test_reverify.py:49
test_reverify_augments_command_and_writes_expected_total software healthy tests/test_reverify.py:68
fake_run_verify software healthy tests/test_reverify.py:78
test_reverify_run_patch_apply_failed software healthy tests/test_reverify.py:94
test_reverify_backs_up_original_artifacts_once software healthy tests/test_reverify.py:105

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
README.md software healthy README.md
.abench.local.example.json software healthy .abench.local.example.json
pyproject.toml software healthy pyproject.toml
sandbox-entrypoint.sh software healthy docker/sandbox-entrypoint.sh
README software healthy docker/extra-ca/README
test_runner_env_preflight.py software healthy tests/test_runner_env_preflight.py
test_robustness.py software healthy tests/test_robustness.py
test_opencode_client.py software healthy tests/test_opencode_client.py
test_cli_verify.py software healthy tests/test_cli_verify.py
test_envutil.py software healthy tests/test_envutil.py
test_subagent_gating.py software healthy tests/test_subagent_gating.py
test_opencode_client_integration.py software healthy tests/test_opencode_client_integration.py
test_opencode_client_errors.py software healthy tests/test_opencode_client_errors.py
__init__.py software healthy tests/__init__.py
test_reverify.py software healthy tests/test_reverify.py
test_runner.py software healthy tests/test_runner.py
test_report.py software healthy tests/test_report.py
test_sandbox_entrypoint.py software healthy tests/test_sandbox_entrypoint.py
test_verify_real_builds.py software healthy tests/test_verify_real_builds.py
fakes.py software healthy tests/fakes.py
test_fakes.py software healthy tests/test_fakes.py
test_runner_progress.py software healthy tests/test_runner_progress.py
test_prompt.py software healthy tests/test_prompt.py
test_diffstat.py software healthy tests/test_diffstat.py
test_tool_validation.py software healthy tests/test_tool_validation.py
test_model_probe.py software healthy tests/test_model_probe.py
test_runner_verify_log.py software healthy tests/test_runner_verify_log.py
test_config.py software healthy tests/test_config.py
test_cheating.py software healthy tests/test_cheating.py
test_config_overlay.py software healthy tests/test_config_overlay.py
test_run_e2e.py software healthy tests/test_run_e2e.py
test_metrics.py software healthy tests/test_metrics.py
test_config_schema.py software healthy tests/test_config_schema.py
test_sandbox.py software healthy tests/test_sandbox.py
test_export_safe_trace.py software healthy tests/test_export_safe_trace.py
test_opencode_config_gating.py software healthy tests/test_opencode_config_gating.py
test_opencode_config.py software healthy tests/test_opencode_config.py
test_libraries.py software healthy tests/test_libraries.py
test_cli.py software healthy tests/test_cli.py
test_recompute.py software healthy tests/test_recompute.py
test_cli_lib.py software healthy tests/test_cli_lib.py
test_render_results.py software healthy tests/test_render_results.py
test_methods.py software healthy tests/test_methods.py
test_runner_retry.py software healthy tests/test_runner_retry.py
test_credentials.py software healthy tests/test_credentials.py
test_network_tool_gating.py software healthy tests/test_network_tool_gating.py
test_run_batches.py software healthy tests/test_run_batches.py
test_reachability.py software healthy tests/test_reachability.py
test_runner_isolation.py software healthy tests/test_runner_isolation.py
test_trace_normalize.py software healthy tests/test_trace_normalize.py

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
_RaisingClient software healthy tests/test_robustness.py:30
_FakeProc software healthy tests/test_opencode_client.py:8
_ServiceErrorClient software healthy tests/test_runner.py:63
_CancelAfterFirstClient software healthy tests/test_runner.py:133
_CapturingClient software healthy tests/test_runner.py:232
_CaptureTools software healthy tests/test_runner.py:297
FakeOpenCodeClient software healthy tests/fakes.py:11
_SequenceClient software healthy tests/test_runner_progress.py:36
_CP software healthy tests/test_tool_validation.py:142
_R software healthy tests/test_tool_validation.py:167
_FakeProc software healthy tests/test_sandbox.py:11
_SequenceClient software healthy tests/test_runner_retry.py:45
_Prov software healthy tests/test_credentials.py:32
_CP software healthy tests/test_reachability.py:40
_RecordingClient software healthy tests/test_runner_isolation.py:39
_BlockingClient software healthy tests/abench_ui/test_sessions_api.py:43
_BlockUntilCancelClient software healthy tests/abench_ui/test_run_session.py:108
_ValidityClient software healthy tests/abench_ui/test_run_session.py:170
RunNotFound software healthy abench_ui/runs.py:18
WSPublishingClient software healthy abench_ui/ws_client.py:10
ValidationResult software healthy abench_ui/validate.py:31
ExperimentNotFound software healthy abench_ui/experiments.py:18
SessionEventBuffer software healthy abench_ui/ws_buffer.py:9
SessionState software healthy abench_ui/run_session.py:27
_PerRunPublishingClient software healthy abench_ui/run_session.py:35
RunSession software healthy abench_ui/run_session.py:158
_ValidateModelBody software healthy abench_ui/server.py:42
_ReachabilityBody software healthy abench_ui/server.py:46
_CredentialsBody software healthy abench_ui/server.py:50
_RunStartBody software healthy abench_ui/server.py:54
_SuccessPatchBody software healthy abench_ui/server.py:58
_VerifyStartBody software healthy abench_ui/server.py:62
ig software healthy abench_ui/static/assets/index-CpyVzSCJ.js:ig
rB software healthy abench_ui/static/assets/index-CpyVzSCJ.js:rB
zw software healthy abench_ui/static/assets/index-CpyVzSCJ.js:zw
t software healthy abench_ui/static/assets/index-CpyVzSCJ.js:t
n software healthy abench_ui/static/assets/index-CpyVzSCJ.js:n
r software healthy abench_ui/static/assets/index-CpyVzSCJ.js:r
o software healthy abench_ui/static/assets/index-CpyVzSCJ.js:o
i software healthy abench_ui/static/assets/index-CpyVzSCJ.js:i
a software healthy abench_ui/static/assets/index-CpyVzSCJ.js:a
h software healthy abench_ui/static/assets/index-CpyVzSCJ.js:h
g software healthy abench_ui/static/assets/index-CpyVzSCJ.js:g
b software healthy abench_ui/static/assets/index-CpyVzSCJ.js:b
S software healthy abench_ui/static/assets/index-CpyVzSCJ.js:S
k software healthy abench_ui/static/assets/index-CpyVzSCJ.js:k
R software healthy abench_ui/static/assets/index-CpyVzSCJ.js:R
O software healthy abench_ui/static/assets/index-CpyVzSCJ.js:O
b2e software healthy abench_ui/static/assets/index-CpyVzSCJ.js:b2e
x2e software healthy abench_ui/static/assets/index-CpyVzSCJ.js:x2e

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
docker software healthy docker
extra-ca software healthy docker/extra-ca
tests software healthy tests
fixtures software healthy tests/fixtures
opencode software healthy tests/fixtures/opencode
abench_ui software healthy tests/abench_ui
docs software healthy docs
superpowers software healthy docs/superpowers
notes software healthy docs/superpowers/notes
plans software healthy docs/superpowers/plans
specs software healthy docs/superpowers/specs
scripts software healthy scripts
abench_ui software healthy abench_ui
static software healthy abench_ui/static
assets software healthy abench_ui/static/assets
web software healthy web
tests software healthy web/tests
fixtures software healthy web/tests/fixtures
src software healthy web/src
api software healthy web/src/api
components software healthy web/src/components
ws software healthy web/src/ws
schema software healthy web/src/schema
lib software healthy web/src/lib
pages software healthy web/src/pages
examples software healthy examples
picocli-wordcount software healthy examples/picocli-wordcount
slices software healthy examples/picocli-wordcount/slices
fixtures software healthy examples/picocli-wordcount/fixtures
wordcount-original software healthy examples/picocli-wordcount/fixtures/wordcount-original
src software healthy examples/picocli-wordcount/fixtures/wordcount-original/src
test software healthy examples/picocli-wordcount/fixtures/wordcount-original/src/…
java software healthy examples/picocli-wordcount/fixtures/wordcount-original/src/…
example software healthy examples/picocli-wordcount/fixtures/wordcount-original/src/…
main software healthy examples/picocli-wordcount/fixtures/wordcount-original/src/…
java software healthy examples/picocli-wordcount/fixtures/wordcount-original/src/…
example software healthy examples/picocli-wordcount/fixtures/wordcount-original/src/…
wordcount-stripped software healthy examples/picocli-wordcount/fixtures/wordcount-stripped
src software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src
test software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src/…
java software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src/…
example software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src/…
main software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src/…
java software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src/…
example software healthy examples/picocli-wordcount/fixtures/wordcount-stripped/src/…
prompts software healthy examples/picocli-wordcount/prompts
real-codebase software healthy examples/real-codebase
tools software healthy tools
abench software healthy abench
experiments software healthy experiments

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
App frontend healthy web/src/App.tsx
VerifyField frontend healthy web/src/components/VerifyField.tsx
ValidationPanel frontend healthy web/src/components/ValidationPanel.tsx
StartupStatus frontend healthy web/src/components/StartupStatus.tsx
VerifyChip frontend healthy web/src/components/VerifyChip.tsx
ModelValidationChip frontend healthy web/src/components/ModelValidationChip.tsx
UploadYamlButton frontend healthy web/src/components/UploadYamlButton.tsx
VerifyCard frontend healthy web/src/components/VerifyCard.tsx
IsolationChip frontend healthy web/src/components/IsolationChip.tsx
VerifyStatusChip frontend healthy web/src/components/VerifyStatusChip.tsx
EventStream frontend healthy web/src/components/EventStream.tsx
RunsTable frontend healthy web/src/components/RunsTable.tsx
PreviousRunsPanel frontend healthy web/src/components/PreviousRunsPanel.tsx
RunSidebar frontend healthy web/src/components/RunSidebar.tsx
MetricsDrawer frontend healthy web/src/components/MetricsDrawer.tsx
ValiditySignals frontend healthy web/src/components/ValiditySignals.tsx
AggregateStatsBar frontend healthy web/src/components/AggregateStatsBar.tsx
AugmentationField frontend healthy web/src/components/AugmentationField.tsx
ProgressHeader frontend healthy web/src/components/ProgressHeader.tsx
MethodComparisonCard frontend healthy web/src/components/MethodComparisonCard.tsx
RawEventsToggle frontend healthy web/src/components/RawEventsToggle.tsx
SafeTraceButton frontend healthy web/src/components/SafeTraceButton.tsx
TurnCard frontend healthy web/src/components/TurnCard.tsx
VerdictBanner frontend healthy web/src/components/VerdictBanner.tsx
AddApiKeyDialog frontend healthy web/src/components/AddApiKeyDialog.tsx
DeleteExperimentDialog frontend healthy web/src/components/DeleteExperimentDialog.tsx
NewExperimentDialog frontend healthy web/src/components/NewExperimentDialog.tsx
ReachabilityPanel frontend healthy web/src/components/ReachabilityPanel.tsx
SummaryTable frontend healthy web/src/components/SummaryTable.tsx
FixturesPanel frontend healthy web/src/components/FixturesPanel.tsx
TargetMethodsChips frontend healthy web/src/components/TargetMethodsChips.tsx
PlanPanel frontend healthy web/src/components/PlanPanel.tsx
SavedExperimentCard frontend healthy web/src/components/SavedExperimentCard.tsx
ActiveRunsBanner frontend healthy web/src/components/ActiveRunsBanner.tsx
CustomEndpointDialog frontend healthy web/src/components/CustomEndpointDialog.tsx
RunSidebarCard frontend healthy web/src/components/RunSidebarCard.tsx
FinalDiffCard frontend healthy web/src/components/FinalDiffCard.tsx
ResultsExportButton frontend healthy web/src/components/ResultsExportButton.tsx
ExperimentForm frontend healthy web/src/components/ExperimentForm.tsx
TraceRunSwitcher frontend healthy web/src/components/TraceRunSwitcher.tsx
StatusPill frontend healthy web/src/components/StatusPill.tsx
RunLogToggle frontend healthy web/src/components/RunLogToggle.tsx
ConditionItemTemplate frontend healthy web/src/schema/ConditionItemTemplate.tsx
DescriptionFieldTemplate frontend healthy web/src/schema/DescriptionFieldTemplate.tsx
RootObjectFieldTemplate frontend healthy web/src/schema/RootObjectFieldTemplate.tsx
ExperimentList frontend healthy web/src/pages/ExperimentList.tsx
ExperimentResults frontend healthy web/src/pages/ExperimentResults.tsx
ExperimentEdit frontend healthy web/src/pages/ExperimentEdit.tsx
RunsIndex frontend healthy web/src/pages/RunsIndex.tsx
TraceView frontend healthy web/src/pages/TraceView.tsx

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
GET /schema api healthy abench_ui/server.py
GET /experiments api healthy abench_ui/server.py
POST /experiments/upload api healthy abench_ui/server.py
GET /experiments/{name} api healthy abench_ui/server.py
GET /experiments/{name}/verify_command api healthy abench_ui/server.py
PUT /experiments/{name} api healthy abench_ui/server.py
DELETE /experiments/{name} api healthy abench_ui/server.py
GET /runs/{name}/batches api healthy abench_ui/server.py
GET /runs/{name} api healthy abench_ui/server.py
GET /runs/{name}/summary api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/metrics api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/trace api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/safe_trace api healthy abench_ui/server.py
GET /runs/{name}/safe_traces api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/patch api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/events api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/verify_log api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/run_log api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/debug_log api healthy abench_ui/server.py
POST /runs/{name}/recompute api healthy abench_ui/server.py
GET /runs/{name}/{condition}/{rep}/method_comparison api healthy abench_ui/server.py
PATCH /runs/{name}/{condition}/{rep} api healthy abench_ui/server.py
POST /validate/model api healthy abench_ui/server.py
POST /validate/reachability api healthy abench_ui/server.py
GET /models api healthy abench_ui/server.py
GET /providers api healthy abench_ui/server.py
POST /providers/{provider}/credentials api healthy abench_ui/server.py
POST /runs api healthy abench_ui/server.py
GET /sessions api healthy abench_ui/server.py
GET /sessions/{sid} api healthy abench_ui/server.py
DELETE /sessions/{sid} api healthy abench_ui/server.py
POST /verify api healthy abench_ui/server.py
GET /verify/{verify_id} api healthy abench_ui/server.py
GET / api healthy abench_ui/server.py
ANY /{full_path:path} api healthy abench_ui/server.py

LabelLayerStatusPath
/ExperimentList frontend healthy web/src/pages/ExperimentList.tsx
/ExperimentResults frontend healthy web/src/pages/ExperimentResults.tsx
/ExperimentEdit frontend healthy web/src/pages/ExperimentEdit.tsx
/RunsIndex frontend healthy web/src/pages/RunsIndex.tsx
/TraceView frontend healthy web/src/pages/TraceView.tsx
/Run frontend healthy web/src/pages/Run.tsx
/ frontend healthy web/tests/App.smoke.test.tsx
/runs/:name frontend healthy web/tests/ExperimentResults.batch.test.tsx
/experiments frontend healthy web/tests/ActiveRunsBanner.test.tsx
/runs/sessions/:sid frontend healthy web/tests/ActiveRunsBanner.test.tsx
/tmp/abench-xy/src frontend healthy web/tests/traceModel.test.ts

LabelLayerStatusPath
127.0.0.1 network healthy README.md
10.0.0.5 network healthy web/tests/ModelValidationChip.test.tsx

LabelLayerStatusPath
repobility-clone-eo4mux80 software healthy /tmp/repobility-clone-eo4mux80

LabelLayerStatusPath
port:5173 network healthy web/vite.config.ts
For AI agents: Voting guide (TP/FP) MCP manifest Stdio wrapper SARIF Integrate Findings queue Vote TP/FP on findings to calibrate the engine.
For AI agents + API integrations
Email me when this repo regresses
Free. We re-scan periodically; new criticals → your inbox. No signup required for the scan itself.
API access

This page is publicly accessible at: https://repobility.com/scan/7a860f58-7f46-4e1b-8176-244617a100bf/

To check status programmatically (no auth required):

curl -s https://repobility.com/api/v1/public/scan/7a860f58-7f46-4e1b-8176-244617a100bf/

Important — please don't re-submit the same URL repeatedly. The submission endpoint is idempotent: re-submitting the same git URL returns this same scan_token, not a new one. To re-scan this repo, sign up free and use the dashboard.