Public scan — anyone with this URL can view this analysis. Sign up to track your own repos privately, run scheduled re-scans, and get AI fix prompts via your dashboard.
Sign up free Scan another repo

qiurui144/vlm-llm-benchmark

https://github.com/qiurui144/vlm-llm-benchmark · scanned 2026-06-15 23:43 UTC (2 months, 4 weeks ago)

58 raw signals (0 security + 58 graph)

File as issue Image
UNIFIED Repobility · multi-layer engine · AI coders

Complete repo analysis

Last scanned 2 months, 4 weeks ago · v1 · 44 actionable findings from 1 signal source. 14 repeated signals grouped for readability. Security checks, system graph analysis, and verified AI-agent feedback are merged into one review queue.

JSON
Combined
60.0
/100
Security checks
60
0 findings
System graph
60
77.8% cov · 44 findings
Critical
2
click to filter
Agents
10
0 votes
Crowd
0
reported
Severity distribution — click a segment to filter
Active filters: excluding tests × Reset all
Severity: Critical 2 High 1 Medium 1 Low 34 9-Layer: Software Security Quality Integrity Frontend Hardware Data Network Cicd Source: Security checks 0 System graph 44 Crowd 0 Layer: Software 23 Frontend 1 Security 3 Cicd 1 Quality 16
Corpus Intelligence Cross-corpus context (cohort percentile, top patterns, fix plan) is shown only on repositories you own. Sign up and connect your repo to view it.
Scan summary Repository scanned at 60.0/100 with 77.8% coverage. It contains 2500 nodes across 0 cross-layer flows, written primarily in mixed languages. Engine surfaced 58 findings — concentrated in quality (30), software (23), security (3). Risk profile is high: 2 critical, 1 high, 1 medium. Recommended next step: open the quality layer findings first — that's where the highest-impact wins live.

Showing 38 of 44 actionable findings. 58 raw detector signals were grouped into reader-sized issues. Click TP / FP to vote on a finding's accuracy — votes adjust the confidence weighting and improve detection across the platform.

critical System graph security Secrets conf 1.00 Possible secret in benchmark/llama_benchmark/utils/remote_device.py
Detected pattern matching password_literal. Rotate the credential and move to a secret manager.
benchmark/llama_benchmark/utils/remote_device.py:4
critical System graph security Secrets conf 1.00 Possible secret in benchmark/llama_configs/devices/k1.yaml
Detected pattern matching password_literal. Rotate the credential and move to a secret manager.
benchmark/llama_configs/devices/k1.yaml:14
high System graph cicd CI/CD security conf 1.00 GitHub Action tracks a moving branch
ludeeus/action-shellcheck@master can move without a code change in this repo. Pin third-party actions to a reviewed 40-character commit SHA.
.github/workflows/ci.yml:59 CI/CD securitySupply chainGithub actions
medium System graph security Coverage conf 1.00 No auth library detected
The scanner did not find any standard auth library (JWT, OAuth, NextAuth, Auth0, etc.). The repo has auth/admin/session surface indicators, so auth may live in custom code, in a separate service, or be missing.
auth
low System graph quality Debug conf 1.00 Debug logging residue appears in source files
Found 115 console/debugger/print-style debug statements in non-test source. This is a common fast-generation residue before production cleanup.
CleanupRepo hardeningGenerated repo pattern
low System graph quality Integrity conf 1.00 12 occurrences Near-duplicate function bodies in 2 places
Functions with the same first-5-line body hash: common.py:infer_sync, common.py:infer_stream This is *the* AI-coder failure mode (4× more duplication in vibe-coded repos — see https://jw.hn/ai-code-hygiene). Consolidate or document why they're separate.
12 occurrences
repo-level (12 hits)
duplicatesduplication
low System graph quality Integrity conf 1.00 4 occurrences Near-duplicate function bodies in 3 places
Functions with the same first-5-line body hash: benchmark/llama_benchmark/backends/nemo_speaker_backend.py:diarize, benchmark/llama_benchmark/backends/wespeaker_backend.py:diarize, benchmark/llama_benchmark/backends/pyannote_backend.py:diarize This is *the* AI-coder failure mode (4× more duplicati…
4 occurrences
repo-level (4 hits)
duplicatesduplication
low System graph quality Integrity conf 1.00 Near-duplicate function bodies in 4 places
Functions with the same first-5-line body hash: benchmark/llama_benchmark/core/result.py:to_dict, benchmark/llama_benchmark/core/result.py:to_dict, benchmark/llama_benchmark/core/result.py:to_dict, benchmark/llama_benchmark/core/result.py:to_dict This is *the* AI-coder failure mode (4× more duplic…
duplicatesduplication
low System graph quality Integrity conf 1.00 Near-duplicate function bodies in 5 places
Functions with the same first-5-line body hash: benchmark/llama_benchmark/benchmarks/asr/runner.py:setup, benchmark/llama_benchmark/benchmarks/rerank/runner.py:setup, benchmark/llama_benchmark/benchmarks/whisper/runner.py:setup, benchmark/llama_benchmark/benchmarks/ocr/runner.py:setup This is *the…
duplicatesduplication
low System graph quality Integrity conf 1.00 Near-duplicate function bodies in 7 places
Functions with the same first-5-line body hash: benchmark/llama_benchmark/benchmarks/docling/runner.py:teardown, benchmark/llama_benchmark/benchmarks/asr/runner.py:teardown, benchmark/llama_benchmark/benchmarks/rerank/runner.py:teardown, benchmark/llama_benchmark/benchmarks/whisper/runner.py:teardo…
duplicatesduplication
low System graph quality Integrity conf 1.00 Near-duplicate function bodies in 9 places
Functions with the same first-5-line body hash: benchmark/rag/component_pipeline.py:run, benchmark/rag/component_pipeline.py:run, benchmark/rag/component_pipeline.py:run, benchmark/rag/component_pipeline.py:run This is *the* AI-coder failure mode (4× more duplication in vibe-coded repos — see http…
duplicatesduplication
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `golden_v1` in benchmark/rag/regression_ci.py:11
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `nvmlSystemGetCudaDriverVersion_v2` in run_benchmark.py:117
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph quality Integrity conf 1.00 Old/deprecated-named symbol `test_detect_groundtruth_leakage_full_copy` in tests/rag/test_judge_attacks.py:16
Names with suffixes like `_old`, `_v1`, `_deprecated` usually indicate replaced-but-not-removed code (typical AI-coder leftover). Confirm and delete, or rename if it's the active version.
old markerDead code
low System graph software Dead code conf 1.00 Possibly dead Python function: compute_cer
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/benchmarks/asr/rtf.py:39
low System graph software Dead code conf 1.00 Possibly dead Python function: compute_per_sample
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/core/base_metric.py:20
low System graph software Dead code conf 1.00 Possibly dead Python function: compute_tpot
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/metrics/performance.py:43
low System graph software Dead code conf 1.00 Possibly dead Python function: decorator
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/core/registry.py:29
low System graph software Dead code conf 1.00 Possibly dead Python function: elapsed_ms
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/utils/timer.py:51
low System graph software Dead code conf 1.00 Possibly dead Python function: encode_corpus
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/benchmarks/embedding/retrieval.py:56
low System graph software Dead code conf 1.00 Possibly dead Python function: encode_queries
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/benchmarks/embedding/retrieval.py:53
low System graph software Dead code conf 1.00 Possibly dead Python function: lap
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/utils/timer.py:44
low System graph software Dead code conf 1.00 Possibly dead Python function: list_backends
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/core/registry.py:129
low System graph software Dead code conf 1.00 Possibly dead Python function: list_runners
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/core/registry.py:124
low System graph software Dead code conf 1.00 Possibly dead Python function: load_beir
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/datasets/beir_dataset.py:63
low System graph software Dead code conf 1.00 Possibly dead Python function: now_ms
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/utils/timer.py:28
low System graph software Dead code conf 1.00 Possibly dead Python function: offline_index
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/rag/component_pipeline.py:338
low System graph software Dead code conf 1.00 Possibly dead Python function: perturb_paraphrase_lite
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/rag/judge_attacks.py:238
low System graph software Dead code conf 1.00 Possibly dead Python function: render_accuracy
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/report/sections.py:10
low System graph software Dead code conf 1.00 Possibly dead Python function: render_throughput
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/report/sections.py:43
low System graph software Dead code conf 1.00 Possibly dead Python function: render_ttft
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/report/sections.py:31
low System graph software Dead code conf 1.00 Possibly dead Python function: run_ci
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/rag/regression_ci.py:240
low System graph software Dead code conf 1.00 Possibly dead Python function: segments_to_rttm
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/metrics/speaker.py:344
low System graph software Dead code conf 1.00 Possibly dead Python function: simulated_judge
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/rag/labs/lab5_judge_calibration.py:30
low System graph software Dead code conf 1.00 Possibly dead Python function: stable_runner
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/rag/labs/lab6_regression_ci.py:32
low System graph software Dead code conf 1.00 Possibly dead Python function: stage_named
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/rag/component_pipeline.py:94
low System graph software Dead code conf 1.00 Possibly dead Python function: stream_with_token_timing
No callers detected by AST scan in this repo. Could be exported for external callers or a framework handler.
benchmark/llama_benchmark/backends/ollama_backend.py:258
low System graph quality Provenance conf 1.00 Shallow git history limits provenance confidence
The repository is a shallow clone. Origin/evolution analysis cannot distinguish fresh generation, imported legacy code, or long-lived human code with high confidence.
Git historyGenerated repo pattern
For AI agents: Voting guide (TP/FP) MCP manifest Stdio wrapper SARIF Integrate Findings queue Vote TP/FP on findings to calibrate the engine.
For AI agents + API integrations
Email me when this repo regresses
Free. We re-scan periodically; new criticals → your inbox. No signup required for the scan itself.
API access

This page is publicly accessible at: https://repobility.com/scan/b4b78901-509d-4f5f-bab3-3e287948e99c/

To check status programmatically (no auth required): 

curl -s https://repobility.com/api/v1/public/scan/b4b78901-509d-4f5f-bab3-3e287948e99c/

Important — please don't re-submit the same URL repeatedly. The submission endpoint is idempotent: re-submitting the same git URL returns this same scan_token, not a new one. To re-scan this repo, sign up free and use the dashboard.