Public scan — anyone with this URL can view this analysis. Sign up to track your own repos privately, run scheduled re-scans, and get AI fix prompts via your dashboard.

NVIDIA/garak

https://github.com/NVIDIA/garak · scanned 2026-05-15 16:00 UTC (4 weeks ago) · 10 languages

169 raw signals (18 security + 151 graph) 78th percentile · Python · medium (20-100K LoC) System graph score 76 (higher by 3)

UNIFIED Repobility · multi-layer engine · AI coders

Complete repo analysis

Last scanned 4 weeks ago · v1 · 10 actionable findings from 1 signal source. 3 repeated signals grouped for readability. Security checks, system graph analysis, and verified AI-agent feedback are merged into one review queue.

JSON
Score breakdown â 2026-05-17-v4 calibration-aware
Component Sub-score Weight Contribution
structure_score 60.0 0.15 9.00
security_score 83.5 0.25 20.88
testing_score 100.0 0.20 20.00
documentation_score 81.0 0.15 12.15
practices_score 65.0 0.15 9.75
code_quality 73.1 0.10 7.31
Overall 1.00 79.1
Calibrated penalty buckets (security_score): threat: 16.5
Severity distribution — click a segment to filter
Active filters: excluding tests × Reset all

All 2975 nodes from the latest scan, grouped by kind. Each node is a unit the engine identified (file, function, endpoint, table…). Most users won't need this view — it's primarily for debugging the engine's graph extraction or for AI agents that want to enumerate the project structure.

LabelLayerStatusPath
mitigation_outputs software healthy tests/conftest.py:33
config_cleanup software healthy tests/conftest.py:38
remove_log_files software healthy tests/conftest.py:41
clear_plugin_instances software healthy tests/conftest.py:61
reload software healthy tests/conftest.py:65
pytest_configure software healthy tests/conftest.py:77
check_storage software healthy tests/conftest.py:88
pytest_runtest_setup software healthy tests/conftest.py:104
validate_avid_report_structure software healthy tests/test_report.py:11
sample_report software healthy tests/test_report.py:28
sample_report_without_metadata software healthy tests/test_report.py:33
exported_avid_report software healthy tests/test_report.py:55
test_init_creates_report_object software healthy tests/test_report.py:71
test_load_reads_report_file software healthy tests/test_report.py:84
test_get_evaluations_extracts_metadata software healthy tests/test_report.py:94
test_get_evaluations_extracts_evaluations_and_scores software healthy tests/test_report.py:108
test_get_evaluations_raises_error_when_no_evals software healthy tests/test_report.py:135
test_export_creates_avid_report_file software healthy tests/test_report.py:157
test_export_creates_avid_report_file_with_proper_structure software healthy tests/test_report.py:163
test_export_includes_model_metadata_in_affects software healthy tests/test_report.py:180
test_export_includes_problemtype_in_report software healthy tests/test_report.py:197
test_export_includes_metrics_in_report software healthy tests/test_report.py:220
test_export_includes_vuln_id_in_avid_taxonomy software healthy tests/test_report.py:244
test_export_works_without_metadata software healthy tests/test_report.py:266
generator_sub_config software healthy tests/test_configurable.py:10
__init__ software healthy tests/test_configurable.py:38
test_config_root_only software healthy tests/test_configurable.py:50
test_config_root_module_classname software healthy tests/test_configurable.py:57
test_config_root_as_dict software healthy tests/test_configurable.py:66
test_param_provided software healthy tests/test_configurable.py:74
test_run_vars_propagate_to_instance software healthy tests/test_configurable.py:81
test_class_over_run_vars_propagate_to_instance software healthy tests/test_configurable.py:94
test_class_vars_propagate_to_instance software healthy tests/test_configurable.py:113
test_class_dict_merge_to_instance software healthy tests/test_configurable.py:120
test_config_mask_class_vars_to_instance software healthy tests/test_configurable.py:130
test_config_supported_params software healthy tests/test_configurable.py:137
test_requirements_txt_pyproject_toml software healthy tests/test_reqs.py:17
test_prompt_structure software healthy tests/test_attempt.py:16
test_message_setup software healthy tests/test_attempt.py:24
test_message_serializable software healthy tests/test_attempt.py:39
test_message_image_load software healthy tests/test_attempt.py:47
test_message_internal_serialize software healthy tests/test_attempt.py:76
test_conversation_internal_serialize software healthy tests/test_attempt.py:95
test_last_message software healthy tests/test_attempt.py:108
cleanup software healthy tests/test_attempt.py:138
remove_reports software healthy tests/test_attempt.py:141
test_attempt_turn_taking software healthy tests/test_attempt.py:150
test_attempt_history_lengths software healthy tests/test_attempt.py:189
test_attempt_illegal_ops software healthy tests/test_attempt.py:220
test_attempt_no_prompt_output_access software healthy tests/test_attempt.py:260

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
FAQ.md software healthy FAQ.md
README.md software healthy README.md
CA_DCO.md software healthy CA_DCO.md
CONTRIBUTING.md software healthy CONTRIBUTING.md
.pre-commit-config.yaml software healthy .pre-commit-config.yaml
.readthedocs.yaml software healthy .readthedocs.yaml
pyproject.toml software healthy pyproject.toml
requirements.txt software healthy requirements.txt
CODE_OF_CONDUCT.md software healthy CODE_OF_CONDUCT.md
SECURITY.md software healthy SECURITY.md
AGENTS.md software healthy AGENTS.md
PROJECTS.md software healthy PROJECTS.md
conftest.py software healthy tests/conftest.py
test_report.py software healthy tests/test_report.py
test_configurable.py software healthy tests/test_configurable.py
test_reqs.py software healthy tests/test_reqs.py
test_attempt.py software healthy tests/test_attempt.py
test_docs.py software healthy tests/test_docs.py
test_config.py software healthy tests/test_config.py
test_hitlog.py software healthy tests/test_hitlog.py
test_sysprompt.py software healthy tests/test_sysprompt.py
test_data.py software healthy tests/test_data.py
test_internal_structures.py software healthy tests/test_internal_structures.py
test_payloads.py software healthy tests/test_payloads.py
__init__.py software healthy tests/resources/__init__.py
test_fixer.py software healthy tests/resources/test_fixer.py
__init__.py software healthy tests/resources/red_team/__init__.py
test_evaluation.py software healthy tests/resources/red_team/test_evaluation.py
__init__.py software healthy tests/cli/__init__.py
test_cli.py software healthy tests/cli/test_cli.py
test_cli_list_filtering.py software healthy tests/cli/test_cli_list_filtering.py
test_report_digest.py software healthy tests/analyze/test_report_digest.py
test_aggregate.py software healthy tests/analyze/test_aggregate.py
__init__.py software healthy tests/analyze/__init__.py
test_bootstrap_ci.py software healthy tests/analyze/test_bootstrap_ci.py
test_report_digest_plugin_cache.py software healthy tests/analyze/test_report_digest_plugin_cache.py
test_tbsa.py software healthy tests/analyze/test_tbsa.py
test_analyze.py software healthy tests/analyze/test_analyze.py
test_calibration.py software healthy tests/analyze/test_calibration.py
test_detector_metrics.py software healthy tests/analyze/test_detector_metrics.py
test_report_digest_sql_injection.py software healthy tests/analyze/test_report_digest_sql_injection.py
test_ci_calculator.py software healthy tests/analyze/test_ci_calculator.py
__init__.py software healthy tests/harnesses/__init__.py
test_harnesses.py software healthy tests/harnesses/test_harnesses.py
test_detectors_sysprompt_extraction.py software healthy tests/detectors/test_detectors_sysprompt_extraction.py
__init__.py software healthy tests/detectors/__init__.py
test_detectors_promptinject.py software healthy tests/detectors/test_detectors_promptinject.py
test_detectors_ansiescape.py software healthy tests/detectors/test_detectors_ansiescape.py
test_detectors_misleading.py software healthy tests/detectors/test_detectors_misleading.py
test_detectors_web_injection.py software healthy tests/detectors/test_detectors_web_injection.py

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
mockConfigurable software healthy tests/test_configurable.py:23
mock_supported software healthy tests/test_configurable.py:138
TestJudge software healthy tests/resources/red_team/test_evaluation.py:11
TestJailbreakOnlyAdversarial software healthy tests/detectors/test_detectors_judge.py:90
_FakeDataset software healthy tests/detectors/test_detectors_packagehallucination.py:420
TestPIILeak software healthy tests/detectors/test_detectors_propile.py:20
TestPIILeakExact software healthy tests/detectors/test_detectors_propile.py:136
TestDecodeMatch software healthy tests/detectors/test_detectors_encoding.py:23
TestDecodeApprox software healthy tests/detectors/test_detectors_encoding.py:84
TestDetectorInit software healthy tests/detectors/test_detectors_agent_breaker.py:53
TestDetectIndependentScoring software healthy tests/detectors/test_detectors_agent_breaker.py:74
TestDetectNoneHandling software healthy tests/detectors/test_detectors_agent_breaker.py:128
TestAllAttemptsScoredForASR software healthy tests/detectors/test_detectors_agent_breaker.py:163
TestDetectContextFromNotes software healthy tests/detectors/test_detectors_agent_breaker.py:201
TestDetectJsonParsing software healthy tests/detectors/test_detectors_agent_breaker.py:231
TestConfidenceCutoff software healthy tests/detectors/test_detectors_agent_breaker.py:340
TestPIILeakProbeBase software healthy tests/probes/test_probes_propile.py:58
TestPIILeakTwin software healthy tests/probes/test_probes_propile.py:122
TestPIILeakTriplet software healthy tests/probes/test_probes_propile.py:197
TestPIILeakQuadruplet software healthy tests/probes/test_probes_propile.py:252
TestPIILeakUnstructured software healthy tests/probes/test_probes_propile.py:313
TestMissingPIIData software healthy tests/probes/test_probes_propile.py:400
TestLoadAgentConfig software healthy tests/probes/test_agent_breaker.py:75
TestDiscoverAgentConfig software healthy tests/probes/test_agent_breaker.py:132
TestProbeOrchestration software healthy tests/probes/test_agent_breaker.py:231
TestBuildToolConfigs software healthy tests/probes/test_agent_breaker.py:317
TestAttackSingleTool software healthy tests/probes/test_agent_breaker.py:384
TestVerifyAttackSuccess software healthy tests/probes/test_agent_breaker.py:430
TestGenerateNextAttempts software healthy tests/probes/test_agent_breaker.py:533
TestGenerateNextAttemptsLoopControl software healthy tests/probes/test_agent_breaker.py:810
TestHandleExploitationPhase software healthy tests/probes/test_agent_breaker.py:881
TestPostprocessAttempt software healthy tests/probes/test_agent_breaker.py:947
TestAttackStateRoundTrip software healthy tests/probes/test_agent_breaker.py:985
TestGOATAttack software healthy tests/probes/test_probes_goat.py:58
TestEarlyStopOn software healthy tests/probes/test_probes_goat.py:374
TestGOATPromptTemplates software healthy tests/probes/test_probes_goat.py:682
TestBase2048SpecCompliance software healthy tests/probes/test_base2048.py:60
TestBase2048Roundtrip software healthy tests/probes/test_base2048.py:84
TestBase2048WithPayloads software healthy tests/probes/test_base2048.py:126
TestBase2048Properties software healthy tests/probes/test_base2048.py:161
TestBase2048NoDependencies software healthy tests/probes/test_base2048.py:189
TestInjectBase2048Probe software healthy tests/probes/test_base2048.py:205
TestFactSnippet software healthy tests/probes/test_probes_latentinjection.py:71
mockHF software healthy tests/generators/test_huggingface.py:167
TestWebSocketGenerator software healthy tests/generators/test_websocket.py:12
_CannedHandler software healthy tests/generators/test_rest_mtls_integration.py:245
ShowASRDirective software healthy docs/source/_ext/garak_ext.py:12
GarakException software healthy garak/exception.py:5
APIKeyMissingError software healthy garak/exception.py:9
TargetNameMissingError software healthy garak/exception.py:13

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
tests software healthy tests
resources software healthy tests/resources
red_team software healthy tests/resources/red_team
cli software healthy tests/cli
analyze software healthy tests/analyze
harnesses software healthy tests/harnesses
detectors software healthy tests/detectors
_assets software healthy tests/_assets
analyze software healthy tests/_assets/analyze
generators software healthy tests/_assets/generators
langservice software healthy tests/_assets/langservice
probes software healthy tests/probes
generators software healthy tests/generators
langservice software healthy tests/langservice
detectors software healthy tests/langservice/detectors
probes software healthy tests/langservice/probes
plugins software healthy tests/plugins
buffs software healthy tests/buffs
docs software healthy docs
source software healthy docs/source
_static software healthy docs/source/_static
css software healthy docs/source/_static/css
_ext software healthy docs/source/_ext
garak software healthy garak
evaluators software healthy garak/evaluators
resources software healthy garak/resources
smuggling software healthy garak/resources/smuggling
apikey software healthy garak/resources/apikey
gcg software healthy garak/resources/gcg
api software healthy garak/resources/api
autodan software healthy garak/resources/autodan
red_team software healthy garak/resources/red_team
fixer software healthy garak/resources/fixer
theme software healthy garak/resources/theme
beast software healthy garak/resources/beast
tap software healthy garak/resources/tap
promptinject software healthy garak/resources/promptinject
analyze software healthy garak/analyze
ui software healthy garak/analyze/ui
harnesses software healthy garak/harnesses
detectors software healthy garak/detectors
probes software healthy garak/probes
generators software healthy garak/generators
configs software healthy garak/configs
langproviders software healthy garak/langproviders
buffs software healthy garak/buffs
tools software healthy tools
propile software healthy tools/propile
rest software healthy tools/rest
packagehallucination software healthy tools/packagehallucination

Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.

LabelLayerStatusPath
App frontend healthy garak-report/src/App.tsx
ColorLegend frontend healthy garak-report/src/components/ColorLegend.tsx
DetectorsView frontend healthy garak-report/src/components/DetectorsView.tsx
SetupSection frontend healthy garak-report/src/components/SetupSection.tsx
ModuleAccordion frontend healthy garak-report/src/components/ModuleAccordion.tsx
ProgressBar frontend healthy garak-report/src/components/ProgressBar.tsx
DefconBadge frontend healthy garak-report/src/components/DefconBadge.tsx
ErrorBoundary frontend healthy garak-report/src/components/ErrorBoundary.tsx
CalibrationSummary frontend healthy garak-report/src/components/CalibrationSummary.tsx
ProbesChart frontend healthy garak-report/src/components/ProbesChart.tsx
GarakLogo frontend healthy garak-report/src/components/GarakLogo.tsx
Footer frontend healthy garak-report/src/components/Footer.tsx
ReportDetails frontend healthy garak-report/src/components/ReportDetails.tsx
MetadataSection frontend healthy garak-report/src/components/MetadataSection.tsx
NvidiaLogo frontend healthy garak-report/src/components/NvidiaLogo.tsx
DefconSummaryPanel frontend healthy garak-report/src/components/DefconSummaryPanel.tsx
Header frontend healthy garak-report/src/components/Header.tsx
ReportFilterBar frontend healthy garak-report/src/components/ReportFilterBar.tsx
SummaryStatsCard frontend healthy garak-report/src/components/SummaryStatsCard.tsx
DetectorResultsTable frontend healthy garak-report/src/components/DetectorChart/DetectorResultsTa…
DetectorLollipopChart frontend healthy garak-report/src/components/DetectorChart/DetectorLollipopC…
DetectorChartHeader frontend healthy garak-report/src/components/DetectorChart/DetectorChartHead…
DetectorFilters frontend healthy garak-report/src/components/DetectorChart/DetectorFilters.t…
ModuleFilterChips frontend healthy garak-report/src/components/ProbeChart/ModuleFilterChips.tsx
ProbeBarChart frontend healthy garak-report/src/components/ProbeChart/ProbeBarChart.tsx
ProbeChartHeader frontend healthy garak-report/src/components/ProbeChart/ProbeChartHeader.tsx
ProbeTagsList frontend healthy garak-report/src/components/ProbeChart/ProbeTagsList.tsx
Report frontend healthy garak-report/src/pages/Report.tsx

LabelLayerStatusPath
build cicd healthy .github/workflows/test_linux.yml
build_windows cicd healthy .github/workflows/test_windows.yml
index_check cicd healthy .github/workflows/test_report_build.yaml
report_tests cicd healthy .github/workflows/test_report_build.yaml
build cicd healthy .github/workflows/maintain_cache.yml
lint cicd healthy .github/workflows/lint.yml
build_macos cicd healthy .github/workflows/test_macos.yml
docs cicd healthy .github/workflows/docs.yml
build cicd healthy .github/workflows/remote_package_install.yml
linux cicd healthy .github/workflows/nightly.yml
windows cicd healthy .github/workflows/nightly.yml
macos cicd healthy .github/workflows/nightly.yml
package_test cicd healthy .github/workflows/nightly.yml
verify-branch-state cicd healthy .github/workflows/release.yml
linux cicd healthy .github/workflows/release.yml
windows cicd healthy .github/workflows/release.yml
macos cicd healthy .github/workflows/release.yml
package_test cicd healthy .github/workflows/release.yml
release-prepare cicd healthy .github/workflows/release.yml
stale cicd healthy .github/workflows/stale.yml
pypi-prepare cicd healthy .github/workflows/prepare_package.yml
handle-labels cicd healthy .github/workflows/labels.yml

LabelLayerStatusPath
gha::test_linux cicd healthy .github/workflows/test_linux.yml
gha::test_windows cicd healthy .github/workflows/test_windows.yml
gha::test_report_build cicd healthy .github/workflows/test_report_build.yaml
gha::maintain_cache cicd healthy .github/workflows/maintain_cache.yml
gha::lint cicd healthy .github/workflows/lint.yml
gha::test_macos cicd healthy .github/workflows/test_macos.yml
gha::docs cicd healthy .github/workflows/docs.yml
gha::remote_package_install cicd healthy .github/workflows/remote_package_install.yml
gha::nightly cicd healthy .github/workflows/nightly.yml
gha::release cicd healthy .github/workflows/release.yml
gha::stale cicd healthy .github/workflows/stale.yml
gha::prepare_package cicd healthy .github/workflows/prepare_package.yml
gha::labels cicd healthy .github/workflows/labels.yml

LabelLayerStatusPath
1.2.3.4 network healthy tests/analyze/test_tbsa.py
127.0.0.9 network healthy tests/generators/test_rest.py
127.0.0.1 network healthy tests/generators/test_rest_mtls_integration.py
0.9.0.6 network healthy garak/harnesses/probewise.py
371.012.371.204 network healthy garak-report/src/components/NvidiaLogo.tsx
1.084.879.936 network healthy garak-report/src/components/NvidiaLogo.tsx
8.325.867.694 network healthy garak-report/src/components/NvidiaLogo.tsx

LabelLayerStatusPath
vps::azure hardware healthy tests/detectors/test_detectors_web_injection.py
vps::aws hardware healthy tests/detectors/test_detectors_apikey.py

LabelLayerStatusPath
/Report frontend healthy garak-report/src/pages/Report.tsx
/__tests__/Report.test frontend healthy garak-report/src/pages/__tests__/Report.test.tsx

LabelLayerStatusPath
auth::garak/generators/watsonx.py security healthy garak/generators/watsonx.py
auth::tools/propile/extract_pii_from_training_dataset.py security healthy tools/propile/extract_pii_from_training_dataset.py

LabelLayerStatusPath
repobility-clone-scb3_msy software healthy /tmp/repobility-clone-scb3_msy

LabelLayerStatusPath
ANY /endpoint api healthy tools/rest/restserv.py

LabelLayerStatusPath
sidekiq data healthy tests/detectors/test_detectors_packagehallucination.py

LabelLayerStatusPath
mongodb data healthy tests/detectors/test_detectors_apikey.py

LabelLayerStatusPath
results data healthy garak/analyze/report_digest.py

LabelLayerStatusPath
port:37176 network healthy tools/rest/restserv.py

LabelLayerStatusPath
gpu (detected) hardware healthy pyproject.toml

LabelLayerStatusPath
password_literal::tests/generators/test_rest.py security healthy tests/generators/test_rest.py

LabelLayerStatusPath
GITHUB_TOKEN cicd healthy
For AI agents: Voting guide (TP/FP) MCP manifest Stdio wrapper SARIF Integrate Findings queue Vote TP/FP on findings to calibrate the engine.
For AI agents + API integrations
Email me when this repo regresses
Free. We re-scan periodically; new criticals → your inbox. No signup required for the scan itself.
API access

This page is publicly accessible at: https://repobility.com/scan/1251ce22-878f-4008-a1db-1b422bd654c9/

To check status programmatically (no auth required):

curl -s https://repobility.com/api/v1/public/scan/1251ce22-878f-4008-a1db-1b422bd654c9/

Important — please don't re-submit the same URL repeatedly. The submission endpoint is idempotent: re-submitting the same git URL returns this same scan_token, not a new one. To re-scan this repo, sign up free and use the dashboard.