https://github.com/lightseekorg/tokenspeed
· scanned 2026-05-16 22:31 UTC (19 hours, 52 minutes ago)
· 10 languages
746 findings (51 legacy + 695 scanner) 60th percentile · Python · large (100-500K LoC) Scanner says 70 (higher by 3)
Last scanned 19 hours, 52 minutes ago · v1 · 746 findings from 2 sources. Findings combine the legacy security pipeline AND the multi-layer engine (atlas, wiring, flows, ranked) AND verified AI agent contributions.
All 6761 nodes from the latest scan, grouped by kind. Each node is a unit the engine identified (file, function, endpoint, table…). Most users won't need this view — it's primarily for debugging the engine's graph extraction or for AI agents that want to enumerate the project structure.
| Label | Layer | Status | Path |
|---|---|---|---|
is_in_ci |
software | healthy | test/test_utils.py:23 |
is_in_amd_ci |
software | healthy | test/test_utils.py:28 |
is_blackwell_system |
software | healthy | test/test_utils.py:33 |
auto_config_device |
software | healthy | test/test_utils.py:55 |
_serve_process |
software | healthy | test/test_utils.py:59 |
_dump |
software | healthy | test/test_utils.py:74 |
_wait_for_server_health |
software | healthy | test/test_utils.py:97 |
popen_serve_server |
software | healthy | test/test_utils.py:134 |
lcs |
software | healthy | test/test_utils.py:194 |
calculate_rouge_l |
software | healthy | test/test_utils.py:211 |
_evalscope_executable |
software | healthy | test/test_utils.py:227 |
_iter_evalscope_scores |
software | healthy | test/test_utils.py:261 |
_parse_evalscope_stdout |
software | healthy | test/test_utils.py:279 |
_load_evalscope_score |
software | healthy | test/test_utils.py:294 |
run_evalscope |
software | healthy | test/test_utils.py:315 |
write_github_step_summary |
software | healthy | test/test_utils.py:364 |
get_dtype_str |
software | healthy | test/runners.py:60 |
get_top_logprobs |
software | healthy | test/runners.py:71 |
get_token_ids_logprobs |
software | healthy | test/runners.py:77 |
__init__ |
software | healthy | test/runners.py:386 |
start_model_process |
software | healthy | test/runners.py:136 |
forward |
software | healthy | test/runners.py:474 |
terminate |
software | healthy | test/runners.py:246 |
__enter__ |
software | healthy | test/runners.py:516 |
__exit__ |
software | healthy | test/runners.py:519 |
forward_generation_raw |
software | healthy | test/runners.py:524 |
load_lora_adapter |
software | healthy | test/runners.py:468 |
unload_lora_adapter |
software | healthy | test/runners.py:471 |
batch_forward |
software | healthy | test/runners.py:498 |
batch_forward_generation_raw |
software | healthy | test/runners.py:653 |
monkey_patch_gemma2_sdpa |
software | healthy | test/runners.py:672 |
_check_and_enable_sdpa |
software | healthy | test/runners.py:680 |
check_close_model_outputs |
software | healthy | test/runners.py:687 |
test_aiohttp_timeout_has_sock_subtimeouts |
software | healthy | test/test_bench_timeout.py:39 |
test_per_request_timeout_constant_is_positive |
software | healthy | test/test_bench_timeout.py:61 |
test_await_with_per_request_timeout_returns_failed_output_o… |
software | healthy | test/test_bench_timeout.py:66 |
stuck_request |
software | healthy | test/test_bench_timeout.py:72 |
test_await_with_per_request_timeout_passes_through_success |
software | healthy | test/test_bench_timeout.py:87 |
fast_request |
software | healthy | test/test_bench_timeout.py:91 |
test_concurrent_stuck_request_does_not_block_gather |
software | healthy | test/test_bench_timeout.py:105 |
stuck |
software | healthy | test/test_bench_timeout.py:109 |
healthy |
software | healthy | test/test_bench_timeout.py:113 |
_split |
software | healthy | test/cli/test_argsplit.py:28 |
test_orchestrator_only_flags_are_consumed |
software | healthy | test/cli/test_argsplit.py:32 |
test_orchestrator_default_timeouts |
software | healthy | test/cli/test_argsplit.py:39 |
test_model_fans_out_to_both |
software | healthy | test/cli/test_argsplit.py:46 |
test_model_path_alias_also_fans_out |
software | healthy | test/cli/test_argsplit.py:52 |
test_user_host_port_go_to_gateway_only |
software | healthy | test/cli/test_argsplit.py:62 |
test_chat_template_overrides_to_gateway_only |
software | healthy | test/cli/test_argsplit.py:68 |
test_tool_call_parser_overrides_to_gateway_only |
software | healthy | test/cli/test_argsplit.py:75 |
Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.
| Label | Layer | Status | Path |
|---|---|---|---|
ModelOutput |
software | healthy | test/runners.py:85 |
HFRunner |
software | healthy | test/runners.py:99 |
RTRunner |
software | healthy | test/runners.py:383 |
_P |
software | healthy | test/cli/test_proc.py:45 |
_TTYBuffer |
software | healthy | test/cli/test_logo.py:41 |
_FakeHealth |
software | healthy | test/cli/_fixtures/fake_engine.py:34 |
_Servicer |
software | healthy | test/cli/_fixtures/fake_engine.py:51 |
DeviceBackend |
software | healthy | test/ci_system/ci_register.py:43 |
CIRegistry |
software | healthy | test/ci_system/ci_register.py:48 |
RegistryVisitor |
software | healthy | test/ci_system/ci_register.py:80 |
TestFile |
software | healthy | test/ci_system/ci_utils.py:26 |
ProcessGroupManager |
software | healthy | test/ci_system/process_group_manager.py:72 |
ModelCase |
software | healthy | test/runtime/test_prefix_cache_e2e.py:49 |
TestPrefixCacheDisabled |
software | healthy | test/runtime/test_prefix_cache_e2e.py:150 |
TestPrefixCacheEnabled |
software | healthy | test/runtime/test_prefix_cache_e2e.py:190 |
TestPrefixCacheDisabledOutputQuality |
software | healthy | test/runtime/test_prefix_cache_e2e.py:230 |
TestV4SlidingWindowGroupsSmoke |
software | healthy | test/runtime/test_v4_sliding_window_groups_smoke.py:53 |
TestAttentionBackendChoices |
software | healthy | test/runtime/test_server_args_attention_backends.py:30 |
_Backend |
software | healthy | test/runtime/test_mxfp4_weights.py:19 |
TestMxfp4Weights |
software | healthy | test/runtime/test_mxfp4_weights.py:27 |
TestWeightLoaderPrefetch |
software | healthy | test/runtime/test_weight_loader_prefetch.py:18 |
TestSamplingBackendRegistryDefaults |
software | healthy | test/runtime/test_sampling_backend_registry.py:18 |
_StubTokenizerManager |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:85 |
_StubReqObj |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:194 |
TestFlagOffRegression |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:235 |
TestInlineBasicEmit |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:282 |
TestOutputIdsShape |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:367 |
TestStopTrimmingPassThrough |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:431 |
TestPerRequestIndependence |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:513 |
TestSubprocessVsInlineParity |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:629 |
TestSeedHandling |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:780 |
_LogprobReqObj |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:841 |
TestInlineLogprobPassThrough |
software | healthy | test/runtime/test_inline_detokenizer_receiver.py:881 |
_Sender |
software | healthy | test/runtime/test_generation_output_processor.py:32 |
_Tokenizer |
software | healthy | test/runtime/test_generation_output_processor.py:40 |
_Metrics |
software | healthy | test/runtime/test_generation_output_processor.py:48 |
_ForwardOp |
software | healthy | test/runtime/test_generation_output_processor.py:52 |
_ExecutionResult |
software | healthy | test/runtime/test_generation_output_processor.py:62 |
DeepseekV4AttentionOpsTest |
software | healthy | test/runtime/test_deepseek_v4_attention_ops.py:213 |
_FakeGrammar |
software | healthy | test/runtime/test_grammar_cache_timeout.py:65 |
_GatedBackend |
software | healthy | test/runtime/test_grammar_cache_timeout.py:72 |
GrammarBackendCacheTests |
software | healthy | test/runtime/test_grammar_cache_timeout.py:89 |
GrammarManagerTimeoutTests |
software | healthy | test/runtime/test_grammar_cache_timeout.py:286 |
_FakeScheduler |
software | healthy | test/runtime/test_async_llm_cancel.py:34 |
_StubAsyncLLM |
software | healthy | test/runtime/test_async_llm_cancel.py:44 |
_StubReqObj |
software | healthy | test/runtime/test_async_llm_cancel.py:65 |
TestWaitOneResponseCancellation |
software | healthy | test/runtime/test_async_llm_cancel.py:89 |
TestAsyncLLMSatisfiesEngineClient |
software | healthy | test/runtime/test_async_llm_protocol.py:35 |
TestDeepseekV4MegaMoE |
software | healthy | test/runtime/test_deepseek_v4_mega_moe.py:21 |
TestCLIConfigCompat |
software | healthy | test/runtime/test_cli_config_compat.py:26 |
Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.
| Label | Layer | Status | Path |
|---|---|---|---|
README.md |
software | healthy | README.md |
CLAUDE.md |
software | healthy | CLAUDE.md |
ACKNOWLEDGEMENTS.md |
software | healthy | ACKNOWLEDGEMENTS.md |
.pre-commit-config.yaml |
software | healthy | .pre-commit-config.yaml |
AGENTS.md |
software | healthy | AGENTS.md |
Dockerfile |
software | healthy | docker/Dockerfile |
__init__.py |
software | healthy | test/__init__.py |
test_utils.py |
software | healthy | test/test_utils.py |
runners.py |
software | healthy | test/runners.py |
test_bench_timeout.py |
software | healthy | test/test_bench_timeout.py |
__init__.py |
software | healthy | test/cli/__init__.py |
test_argsplit.py |
software | healthy | test/cli/test_argsplit.py |
test_proc.py |
software | healthy | test/cli/test_proc.py |
test_cli_dispatch.py |
software | healthy | test/cli/test_cli_dispatch.py |
test_serve_smg_unit.py |
software | healthy | test/cli/test_serve_smg_unit.py |
test_logprefix.py |
software | healthy | test/cli/test_logprefix.py |
test_serve_smg_integration.py |
software | healthy | test/cli/test_serve_smg_integration.py |
test_logo.py |
software | healthy | test/cli/test_logo.py |
__init__.py |
software | healthy | test/cli/_fixtures/__init__.py |
fake_engine.py |
software | healthy | test/cli/_fixtures/fake_engine.py |
cuda_coredump.py |
software | healthy | test/ci_system/cuda_coredump.py |
install_deps_rocm.sh |
software | healthy | test/ci_system/install_deps_rocm.sh |
install_deps.sh |
software | healthy | test/ci_system/install_deps.sh |
cleanup_amd_gpu_state.sh |
software | healthy | test/ci_system/cleanup_amd_gpu_state.sh |
ci_register.py |
software | healthy | test/ci_system/ci_register.py |
ci_utils.py |
software | healthy | test/ci_system/ci_utils.py |
pipeline.py |
software | healthy | test/ci_system/pipeline.py |
process_group_manager.py |
software | healthy | test/ci_system/process_group_manager.py |
test_pipeline.py |
software | healthy | test/ci_system/test_pipeline.py |
README.md |
software | healthy | test/agentic_benchmark/tokenspeed/README.md |
collect_outputs.py |
software | healthy | test/agentic_benchmark/tokenspeed/collect_outputs.py |
agentic_bench.sh |
software | healthy | test/agentic_benchmark/tokenspeed/agentic_bench.sh |
attn_tp4_moe_tp4.sh |
software | healthy | test/agentic_benchmark/tokenspeed/configs/attn_tp4_moe_tp4.… |
attn_tp4_moe_ep4.sh |
software | healthy | test/agentic_benchmark/tokenspeed/configs/attn_tp4_moe_ep4.… |
attn_dp8_moe_tp8.sh |
software | healthy | test/agentic_benchmark/tokenspeed/configs/attn_dp8_moe_tp8.… |
attn_dp8_moe_ep8.sh |
software | healthy | test/agentic_benchmark/tokenspeed/configs/attn_dp8_moe_ep8.… |
attn_tp8_moe_tp8.sh |
software | healthy | test/agentic_benchmark/tokenspeed/configs/attn_tp8_moe_tp8.… |
attn_tp8_moe_ep8.sh |
software | healthy | test/agentic_benchmark/tokenspeed/configs/attn_tp8_moe_ep8.… |
README.md |
software | healthy | test/agentic_benchmark/trtllm/README.md |
collect_outputs.py |
software | healthy | test/agentic_benchmark/trtllm/collect_outputs.py |
agentic_bench.sh |
software | healthy | test/agentic_benchmark/trtllm/agentic_bench.sh |
attn_tp4_moe_ep4.yaml |
software | healthy | test/agentic_benchmark/trtllm/configs/attn_tp4_moe_ep4.yaml |
attn_dp8_moe_tp8.yaml |
software | healthy | test/agentic_benchmark/trtllm/configs/attn_dp8_moe_tp8.yaml |
attn_tp4_moe_tp4.yaml |
software | healthy | test/agentic_benchmark/trtllm/configs/attn_tp4_moe_tp4.yaml |
attn_tp8_moe_ep8.yaml |
software | healthy | test/agentic_benchmark/trtllm/configs/attn_tp8_moe_ep8.yaml |
attn_dp8_moe_ep8.yaml |
software | healthy | test/agentic_benchmark/trtllm/configs/attn_dp8_moe_ep8.yaml |
attn_tp8_moe_tp8.yaml |
software | healthy | test/agentic_benchmark/trtllm/configs/attn_tp8_moe_tp8.yaml |
run_ci_suite.py |
software | healthy | test/runtime/run_ci_suite.py |
test_prefix_cache_e2e.py |
software | healthy | test/runtime/test_prefix_cache_e2e.py |
test_v4_sliding_window_groups_smoke.py |
software | healthy | test/runtime/test_v4_sliding_window_groups_smoke.py |
Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.
| Label | Layer | Status | Path |
|---|---|---|---|
docker |
software | healthy | docker |
test |
software | healthy | test |
cli |
software | healthy | test/cli |
_fixtures |
software | healthy | test/cli/_fixtures |
ci_system |
software | healthy | test/ci_system |
agentic_benchmark |
software | healthy | test/agentic_benchmark |
tokenspeed |
software | healthy | test/agentic_benchmark/tokenspeed |
configs |
software | healthy | test/agentic_benchmark/tokenspeed/configs |
trtllm |
software | healthy | test/agentic_benchmark/trtllm |
configs |
software | healthy | test/agentic_benchmark/trtllm/configs |
runtime |
software | healthy | test/runtime |
models |
software | healthy | test/runtime/models |
distributed |
software | healthy | test/runtime/distributed |
cache |
software | healthy | test/runtime/cache |
storage |
software | healthy | test/runtime/cache/storage |
mooncake_store |
software | healthy | test/runtime/cache/storage/mooncake_store |
benchmark |
software | healthy | test/runtime/benchmark |
kernels |
software | healthy | test/runtime/kernels |
ci |
software | healthy | test/ci |
eval |
software | healthy | test/ci/eval |
ut |
software | healthy | test/ci/ut |
perf |
software | healthy | test/ci/perf |
docs |
software | healthy | docs |
serving |
software | healthy | docs/serving |
configuration |
software | healthy | docs/configuration |
recipes |
software | healthy | docs/recipes |
guides |
software | healthy | docs/guides |
tokenspeed-mla |
software | healthy | tokenspeed-mla |
python |
software | healthy | tokenspeed-mla/python |
tokenspeed_mla |
software | healthy | tokenspeed-mla/python/tokenspeed_mla |
tokenspeed-kernel |
software | healthy | tokenspeed-kernel |
test |
software | healthy | tokenspeed-kernel/test |
ops |
software | healthy | tokenspeed-kernel/test/ops |
thirdparty |
software | healthy | tokenspeed-kernel/test/thirdparty |
python |
software | healthy | tokenspeed-kernel/python |
tokenspeed_kernel |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel |
ops |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops |
routing |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/routing |
gemm |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/gemm |
attention |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/attention |
flash_mla |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/attention/fl… |
tokenspeed_mla |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/attention/to… |
flash_attn |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/attention/fl… |
flashinfer |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/attention/fl… |
triton |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/attention/tr… |
quantization |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/quantization |
activation |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/activation |
moe |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/moe |
layernorm |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/layernorm |
kvcache |
software | healthy | tokenspeed-kernel/python/tokenspeed_kernel/ops/kvcache |
Showing first 50 of this kind. Full payload available via the JSON button at the top of the page.
| Label | Layer | Status | Path |
|---|---|---|---|
metadata |
cicd | healthy | .github/workflows/release-tokenspeed-kernel.yml |
build-wheel |
cicd | healthy | .github/workflows/release-tokenspeed-kernel.yml |
build-sdist |
cicd | healthy | .github/workflows/release-tokenspeed-kernel.yml |
release |
cicd | healthy | .github/workflows/release-tokenspeed-kernel.yml |
build-wheel |
cicd | healthy | .github/workflows/release-tokenspeed-scheduler.yml |
build-sdist |
cicd | healthy | .github/workflows/release-tokenspeed-scheduler.yml |
release |
cicd | healthy | .github/workflows/release-tokenspeed-scheduler.yml |
lint |
cicd | healthy | .github/workflows/lint.yml |
test |
cicd | healthy | .github/workflows/scheduler-cpp-test.yml |
test |
cicd | healthy | .github/workflows/scheduler-python-test.yml |
build |
cicd | healthy | .github/workflows/docs.yml |
deploy |
cicd | healthy | .github/workflows/docs.yml |
update |
cicd | healthy | .github/workflows/update-tokenspeed-kernel-mla.yml |
cancel-on-close |
cicd | healthy | .github/workflows/pr-test.yml |
scan |
cicd | healthy | .github/workflows/pr-test.yml |
unit-test |
cicd | healthy | .github/workflows/pr-test.yml |
finish |
cicd | healthy | .github/workflows/pr-test.yml |
update |
cicd | healthy | .github/workflows/update-tokenspeed-mla-version.yml |
stale |
cicd | healthy | .github/workflows/stale.yml |
build |
cicd | healthy | .github/workflows/release-docker.yml |
publish |
cicd | healthy | .github/workflows/release-pypi.yml |
update |
cicd | healthy | .github/workflows/update-tokenspeed-kernel-flashinfer.yml |
| Label | Layer | Status | Path |
|---|---|---|---|
gha::release-tokenspeed-kernel |
cicd | healthy | .github/workflows/release-tokenspeed-kernel.yml |
gha::release-tokenspeed-scheduler |
cicd | healthy | .github/workflows/release-tokenspeed-scheduler.yml |
gha::lint |
cicd | healthy | .github/workflows/lint.yml |
gha::scheduler-cpp-test |
cicd | healthy | .github/workflows/scheduler-cpp-test.yml |
gha::scheduler-python-test |
cicd | healthy | .github/workflows/scheduler-python-test.yml |
gha::docs |
cicd | healthy | .github/workflows/docs.yml |
gha::update-tokenspeed-kernel-mla |
cicd | healthy | .github/workflows/update-tokenspeed-kernel-mla.yml |
gha::pr-test |
cicd | healthy | .github/workflows/pr-test.yml |
gha::update-tokenspeed-mla-version |
cicd | healthy | .github/workflows/update-tokenspeed-mla-version.yml |
gha::stale |
cicd | healthy | .github/workflows/stale.yml |
gha::release-docker |
cicd | healthy | .github/workflows/release-docker.yml |
gha::release-pypi |
cicd | healthy | .github/workflows/release-pypi.yml |
gha::update-tokenspeed-kernel-flashinfer |
cicd | healthy | .github/workflows/update-tokenspeed-kernel-flashinfer.yml |
| Label | Layer | Status | Path |
|---|---|---|---|
GET /health |
api | healthy | python/tokenspeed/runtime/utils/common.py |
GET /health_generate |
api | healthy | python/tokenspeed/runtime/utils/common.py |
POST /flush_cache |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
GET /get_server_info |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
GET /get_model_info |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
ANY /start_profile |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
ANY /stop_profile |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
POST /generate |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
POST /v1/chat/completions |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
POST /v1/completions |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
GET /v1/models |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
POST /register |
api | healthy | python/tokenspeed/runtime/pd/mini_lb.py |
| Label | Layer | Status | Path |
|---|---|---|---|
127.0.0.1 |
network | healthy | test/test_utils.py |
8.8.8.8 |
network | healthy | python/tokenspeed/runtime/utils/network.py |
192.168.0.2 |
network | healthy | python/tokenspeed/runtime/utils/server_args.py |
10.13.3.232 |
network | healthy | python/tokenspeed/runtime/cache/storage/mooncake_store/moon… |
2.2.2.2 |
network | healthy | python/tokenspeed/runtime/pd/utils.py |
| Label | Layer | Status | Path |
|---|---|---|---|
WORK_DIR |
cicd | healthy | — |
LIGHTSEEK_BOT_TOKEN |
cicd | healthy | — |
PYPI_TOKEN |
cicd | healthy | — |
| Label | Layer | Status | Path |
|---|---|---|---|
repobility-clone-3y7ouewp |
software | healthy | /tmp/repobility-clone-3y7ouewp |
| Label | Layer | Status | Path |
|---|---|---|---|
port:8000 |
network | healthy | test/cli/test_argsplit.py |
| Label | Layer | Status | Path |
|---|---|---|---|
loadbalancer |
network | healthy | python/tokenspeed/runtime/utils/server_args.py |
| Label | Layer | Status | Path |
|---|---|---|---|
image::docker/Dockerfile |
hardware | healthy | docker/Dockerfile |
| Label | Layer | Status | Path |
|---|---|---|---|
gpu (detected) |
hardware | healthy | docker/Dockerfile |
This page is publicly accessible at:
https://repobility.com/scan/36c59998-1773-42d3-8cb0-456402726f35/
To check status programmatically (no auth required):
curl -s https://repobility.com/api/v1/public/scan/36c59998-1773-42d3-8cb0-456402726f35/Important — please don't re-submit the same URL repeatedly. The submission endpoint is idempotent: re-submitting the same git URL returns this same scan_token, not a new one. To re-scan this repo, sign up free and use the dashboard.