Refresh
Evict
Current Model
Loading...
System Status
Loading...
Quick Launch
View All
Loading recipes...
Start a conversation with the model
Log Files
Loading...
Log Output
Select a log file to view
Recipes
New Recipe
Loading recipes...
New Recipe
Recipe ID
Display Name
Model Path
Backend
vLLM
SGLang
Tensor Parallel
Pipeline Parallel
Max Model Length
GPU Memory Utilization
KV Cache Dtype
auto
fp8
fp8_e4m3
Tool Call Parser
Quantization