daniel's blog
1 min read

In browser LLM inference

Model: Qwen2.5-0.5B-Instruct-q4f16_1-MLC