2026-09-30 本地部署Llama-3-70B量化推理全流程
从GGUF量化到llama.cpp服务化,含KV Cache优化与并发压测数据。
从GGUF量化到llama.cpp服务化,含KV Cache优化与并发压测数据。
Welcome to Hexo! This is your very first post. Check documentation for more info. If you get any problems when using Hexo, you can find the answer in troubleshooting or you can ask me on GitHub.
1 | $ hexo new "My New Post" |
More info: Writing
1 | $ hexo server |
More info: Server
1 | $ hexo generate |
More info: Generating
1 | $ hexo deploy |
More info: Deployment