🔥 Trending today
JetBrains Mellum 2: a really good and performant model
r/LocalLLaMA top day5 days agoBenchmarkA r/LocalLLaMA user shared informal impressions of JetBrains Mellum 2, focusing on local coding-style tasks and tool calls. On an AMD Radeon RX 7900 XT with llama.cpp Vulkan and 131K context, the model reportedly generated around 111 tokens/s and stayed above 100 tokens/s near full context. The author stresses this is not a scientific benchmark, but a practical workflow-oriented test.
在單一 AMD GPU 上使用 ROCm 運行類似 ChatGPT 的聊天機器人
Hugging Face Blog1,126 days agoTutorialThis blog post from Hugging Face provides a detailed walkthrough of how to deploy and run an open-source ChatGPT-like chatbot on a single AMD GPU using AMD's…