Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP
Article URL: https://piszczek.pl/blog/qwen38-27b-256k-50-tps-24gb-gpu
Comments URL: https://news.ycombinator.com/item?id=49331607
Points: 9
# Comments: 2
💡 AI analysis provides alternative perspectives on current events