Show HN: Shoehorn – Quantize any model down to run on your machine

Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so far. https://github.com/notactuallytreyanastasio/shoehorn
Comments URL: https://news.ycombinator.com/item?id=49346135
Points: 5
# Comments: 2
Related Markets
All MarketsMarket data may be delayed. Not financial advice.
💡 AI analysis provides alternative perspectives on current events