Unsloth -local LLM app rabbithole

Started by rcjordan, October 19, 2026, 05:34:23 PM

Previous topic - Next topic

rcjordan


rcjordan

rabbithole started here:

DeepSeek V4.1-Flash-1017 can now run locally! 🐳

We made 1-bit quants retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).

Run on a 128GB+ RAM device.  <==== RC: AAaaackk!

V4.1 Flash 1017 is the strongest open model to date.

https://bsky.app/profile/unsloth.ai/post/3myais5flhc2t