Unsloth -local LLM app rabbithole

Started by rcjordan, Today at 05:34:23 PM

Previous topic - Next topic

rcjordan

Meet Unsloth Desktop - the first desktop app to run and train models : r/unsloth
https://www.reddit.com/r/unsloth/comments/1vli9xs/meet_unsloth_desktop_the_first_desktop_app_to_run/

Unsloth Desktop Features Breakdown : r/unsloth
https://www.reddit.com/r/unsloth/comments/1vlsw7q/unsloth_desktop_features_breakdown/

DeepSeek-V4.1-Flash: Run Locally Guide | Unsloth Documentation
https://unsloth.ai/docs/models/deepseek-v4.1-flash


rcjordan

rabbithole started here:

DeepSeek V4.1-Flash-1017 can now run locally! 🐳

We made 1-bit quants retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).

Run on a 128GB+ RAM device.  <==== RC: AAaaackk!

V4.1 Flash 1017 is the strongest open model to date.

https://bsky.app/profile/unsloth.ai/post/3myais5flhc2t