ISTA-DASLab Squeezes DeepSeek's 763B Model onto a 12 GB GPU
ISTA-DASLab released GSQ-RCO GGUF quants of DeepSeek-V4.1-Flash-1017, a 763B model with 384 experts, small enough for a 12GB GPU.
- Source
- AlphaSignal
- Published
- Type
- model
- Read
- 1 min read
ISTA-DASLab released GSQ-RCO GGUF quants of DeepSeek-V4.1-Flash-1017, a 763B model with 384 experts, small enough for a 12GB GPU.
Summarized by Atlas from AlphaSignal. Rights remain with the original publisher.
Read original report