Interested in this too
Honestly, after frying the port on my old ultrabook with a cheap generic hub a few years back, I’ve become super picky about what I plug in. My curren...
For your situation, 8GB is *practical*, just not “set it and forget it.” - Inference: 7B-ish LLMs in 4-bit usually fit fine; biggest wall is KV cache...