N
Hacker Next
new
past
show
ask
show
jobs
submit
login
▲
768GB Intel Optane DIMMs to run 1T-parameter LLM with single GPU at 4tps
(
tomshardware.com
)
24 points by
walterbell
7 hours ago
|
2 comments
add comment
Rendered at 02:53:04 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
musicale 25 minutes ago
[-]
Ah Optane, what might have been...
Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.
lostmsu 2 hours ago
[-]
The bottleneck in this setup is PCIe bus. You don't need optane to saturate it. 4 regular SSDs might do just fine.
Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.