Omarchy

Omarchy Will Hand Freed GPU Memory Back to the System on the DGX Spark

Leave a comment

DHH merged a pull request on Nov. 18 that makes Omarchy on NVIDIA GB10 machines like the DGX Spark give freed GPU memory back to the system right away, Omarchy Central reports. The culprit is a feature of NVIDIA’s 615 driver that keeps freed memory in its own page pools and only releases it under memory pressure. On GB10, GPU memory is system RAM, so after stopping a 100 GiB local model, 106.7 GiB stayed parked in the driver’s pools.

The fix matches NVIDIA’s own DGX OS by setting NVreg_EnableSystemMemoryPools=0 on GB10 machines only. New installs get it from a new hardware step; existing machines get a migration that writes the modprobe option, rebuilds the boot image and asks for a reboot. It’s coming in the next Omarchy version.

My take

Good catch, and the right kind of fix. But the PR is honest that the change had “not yet run on a Spark” when it was merged, and the thing to watch is whether model load times suffer without the pools. If you’ve got a Spark, reboot after the update and check /proc/meminfo and your load times before you call it done.

God Bless, and Needs Garlic!

References & Further Reading

Subscribe (RSS) Follow Omarchy via RSS

Leave a note

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.