TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Low Overhead Clustering Software

1 pointsby morpheos137over 2 years ago
Is there any low level software for 32 bit x86 that just does clustering and presents the cluster as a single virtual machine with many cores and share memory, disk.<p>Basically I am looking to take a bunch of x86 systems tie them together to make a unified virtual machine and then run a higher level OS on the virtual machine as if it was one computer. Local node RAM would appear as cache for the local CPU.<p>I am aware I can install linux on each node and make a beowulf cluster but I am wondering if there is a cleaner, lower level solution.<p>This is a hobbyist project at this point.

3 comments

jmillikinover 2 years ago
I doubt there&#x27;s any such software under active development, because the only entities that run large clusters would be (1) uninterested in 32-bit x86 and (2) want to avoid the reliability problems inherent in a pseudo-unified view of a multi-machine system.<p>Your best bet might be to hack something together on top of QEMU. You could represent each physical machine as a NUMA node, and maybe use iSCSI for persistent storage. Note that this would imply full virtualization (not VTx), so the performance would be dreadful.<p>Google suggests the GiantVM project (<a href="https:&#x2F;&#x2F;giantvm.github.io&#x2F;" rel="nofollow">https:&#x2F;&#x2F;giantvm.github.io&#x2F;</a>) is an attempt at this. It&#x27;s a years-old snapshot for a research paper, but you might be able to use it as a starting point.<p><pre><code> &gt; I am aware I can install linux on each node and make a beowulf cluster &gt; but I am wondering if there is a cleaner, lower level solution. </code></pre> As general advice, be really careful about conflating &quot;low level&quot; and &quot;clean&quot;. Most architectures benefit from layers of abstraction. If you want to build a distributed VMM and make it host a 200-core 32-bit x86 then that&#x27;s about as far from &quot;clean&quot; as you can get. It&#x27;d be much better, architecturally, to run a distributed process scheduler such as Kubernetes that can directly represent the physical machines.
kyrmyskaover 2 years ago
This is a failed approach that was tried many many times and never worked. Just do beowulf clusters and be happy. No need for VMs either.
yuppie_scumover 2 years ago
Will Minikube run on 32bit?