TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

My Raspberry Pi cluster

131 点作者 hardmath123将近 9 年前

16 条评论

VLM将近 9 年前
I&#x27;m not OP but I&#x27;ve done this stuff on and off for two decades and I thought I&#x27;d toss out some answers.<p>About 20 years ago I got started using a dozen or so surplus Pentium75 desktops and by combining the working parts and best&#x2F;largest parts I ended up with eight or so nodes with a reasonable amount of memory and local storage.<p>A write up would have been pointless it was pretty much standard like you&#x27;d read in any linux magazine of the era.<p>I used one of the PBS options for batching and some homemade stuff to rip audio CDs to mp3 in a distributed manner and completely unproductively fooled around with PVM and MPI. In the old days PVM was stable and easy to use although MPI was predicted to be the wave of the future. In fact today PVM is pretty much dead and everyone uses MPI or the ever popular NIH homemade stuff. &quot;Back in the old days&quot; we did things like spawn off ray tracing jobs semi-manually with bash scripts and perl scripts. You&#x27;d write perl that output animated povray files given a frame number and then queue up like 120 ray tracing jobs and then stack them into video and thats how you got a minute of bad ray traced animated movies. Not being much of an artist my animated ray tracing was limited to bad physics demos like mirrored ball bouncing. As most other cluster ops do I calculated a lot of &quot;X+1&quot; and &quot;Is X a prime&quot; to test. Like most screwing around, honestly I just turned a lot of KWh into heat.<p>The wife acceptance factor was incredibly low. Although admittedly I&#x27;m still married, to the same awesome woman even. Eventually I got rid of all the machines. But for a year or two it was a lot of fun. I thought the noise level was bad... then I replaced all the boxes with dell towers a few years later that sounded like jet engines. Then IBM 1U rackmount servers P4 surplus around 2010-ish which did a pretty awesome job of running LXC before containerization became &quot;cool&quot;. Portability ha ha ha the size of a closet in the middle of my home office, looks like an organized disaster zone. Really looking forward to building a pi cluster to screw around with that&#x27;ll fit in a shoebox with room to spare. OMG I could build a toy cluster so small I could drop it into my desk drawer when I&#x27;m not playing... Oh if I had more time this summer I&#x27;m feeling the urge to build another cluster...<p>Power doesn&#x27;t matter as long as the circuit breaker doesn&#x27;t pop. At one point I figured I was burning 1100 watts using the dell towers (and yes the room does get warm) which implies running 24x7 would cost me $1100&#x2F;yr (which is very cheap compared to a training class or many other hobbies, but I digress) however I suspect I never powered up that cluster more than maybe 300 hours. I spent 10x more money on a then new technology 100 meg ethernet switch than I did on the power the system used. Back in the dinosaur era we mostly used hubs which were unswitched one big broadcast region, probably sounds very weird to modern young kids.<p>I can&#x27;t even begin to list all the stuff I learned. The jump from admin&#x27;ing one unix box to admin&#x27;ing a cluster is almost as big as the jump from being an appliance user to being a cluster admin.<p>What I didn&#x27;t learn was the scalability problems of having 10000 nodes, having less than ten generally, I did a lot of setup by hand. Although I did all the OS level stuff automation like homemade scripts, puppet, etc. A lot of cluster admin is related to the &quot;fun&quot; of physical hardware support for 10000 individual boxes and I miss out on that. Also running 24x7 how do you handle dusty air filters or whatever at that scale for day to day operation? Power failure recovery must be non-trivial.<p>Its hard to say &quot;well I&#x27;d never have gotten job X except for...&quot; because I might have anyway. As a hobby its been tangentially tied in with my day job on and off since at least the turn of the century.
评论 #12150587 未加载
评论 #12153196 未加载
评论 #12150920 未加载
评论 #12150589 未加载
benologist将近 9 年前
<a href="https:&#x2F;&#x2F;pi-hole.net&#x2F;" rel="nofollow">https:&#x2F;&#x2F;pi-hole.net&#x2F;</a> is my favorite pi software, it&#x27;s network wide DNS server for ad blocking which I supplement with a bunch of privacy&#x2F;security lists from <a href="https:&#x2F;&#x2F;github.com&#x2F;StevenBlack&#x2F;hosts" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;StevenBlack&#x2F;hosts</a>. 5% of my traffic was blocked today which is heaps considering it&#x27;s counting mountains of requests to eg Dropbox&#x27;s API.<p>It even ran powered straight off my router&#x27;s usb port, although I just put in a VM now: <a href="https:&#x2F;&#x2F;github.com&#x2F;benlowry&#x2F;pihole-extended-hosts" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;benlowry&#x2F;pihole-extended-hosts</a>
评论 #12148888 未加载
评论 #12148105 未加载
web007将近 9 年前
I&#x27;m still hoping for someone to build a SBC like the RPi that takes POE for power. USB is convenient for general use, sure, but for something like this cluster it would be ideal to have a single wire in and out.<p>Unfortunately it&#x27;s probably a chicken-and-egg thing, where POE is too expensive until a lot of boards support it, and boards won&#x27;t support it because it&#x27;s too expensive.
评论 #12147941 未加载
评论 #12149408 未加载
评论 #12148217 未加载
chj将近 9 年前
Cheap maybe, but if you really use Raspberry Pi a lot, you will find that Pi isn&#x27;t that robust after all. I installed 20 of them two years ago, so far at least replaced 4 of them during the time. Can&#x27;t comment on the recent models though.
评论 #12147973 未加载
评论 #12147654 未加载
AstroJetson将近 9 年前
I want one of these Pi Zero Motherboards, but there has been no update by the company since January<p><a href="http:&#x2F;&#x2F;hackaday.com&#x2F;2016&#x2F;01&#x2F;25&#x2F;raspberry-pi-zero-cluster-packs-a-punch&#x2F;" rel="nofollow">http:&#x2F;&#x2F;hackaday.com&#x2F;2016&#x2F;01&#x2F;25&#x2F;raspberry-pi-zero-cluster-pac...</a><p>Like others, I have a stack of Pi systems doing file storage, DNS ad blocking, webservers, home control monitoring, XMBC, etc. A clean mount would be cool
评论 #12149051 未加载
评论 #12149124 未加载
white-flame将近 9 年前
Instead of always stacking these, with shelves and&#x2F;or individual standoffs between the boards, wouldn&#x27;t it be cheaper and easier to just hang them, using some longer horizontal metal rods going through all the boards&#x27; mounting holes?
评论 #12149404 未加载
_b8r0将近 9 年前
I have a Pi Zero-based 8 node MPI cluster (4 Zeroes, 1 Pi2) that I set up using 8086 Consulting&#x27;s Clusterhat. In total it gets about 454 Gigaflops, or roughly the speed of a Pentium 4, or maybe two Raspberry Pi 2s.<p>It&#x27;s my 3rd beowulf, but the first that fits in my hand and runs over USB. I use it mostly for exploring fractal space and attempting to (but usually failing) to approximate pi.<p>Both problems are well suited to doing something in the slow lane. We know Pi to trillions of places, so there&#x27;s little benefit in a fast machine to calculate it to billions. It&#x27;s more a great exercise learning problem solving approaches.<p>So far I&#x27;ve managed to get a working monte-carlo based approximation across the node, but it&#x27;s a terrible approach to approximating pi to anything more than a few places. I&#x27;ve also had some luck with implementing ramanujan-type formulae, and am still working on implementing chudnovsky in distributed forms within the bounds of the zero&#x27;s RAM limitations.<p>On the fractal side I&#x27;ve only really had time to look at mandelbrot, but I&#x27;m looking forward to using it to render animations for julia and to explore henon attractors.<p>[1] - <a href="http:&#x2F;&#x2F;clusterhat.com&#x2F;" rel="nofollow">http:&#x2F;&#x2F;clusterhat.com&#x2F;</a>
mcculley将近 9 年前
&gt;One big thing is to make sure atime is disabled, a massively brain dead feature inherited from 1980s Unix that writes to the disk every time you read from a file.<p>That&#x27;s not a fair criticism of the atime feature. There are lots of use cases where it is desirable.
dxxvi将近 9 年前
I will be very happy if I can plug a laptop charger to a RPi and much happier if 2 RPi&#x27;s can share the same laptop charger.
评论 #12148627 未加载
评论 #12148628 未加载
nixisfun将近 9 年前
It is an Ethernet switch not a hub. The author should look into running something like a rocks cluster.
napperjabber将近 9 年前
Nice. Need to see more hardware posts here. Please though, improve the depth of the language.
kylek将近 9 年前
As far as computing power it&#x27;s for sure useless, but tag on some kind of wiring hardness&#x2F;breakout board for the GPIO pins and a redundant power supply and you might have a nice cheap platform to build a control system around.
frik将近 9 年前
SETI@home style &#x2F; GRID-computing could be used to run jobs on numerous idle Raspberry PIs (the location doesn&#x27;t matter aka no cluster setup needed).
signa11将近 9 年前
This kind of stuff is what erlang lives for. Perhaps that might be something to consider ? But then again, running a couple of vm&#x27;s is way better.
评论 #12148806 未加载
CaptSpify将近 9 年前
Weird that none of the prices he lists are the same when I go to amazon or newegg.
评论 #12147395 未加载
DKnoll将近 9 年前
Alternatively titled: &quot;How to build a desk toy that functions better as a conversation piece than a practical replacement for a Hyper-V&#x2F;Xen lab&quot;
评论 #12150566 未加载
评论 #12147345 未加载
评论 #12147070 未加载
评论 #12147059 未加载
评论 #12147116 未加载
评论 #12147174 未加载