Can Vector Supercomputing Be Revived?

Better programmable gather&#x2F;scatter (like described here: <a href="https:&#x2F;&#x2F;www.nextplatform.com&#x2F;2017&#x2F;09&#x2F;14&#x2F;shedding-light-dark-bandwidth&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.nextplatform.com&#x2F;2017&#x2F;09&#x2F;14&#x2F;shedding-light-dark-...</a>) can definitely open up a wider range of applications to vectorization.

More generally, I&#x27;d really like &quot;real&quot; vector ISA&#x27;s to become mainstream [1]. We&#x27;ve suffered from the scourge of packed-SIMD long enough, thank you very much.<p>ARM SVE, RISC-V V extension, and indeed to an extent AVX-512 look pretty good.<p>[1] Not saying that every chip must dedicate a huge portion of the die area to a monster vector unit, I&#x27;d just like the ISA to be there so programmers and compilers can target it.

It’s very very very tough to compete with the economies of scale and ecosystem with modern GPU computing.<p>Vector supercomputing doesn’t need to be “revived”, it is already here.

Those mining memory-bandwidth-hard cryptocurrencies, like zcash, may consider evaluating these. According to the article, they’ll have 1200 GB&#x2F;s, vs 900 GB&#x2F;s for the top nVidia Volta card. (Of course, it’s quite likely that this increase in memory bandwidth isn’t worth it for reasons of cost, ISA suitability for the particularities of Equihash, etc., but hard to say without a lot of thinking-through.)

I found it fascinating that NEC&#x27;s new vector machine is now vector accelerator&#x27;s on PCIe cards. First, this reminds me of how early vector processors were add-ons to existing processors. I wonder if that changes the programming model (compared to the sx-9&#x2F;ace or cray j90s) and how.

Vector engines really suffer from numerical stability problems, so for certain kinds of problems, you&#x27;ll get wrong answers (but at least you&#x27;ll get them fast).