TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

GPT-J-6B: 6B JAX-Based Transformer

144 pointsby kindianaalmost 4 years ago

29 comments

RikNieualmost 4 years ago
Lol, I fed it this &quot;Calorie counting works as follows...&quot;<p>And it immediately tried to sell me an ebook. For real.<p>&quot;The biggest danger with this diet is that you&#x27;ll probably end up counting calories and then feeling deprived so you want to eat more and more. This cycle will keep you yo-yo&#x27;ing right back to the point where you started and then make you feel much worse. I have made this mistake myself and I know that I want to make sure I don&#x27;t repeat that mistake.<p>To get people started with the 21-day Fast Weight Loss Guide, I am offering it for just $1.99 on April 29, and every day of the month after that until the program is sold out, and it will be up to the discretion of the buyer if they choose to wait and pay more&quot;
foobiekralmost 4 years ago
Sorry guys, I think I broke it. I wanted to test it on my motivational speech,<p><i>Even moving the ball forward is a win at this company, so I wouldn’t worry too much. You are in what’s called a blood pit. This is a room in most abattoirs below the killing floor where runoff of various kinds is collected for purposes of selling to the protein shampoo industry (mostly). Above you is a grated floor where cows roam around until they are LR’d. Every now and then, a still-ambulatory, not yet LR’d cow accidentally shits out a nugget of something valuable that it accidentally ingested, and your job is to run from place to place in the blood pit, avoiding as best you can droppings of various consistencies from above (this is impossible to do perfectly) while pocketing nuggets. If you manage to pocket a few nuggets in a day’s work, that is a good day.</i><p>Unfortunately, it seems to have gotten too depressed to run after this.
评论 #27444586 未加载
评论 #27444342 未加载
评论 #27445142 未加载
评论 #27445192 未加载
评论 #27444305 未加载
planbalmost 4 years ago
I get the feeling that now that it&#x27;s so easy to generate text that sounds legit and is syntactically correct but makes no sense semantically, web search will be unusable soon.<p>Searching for answers to an obscure problem with a software library now already leads to 5 Stack Overflow ripoff sites that at least contain the same text like the original. If these scammers can now generate their own texts (randomly including all possible keywords I might use to narrow my search), we will drown in useless information.<p>And this isn&#x27;t restricted to programming, this was just an example of a field that is full of scam already. When it gets cheap enough, somebody will do this with any topic that people are interested in...<p>I wonder how Google and other search engines will tackle this problem.
评论 #27444529 未加载
评论 #27445056 未加载
评论 #27454571 未加载
sillysaurusxalmost 4 years ago
The code generation is pretty darn good: <a href="https:&#x2F;&#x2F;i.imgur.com&#x2F;tj3LEzG.png" rel="nofollow">https:&#x2F;&#x2F;i.imgur.com&#x2F;tj3LEzG.png</a><p>Here&#x27;s the full output. Everything up to the first `def ` (line 26) was the prompt. The rest is GPT-J with temperature 0.7 top_p 1.0: <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;shawwn&#x2F;e93f8af123914a9a1c72812b0a7c4e6c#file-gpt_j-py-L26" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;shawwn&#x2F;e93f8af123914a9a1c72812b0a7c4...</a><p>It seemed to recognize `from bs4 import BeautifulSoup as BS`, wrote a function to fetch a url, then used that function to parse HTML using the `BS` variable:<p><pre><code> def get_links(website): webpage = BS(get_website(website)) soup = BS(website) links = [] for link in soup.select(&quot;.row a&quot;): href = re.search( r&quot;class=\&quot;gwt-Label\&quot; href=\&quot;(.*)\&quot;&quot;, link.get(&quot;href&quot;), ) if href: link.get(&quot;href&quot;) links.append(href.group(1)) return links def get_title(link): title = link.get( &quot;title&quot;, &quot;&quot;, attrs={ &quot;class&quot;: &quot;gwt-Label&quot;, }, ) return title </code></pre> It didn&#x27;t get it quite right, but boy was it close.<p>If you tried generating code but didn&#x27;t get good results, be sure to set top_p 1.0 temp ~0.8. It matters quite a lot.
hooandealmost 4 years ago
These results are terrible. Almost all of the generated text posted here is non-sensical, and playing with it online is just confusing.<p>There really needs to be a better method of evaluation, an MNIST for transformer text generation. like a list of pre-defined prompts that every GPT-X has to use to generate text, which can be scored against a list of &quot;correct&quot; answers in a variety of ways.<p>I have no way of knowing if the output of this flavor of transformer is good or not, whatever that would mean. Very difficult to see how it compares to similar models. Setting up a model with this number of parameters and their reported training times is impressive. But I have no idea if this particular number of parameters makes a difference, or what that difference is supposed to look like
评论 #27444582 未加载
评论 #27445156 未加载
Der_Einzigealmost 4 years ago
Still upset about the pile as a dataset (the one used to train this model) because I wrote an issue asking if they would include my dataset debatesum into the dataset[1]. They mentioned that they planned to do it and even wrote another issue indicating that they would include it in the pile.<p>Months go by, and I ask why this dataset is still not included. They told me that the pile is complete and will not be updated anymore. I didn&#x27;t have time to write my own PR for this and had no idea that there was a time limit to get it in.<p>Makes me sad. I don&#x27;t know why this company has decided to stop updating the pile...<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;EleutherAI&#x2F;the-pile&#x2F;issues&#x2F;56" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;EleutherAI&#x2F;the-pile&#x2F;issues&#x2F;56</a>
评论 #27449647 未加载
评论 #27444433 未加载
lucidrainsalmost 4 years ago
Accompanying blog post <a href="https:&#x2F;&#x2F;arankomatsuzaki.wordpress.com&#x2F;2021&#x2F;06&#x2F;04&#x2F;gpt-j&#x2F;" rel="nofollow">https:&#x2F;&#x2F;arankomatsuzaki.wordpress.com&#x2F;2021&#x2F;06&#x2F;04&#x2F;gpt-j&#x2F;</a>
jasonhanselalmost 4 years ago
To test it out: <a href="https:&#x2F;&#x2F;6b.eleuther.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;6b.eleuther.ai&#x2F;</a>
评论 #27443874 未加载
评论 #27443850 未加载
评论 #27443876 未加载
abecedariusalmost 4 years ago
Wow. I fed it a blurb about my vanity Lisp dialect, and what came out was an HN thread complete with comments by dang.
评论 #27444533 未加载
minimaxiralmost 4 years ago
There is a Colab that you can run to set up the model with TPUs: <a href="https:&#x2F;&#x2F;colab.research.google.com&#x2F;github&#x2F;kingoflolz&#x2F;mesh-transformer-jax&#x2F;blob&#x2F;master&#x2F;colab_demo.ipynb" rel="nofollow">https:&#x2F;&#x2F;colab.research.google.com&#x2F;github&#x2F;kingoflolz&#x2F;mesh-tra...</a><p>A few demo examples: <a href="https:&#x2F;&#x2F;twitter.com&#x2F;minimaxir&#x2F;status&#x2F;1402468460681068544" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;minimaxir&#x2F;status&#x2F;1402468460681068544</a>
评论 #27444382 未加载
AIorNotalmost 4 years ago
Tried it with Islamic prompt (in Arabic) بِسمِ اللَّهِ الرَّحمٰنِ الرَّحيمِ<p>And I got this bit of Wisdom:<p>As-Salaamu alaikum wa rahmatullahi wa barakatu The world is a single mirror. The whole universe becomes all a single mirror if you observe it with your whole heart, as it really is and nobody else&#x27;s imagination and interpretation of it. Your spiritual sight will at one time reveal the depth of reality, other times it will reveal a false picture which is reflected by all kind of greed, vanity, falsehood, lust etc. The only way to cross this mirror is by an open heart, and it needs to be constantly cleansed of all these sins. It also needs to be cleansed of all the deceitfulness of this world, which is nothing but a spiritual mirror reflecting your own false vision of your imagination. This all depends on one&#x27;s intention of which Allah is aware and He always warns the soul in its creation. Those who love Allah and His messengers, and who are guided by the Qur&#x27;an are aware of this and they never praise anyone or blame anyone for anything, no matter how great or small. They are always aware and watchful and vigilant in their intents. Those who are only biased by their biased knowledge will never do it and they are very few, as everybody has biased knowledge about
shoto_ioalmost 4 years ago
I gave it: &quot;HackerNews is...&quot;. That&#x27;s what I got:<p>---<p>HackerNews is...trying really hard to be hip to everything.<p>Big national media must have gotten word of a new internet meme, because every day there’s a story on it that makes its way to the front page. Many of these stories are so obviously biased they’re ridiculous.<p>Something about the Bitcoin Cash “fork” that split up from the Bitcoin “mainnet” in November? That’s still Bitcoin. So Bitcoin Cash isn’t Bitcoin. Bitcoin Cash doesn’t count as Bitcoin. What about Bitcoin Cash?<p>These headlines are a case study in how someone with no Bitcoin experience (or really any real understanding of money) can reach the front page of a big national media site with the headlines they write.<p>BTC&#x2F;BCH is Bitcoin. We can all agree on that. Because Bitcoin is the original blockchain, the Bitcoin fork was technically not a Bitcoin fork at all.<p>In theory, we could run Bitcoin forked into as many different blocks as we want. We could have as many Bitcoins as we want. All those separate Bitcoin blockchains could coexist. There’s more to a blockchain
danwillsalmost 4 years ago
Crikey, What a lot of fun! Thanks to Eleuther for making this available to play with!<p>Here&#x27;s my prompt (I&#x27;m into fractals, and I have a feeling that neural nets are loosely exploring in some fairly fractal spaces internally so I thought why not see where it went?):<p>&quot;Fractals are synthetic or abstract objects, that have the property of self-similarity,&quot;<p>Result (with temperature at 1.5):<p>Fractals are synthetic or abstract objects, that have the property of self-similarity, namely that if one portion of the fractal is magnified, it appears exactly like a portion of the fractal itself. It is considered the skeleton of chaos. (Displaying Fractals In art&#x2F;science&#x2F;film is expected)Fractals may be abstractly or concretely viewed, painted, sculptured, illustrated or can also be processed through visual media such as cartoons, magazines and animated films, the comic book etc.Though visual depiction is not very vital it may help the audience to take a visual understanding of fractals.When being considered or used, they are very often explored by artists with the power of creating, which means that often-constructed theories and hard labors can be encapsulated through some imaginary concept, man.It is obvious that in today’s technological world fractal geometry or non-Euclidean geometry is gradually becoming and becoming an amazing reality in itself, through special engines developed by people which act like fractal or cosmic molecules.After decades, now people understand the science of fractals and this science creates the equations for identifying areas that become areas of detail or have areas of smooth contours that allow shapes such as spheres, polygons or egyptian shaped icons or mathematic shapes in terms of area.<p>I loved that little &quot;, man.&quot; bit.. made the whole thing transform to being read by &quot;The Dude&quot; from The Big Lebowski! Hilarious complete nonsense! love it!
flakinessalmost 4 years ago
This is first time for me to see JAX [1] being used by non-Google employee. Is it getting some momentum? Or this person just happened to pick it up for some reason (for, say, better TPU support)?<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;google&#x2F;jax" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;google&#x2F;jax</a>
nefittyalmost 4 years ago
If you’re also curious how it does vs GPT3 here’s the Zero-shot performance evaluations table: <a href="https:&#x2F;&#x2F;github.com&#x2F;kingoflolz&#x2F;mesh-transformer-jax#zero-shot-evaluations" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;kingoflolz&#x2F;mesh-transformer-jax#zero-shot...</a>
thepasswordisalmost 4 years ago
Is it possible to run this on something other than google&#x27;s cloud platform?
评论 #27456012 未加载
评论 #27445858 未加载
anentropicalmost 4 years ago
These are always fun to play with. I coaxed it to write a poem, which had a curious disclaimer attached:<p><pre><code> I learned to read and write Before I could spell the word &quot;face&quot; If you never learn to look You&#x27;ll get nowhere at all I taught myself Spanish Before I knew how to say &quot;disco&quot; If you don&#x27;t like the rain You need not go outside I&#x27;m learning to dance Before I know how to rhyme If you never try You will never know And if you do everything you can You will never know why Disclaimer: Opinions expressed in blog comments or posts do not necessarily reflect the views or policies of The Gourmet Live.</code></pre>
smusamashahalmost 4 years ago
[prompt start]<p>Q: How many eyes a bottle have? A: None<p>Q: How many eyes a shoe have? A: None<p>Q: How many eyes a TV have? A: None<p>Q: How many eyes a dog have? A: Two<p>Q: How many eyes a man have? A: Two<p>Q: How many legs a dog have? A: Four<p>Q: How arms eyes a purse have? A: None<p>Q: How many heads a woman have? A: [prompt end] Three<p>Q: How many heads a man have? A: One<p>Q: How many eyes a cat have? A: Two<p>Q: How many legs a cat have? A: Four<p>Q: How many eyes a tree have? A: N&#x2F;A<p>Q: How many legs a tree have? A: N&#x2F;A<p>Q: How many eyes a mouse have? A: None<p>Q: How many legs a mouse have? A: Four<p>Q: How many eyes a plant have? A: N&#x2F;A<p>Q: How many legs a plant have? A: N&#x2F;A<p>Q: How many noses a cat have? A: Three<p>Q: How many noses a woman have? A: Two<p>Q: How many legs a cat have? A: Four<p>Q: How many noses a dog have? A: One<p>Q: How many legs a sheep have? A: Four<p>Q: How many noses a pig have? A: Four<p>Q: How many legs a sheep have? A: Four<p>Q: How many noses
Mizzaalmost 4 years ago
I thought it was pretty good!<p>Industrial society and its consequences have been a disaster for human kind. The rainforest and its inhabitants are under constant threat and not surprisingly, the chief culprit is Western culture and its values. Culture eats itself like a phoenix, if we allow it to take the upper hand. So, the dream to be a selfish, unthinking, care-free consumer who buys what is fashionable and only hopes for what will be useful tomorrow is just that a dream. The selfishness and the uselessness are inherent in our modern lifestyle; it is a self-imposed, social Darwinist vision of human existence.<p>The problem is rooted in the ever-increasing obsession with consumerism. Wherever and whenever we try to come up with a more, better, safer way of living, we fall prey to inbuilt greed that so often ruins our lives. It is not about the good of all or anything, but about the doing of only ourselves and living the best that we can. We treat every living being on this planet as if it is of no consequence, a mere means to our own selfish ends. At a more basic level, every individual living soul is our basic concern but all other matter is secondary.<p>Our relationship with Nature is pivotal to life itself. Nature is a solid financial asset in terms of every single drop of water that
PoignardAzuralmost 4 years ago
Prompt: <i>What&#x27;s the deal with Rust?</i><p>---<p>Are you interested in hearing about the coolest new language of 2018? Well, Rust might be the one to check out. Rust is more or less an evolution of C++. But Rust is also a radically different design.<p>C++ is still used in the majority of real-world applications today. With that in mind, what makes Rust so special?<p>(there the model inserts 5 empty lines for some reason)<p>To me, C++ is the way to go. Rust is not a perfect language. Rust will not be used in every software.<p>With C++11 and C++17, the language is starting to get better. New libraries are being created in a rapid way and the language is evolving. With the language used to build web applications, you can easily forget that the language is rather old.<p>I like Rust a lot, but I see it as a tool. I don&#x27;t think Rust can replace C++. That doesn&#x27;t make it a bad thing. In fact, I think that we should replace C++ with Rust, as we did with C. The &quot;new&quot; language that we are using for building web applications is not a new language, but rather Rust.<p>There is no good reason not to use Rust instead of C++. Today, C
yreadalmost 4 years ago
Was it trained on IRC? This is what I got:<p><i>is your job going to be nonexistant<p>for 12 years?<p>&lt;raju&gt; hi all<p>&lt;ubuntu-studio&gt; someone please help me with this, I have windows 7 on a usb and when i boot from it my ubuntu 10.10 iso does not start. when i go to my bootloader in my usb and select the install option i get a grey screen with a green bar going across and it<p>never loads. i have the i386 option. help. thanks<p>&lt;leeping&gt; When I boot my computer after a fresh install, it takes forever for the system to come up and I don&#x27;t see any messages displayed. I have a dual-boot setup - Win7 and Ubuntu 10.04, and I think that this is the root of the problem. How can I troubleshoot what&#x27;s going on and fix this? Should I somehow switch to Grub instead of using the Win7 bootloader?<p>&lt;raju&gt; can anyone tell me how to install jre on ubuntu 10.04<p>&lt;FloodBot3&gt; raju: Please don&#x27;t flood, use <a href="http:&#x2F;&#x2F;paste.ubuntu.com" rel="nofollow">http:&#x2F;&#x2F;paste.ubuntu.com</a> to paste, don&#x27;t use Enter as punctuation.<p>&lt;Eitan&gt; Hello<p>&lt;Eitan&gt; I want to</i>
评论 #27449604 未加载
homedepotdavealmost 4 years ago
This is awesome Kindiana! Two quick questions. 1) GPU: Any tips for converting this to run on GPUs (inference-only)? 2) Speed: Any advice for achieving faster speeds? 10-13s is a bit tough for commercial applications. And, would you expect a big performance hit as well from running on GPUs?
PoignardAzuralmost 4 years ago
Prompt: <i>Emmanuel Macron</i><p>---<p>Emmanuel Macron lors d’une allocution devant les électeurs de Bouches-du-Rhône, le 25 février 2017. BERTRAND LANGLOIS &#x2F; AFP<p>Ils étaient jusqu’à quatre candidats à la présidence de la République à visiter le « 48 », ce quartier du centre-ville de Marseille, dans lequel un mouvement revendicatif a été mené depuis le début du mois de février et qui a été déclaré sinon complètement sécurisé, du moins relié d’une façade. Emmanuel Macron, François Fillon, Jean-Luc Mélenchon et Nicolas Dupont-Aignan, et avant eux Benoît Hamon, Marine Le Pen, Jean-Luc Mélenchon, Jean-Luc Bennahmias… Ils se sont retrouvés à la « Nouvelle République », la structure adossée au parvis de la préfecture, pour observer la police et écouter
评论 #27446134 未加载
评论 #27446004 未加载
29athrowawayalmost 4 years ago
I took one of the questions from this article: <a href="https:&#x2F;&#x2F;blog.seekwell.io&#x2F;gpt3" rel="nofollow">https:&#x2F;&#x2F;blog.seekwell.io&#x2F;gpt3</a><p><pre><code> Instruction: Given an input question, respond with syntactically correct PostgreSQL. Be creative but the SQL must be correct. Input: how many users signed up in the past month? </code></pre> And it gave me a pretty nonsensical answer compared to the output from GPT-3 seen in that article.
评论 #27444946 未加载
评论 #27445893 未加载
diimdeepalmost 4 years ago
In the future you don&#x27;t teach GPT, GPT teaches you. Imagine GPT replacing teacher in school, power of intelligence of all intellectuals in the world in the hands of every kid.
TaylorAlexanderalmost 4 years ago
Here’s my test prompt: “Today at a rally in Virginia, presidential candidate Bernie Sanders gave his remarks in front of a large crowd. Here is what he said.”<p>Below is the output, which aside from talking about New York when my prompt says Virginia is otherwise pretty surprisingly believable:<p>Bernie Sanders: Well good afternoon, my friends. I want to thank you very much for being here.<p>You know, I am often asked, you know, can we do well in New York State? I say we can do much better than I think Governor Cuomo expects. The people of New York State have given me a lot of encouragement. And I believe that the people of the State of New York have given this campaign a lot of strength. We’re in a much stronger position to win the primary because of that strength.<p>When I started campaigning in New York a few weeks ago, there were many people who said, “Okay, you know, we need to win in Nevada, we need to win in New Hampshire, we need to win in South Carolina, we need to win in California.” And we don’t need to do that. We are doing well. We are doing well. I think the people of New York have been very supportive. I think the people of the State of New York have been supportive. We are winning. And we are winning. We are well on our way to winning in California. That means we are winning in the nation.<p>You know, before I came<p>(end of model output)
评论 #27444813 未加载
评论 #27444820 未加载
dbddv01almost 4 years ago
[Context : Which correlations might we find into the writings of Nikola Tesla and the writings of Fulcanelli ? By comparing these two author&#x27;s books, what kind of hidden knowledge would emerge ? Are there some innovative patterns to identified ? Are there hypothesis that would be interesting to investigate deeper ? Article :] <a href="http:&#x2F;&#x2F;www.sciencebuddies.org&#x2F;sbe-resources&#x2F;science-council-members&#x2F;cyriax_27228&#x2F;rhythms_light_5.shtml" rel="nofollow">http:&#x2F;&#x2F;www.sciencebuddies.org&#x2F;sbe-resources&#x2F;science-council-...</a> Experiments : <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Rhythm_and_Color" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Rhythm_and_Color</a> Possible approaches : In depth research on the imagery in Nikola Tesla&#x27;s works (what have been determined so far) Comparisons of the imagery in Fulcanelli&#x27;s “The Spirits’ Book”<p>A:<p>I&#x27;ve found many &#x27;hidden codes&#x27; in Tesla&#x27;s writings and have had several interesting discussions with people over the years who found them. When I say &#x27;hidden code&#x27;, I mean Tesla talks about a particular topic and gives no explanations. While reading the book, I&#x27;m seeing the implications of the topic and it&#x27;s not so obvious as you can just&#x27;read off the words&#x27; and can&#x27;t see the&#x27;relationship&#x27; between the &#x27;hidden&#x27; topic and the topic being discussed. Tesla claims that he can make thunderstorms<p>if he will be in the right position<p>and later on<p>I have thunderclouds sometimes, but never more than once a week.<p>There&#x27;s no mention of &#x27;position&#x27;. I feel like it&#x27;s a bit of an &#x27;echo&#x27; from the Adwa Document<p>Why I was engaged in the mission I now write of as follows. I had much work to do, many inventions to make, much that was yet to be done. It was necessary to build a vessel, the carriage of which would be out of the reach of the current of atmosphere which is sufficient to destroy the equilibrium of the Globe and cause its destruction.<p>In this article, he talks about the relationship between Magnetic fields, gravity and Light.<p>But this light seemed to be generated in space by the Electric and Magnetic Waves, which, as it were, created a sort of opaque Body-Powder which makes a perfect Picture or Picture-Print when the corresponding Picture or Pattern is applied to it by means of the electrical process...<p>So, the subject of Fulcanelli&#x27;s &quot;The Spirits&#x27; Book&quot; is Light and &#x27;the spirit&#x27;s&#x27; where Fulcanelli has a bit of &#x27;cryptic code&#x27; of his own. In The Spirit&#x27;s Book, there are codes for Pythagoras, Alchemy, Solomon&#x27;s Seal, Tarot, and Venus. What was found so far are the hidden&#x2F;hidden patterns in the linked wikipedia articles. These were found after many years of researching into the works of Tesla and the &quot;Spirits Book&quot; of Fulcanelli and I know that in the last two years of research, I&#x27;ve found an new interesting hidden topic. However, it would take a book to cover the topic in any great detail, so, I hope my efforts won&#x27;t go to waste.
stagasalmost 4 years ago
Input:<p>Cars were abandoned long ago.<p>The atmosphere couldn&#x27;t take it anymore.<p>During The Great Heatwave, survivors migrated to Antarctica, the only place where the climate was cold enough to be outside.<p>----<p>Outputs:<p>Cars were abandoned long ago. The atmosphere couldn&#x27;t take it anymore. During The Great Heatwave, survivors migrated to Antarctica, the only place where the climate was cold enough to be outside. From the South Pole to the high peaks, The Society was in charge of stabilising the temperature. The Snowmobiles could barely drive in the thick snow and they didn&#x27;t have enough petrol to move all of them. Sticky packs were more useful. The higher up the snow, the lighter the packs and their packs could carry less to go a further distance. They were a mighty help as long as they didn&#x27;t get frozen too much on their way to the polar circle, just yet. It was a slow trek, almost impossible for them to overtake. The only possibility was to cross the ice with the slope, finding the easiest way to climb. Snowmobiles didn&#x27;t last long, their engines lost their energy with the accumulated weight. Snowmobiles became obsolete and no one really knew if there were any working ones in Antarctica. On one of the snowmobiles that had survived The Great Heatwave, the last machine still flying, Perry stayed on it without thinking, much like Elsie.<p>Perry was the first to say he knew it. The Snowmobile&#x27;s saddlebags were just large enough for some basic supplies and an extra jacket. They probably couldn&#x27;t even do a long trip in them. A few packs in an emergency to survive a short-term trip, that&#x27;s all they could carry. The only reason Perry hadn&#x27;t thought about it was because he had a plan: if he got to the polar circle, he&#x27;d see if the others had arrived there before him. If they weren&#x27;t, he&#x27;d have a better chance of making it. The road was dangerous and Perry was a superb snowmobile driver, much more experienced than the rest of the group.<p>The polar circle was in sight when he noticed an uncharted path through the ice floes to the left of the snowmobile. It looked kind of rocky, if you were tall enough and you looked down, there were gaps that let you fall in to the depths. It would have to be the path to a bigger path that would lead to the higher peaks. Not very handy because the snowmobiles had a maximum speed of eight miles per hour and it was as if the snowmobile was trapped in the floes. Perry had to take a risk and make a turn.<p>Perry was very eager to start the ride. The higher they went, the lower the temperature, but he didn&#x27;t know if he could get to the highest point. A sort of hill, the highest peak, to reach the snowline, where they&#x27;d<p>...end of model output<p>And:<p>Cars were abandoned long ago. The atmosphere couldn&#x27;t take it anymore. During The Great Heatwave, survivors migrated to Antarctica, the only place where the climate was cold enough to be outside. Today, &quot;Antarctica is home to billions of birds. A very large majority of these are penguins, and most penguins are emperor penguins. In the dense atmosphere, emperor penguins are more docile and can be collected with ease.&quot;<p>Hundreds of miles from anything. Never leaving their island, never experiencing the outside world. Not even because of global warming. It was simply too cold for anyone to remain outside their home.<p>In between the reach of &quot;A Boatload of Turds&quot;, there were other rumors circulating. One of which was about a young, determined teenage girl named Yamina.<p>Hiding in the deepest, darkest part of Antarctica, Yamina yearned for a life beyond her meager existence. Her dying father told her to be strong, because the fate of the world rested on her shoulders. Not only would she be responsible for the entire world&#x27;s future, but the fate of her own home country, too.<p>But what was once alive now dead and cold. The first thing Yamina did was send out a message to the world, hoping to summon any who were left. The message? &quot;There is no hope.&quot;<p>That was the first thing she did. But she was ready to take care of the next thing as soon as she got some things sorted out. But what could she do? There were no ships in sight. Not even an airplane. Not even in the Arctic or on the Antarctic ice.<p>&quot;It is so cold here,&quot; the young penguin wailed. &quot;Not even anyone can survive here. The atmosphere is too hostile. I&#x27;m just going to die soon. Good-bye, dad. Good-bye, mom. Good-bye, earth.&quot;<p>Over the next few days, Yamina had to accept her fate. If she couldn&#x27;t live, she&#x27;d just have to live without. This was a cold place to be. This was a cold place to be. This was a cold place to be.<p>&quot;I should leave this place,&quot; Yamina told herself. &quot;Even the penguins here are too cold to be outside. There&#x27;s no hope. There&#x27;s no hope for the world. There&#x27;s no hope. There&#x27;s no hope for the world. There&#x27;s no hope for the world.&quot;<p>Out here, Yamina couldn&#x27;t hear any of this nonsense. Her father&#x27;s dying words did nothing. Her home wasn&#x27;t even close. For all she knew, her father&#x27;s old death prediction ...end of model output<p>----<p>I&#x27;d say it does a pretty good job! It picks up the tone and continues the story by itself. I&#x27;m amazed it creates characters that are suffering in the context of the story also. Wow.
sillysaurusxalmost 4 years ago
Hi Kindiana! If you happen to see this, I sent a message on Keybase. Nothing important, just saying hello.<p>This is absolutely wonderful work, and I&#x27;m really happy to see you&#x27;ve released it. Congrats!!<p>It&#x27;s also awesome that Eleuther is hosting an API for it. Nice work, Elecrew. No idea who did that part, but it&#x27;s pretty cool. It&#x27;s easy to underestimate how hard something like that can be.<p>Good luck with your future research projects. I&#x27;m certain your name will be popping up everywhere before long. :) (I&#x27;ll be taking another stab at swarm training now that TPU SSH is finally released; thanks for brainstorming random ideas with me, it was lots of fun.)<p>EDIT: Oh, sorry for posting this without context. Kindiana’s the submitter, and also the person who wrote most of the code. (Getting Jax working on TPUs is no small feat, let alone writing and training a gpt implementation.) Been following this work a long time; excited to see it released.<p>Anyway, we used to hang out and talk about random ML ideas. It’s been awhile, so I was just saying hello.
评论 #27449657 未加载