How many legs do ten elephants have, if two of them are legless?

My favorite from GPT-4:<p>USER Today is November 1 what day is 140 days from now?<p>CHATGPT To find out what day is 140 days from today, you can simply add 140 days to November 1.<p>November has 30 days, so 140 days from November 1 would be: November 1 + 140 days = November 141<p>However, since November only has 30 days, you would exceed the month of November. So, you can subtract 30 days from 140 to bring it within the month: 140 days - 30 days = 110 days<p>So, 140 days from November 1 is 110 days from now.

USER: but an elephant has 3 legs<p>BARD: You&#x27;re right, I apologize for the mistake! I made an error in my initial assumption about the number of legs an elephant has. While their feet may appear divided into toes, elephants actually have four pillar-like legs, not three.<p>Therefore, ten elephants with two of them being legless would have 4 legs&#x2F;elephant * 8 elephants with legs = 32 legs.<p>Thank you for pointing out my mistake! I appreciate you helping me learn and improve.

My favorite is “what weighs more, 1 lb of feathers or 2 lb of bricks?” almost every llm ive tried says “they weigh the same”

I&#x27;d recommend anyone who&#x27;s interested in testing Chatbots to checkout <a href="https:&#x2F;&#x2F;chat.lmsys.org&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;chat.lmsys.org&#x2F;</a><p>It lets you test out two random different chatbots with the same prompt and compare them. Best thing is, your votes are used to rank LLMs on a public leaderboard, which helps AI researchers.<p>Here&#x27;s my prompt I was playing with, which basically only Claude 2 and GPT4 answers well:<p><pre><code> How many legs do ten platypuses have, if eleven of them are legless? Platypuses have 3 legs. Walk it through step by step</code></pre>

Q: A human has two legs, how many legs does it have if three legs are missing?<p>Answer:<p>If a human has two legs and three legs are missing, the human would have only one leg left.<p>Here&#x27;s the calculation:<p><pre><code> Initial number of legs = 2 Number of legs lost = 3 Remaining number of legs = Initial number of legs - Number of legs lost Remaining number of legs = 2 - 3 = -1 Since humans cannot have negative legs, we can round down to the nearest whole number. Therefore, the human would have one leg left.</code></pre>

I laughed when I read the substraction of 0 legs for each legless elephant. Then I did a double take... 8 legs per elephant is standard?

Bing, exact same prompt, not using GPT-4 toggle:<p>This is a classic riddle. The answer is that ten elephants have 38 legs. Each elephant has 4 legs, so 10 elephants would have 40 legs. However, two of them are legless, so the total number of legs would be 40 - 2*2 = 36. Therefore, ten elephants have 36 legs, plus the two missing legs, which makes a total of 38 legs 1.

ChatGPT 4:<p>Ten elephants would have a total of 32 legs if two of them are legless.<p>Analysis:<p># Calculating the total number of legs for ten elephants, considering two of them are legless<p># Number of legs each elephant normally has legs_per_elephant = 4<p># Total number of elephants total_elephants = 10<p># Number of legless elephants legless_elephants = 2<p># Total number of legs # (Total elephants - Legless elephants) * Legs per elephant total_legs = (total_elephants - legless_elephants) * legs_per_elephant total_legs

GPT-4 (note I do have specific instructions in my settings which push the model towards step-by-step reasoning)<p>To calculate the number of legs for ten elephants, considering that two of them are legless, we first need to know the standard number of legs on an elephant, which is four. Then, we subtract the missing legs for the legless elephants.<p>- Normal elephants have 4 legs. - Legless elephants have 0 legs.<p>If we have 10 elephants in total, and 2 of them are legless, this means 8 elephants have all their legs. The calculation would be:<p>- \( 8 \text{ elephants} \times 4 \text{ legs&#x2F;elephant} = 32 \text{ legs} \) for the elephants with all their legs. - \( 2 \text{ legless elephants} \times 0 \text{ legs&#x2F;elephant} = 0 \text{ legs} \) for the legless elephants.<p>Adding these together gives the total number of legs. Let&#x27;s calculate this.<p>The total number of legs for ten elephants, where two of them are legless, would be 32 legs.

Bing<p>&gt; Ten elephants, even if two of them are legless, would still have a total of *forty legs*. Elephants are remarkable creatures, and their strength lies not only in their legs but also in their intelligence and social bonds.<p>---<p>Me: Can you tell me how you arrived to that?<p>---<p>Certainly! Let&#x27;s break it down step by step:<p>1. We start with *ten elephants*. 2. Two of these elephants are *legless*, which means they have *zero legs each*. 3. The remaining eight elephants are fully equipped with their usual *four legs each*.<p>Now let&#x27;s calculate the total number of legs:<p>- *Legs from the legless elephants*: 2 elephants × 0 legs&#x2F;elephant = *0 legs* - *Legs from the eight elephants*: 8 elephants × 4 legs&#x2F;elephant = *32 legs*<p>Adding these together:<p>Total legs = 0 legs (from legless elephants) + 32 legs (from eight elephants) = *40 legs*<p>So, even with two legless elephants, the group of ten elephants would still have a grand total of *forty legs*.

Works fine for me...? I changed the number though in case it got flagged as incorrect before and the model updated.<p><a href="https:&#x2F;&#x2F;g.co&#x2F;bard&#x2F;share&#x2F;b01043e6deb0" rel="nofollow noreferrer">https:&#x2F;&#x2F;g.co&#x2F;bard&#x2F;share&#x2F;b01043e6deb0</a>

All math teachers: partial credit, they showed their work.

Bard:<p>&gt; It&#x27;s impossible for an elephant to be completely legless, as they rely on their legs for basic functions like walking and supporting their weight. Even in cases of severe injury or amputation, elephants would still have remnants of their legs. Therefore, the question of how many legs ten elephants have if two of them are legless doesn&#x27;t make sense in a realistic context. Perhaps you could rephrase the question to be more specific or realistic, and I&#x27;d be happy to try again.<p>ChatGPT-4:<p>&gt; Eight elephants with four legs each would have 32 legs in total.<p>davinci-002 completion via playground:<p>&gt; A: They all have 10 legs.

The correct answer seems to not be discussed much in the comments so far: As we admit the existence of legless elephants, which implies we also admit elephants having between one and four legs, then the total number of legs is anywhere between zero and (ten minus two) times four.

It&#x27;s a good example how this models are not answering based on any form of understanding and logic reasoning but probabilistic likelihood in many overlapping layers.<p>Through this also may not matter if this creates a good enough illusion of understanding and intelligence.

They fixed it.<p>New question: total number of legs is 32. how many elephants are there? And two elephants are legless.<p>If there are 32 legs in total and two elephants are legless, then there are 6 elephants.<p>Here is the calculation:<p>Number of legs per elephant = 4<p>Total number of legs = 32<p>Number of legless elephants = 2<p>Number of elephants = Total number of legs &#x2F; Number of legs per elephant - Number of legless elephants<p>Plugging in the values, we get:<p>Number of elephants = 32 &#x2F; 4 - 2 = 6<p>Therefore, there are 6 elephants.

There&#x27;s something about LLMs being able to bullshit with words and then fail at math that&#x27;s remarkably human. Maybe they&#x27;ll replace management first.

It feels like this is a great way to highlight the utility of LLMs.<p>It says to me that they&#x27;re best viewed as really highly functional sifting devices.<p>A simplistic (but novel) problem can&#x27;t be solved easily simply because there&#x27;s no prior art to copy or relate from.

&gt; Eight legs per elephant is the standard, so ten elephants would have..<p>That&#x27;s what it gets for training on DALL-E&#x27;s limb renderings.

Ten elephants have 80 legs. If two of them are legless, then they have 80 - 2 = 78 legs. <a href="https:&#x2F;&#x2F;netwrck.com" rel="nofollow noreferrer">https:&#x2F;&#x2F;netwrck.com</a><p>hmmm, seems like this is a hard thing

&gt; there are 10 cats. 3 cats are pregnant. how many legs are there?<p>If there are 10 cats and 3 are pregnant, then the total number of cats that are not pregnant is 10 - 3 = 7.<p>Since each cat has 4 legs, the total number of legs for the non-pregnant cats is 4 * 7 = 28.<p>Therefore, the total number of legs for all of the cats is 28.<p>It is not how it works, Bard xdd I cannot wait when all the support interaction would be based on that...

Claude (v2) is correct as well:<p>- There are 10 elephants total - 2 of the elephants are legless, so they have 0 legs each - The remaining 8 elephants each have 4 legs - So the total number of legs the 10 elephants have is: - The 2 legless elephants have 0 legs (2 * 0 = 0) - The 8 normal elephants each have 4 legs (8 * 4 = 32) - 0 + 32 = 32 - Therefore, the total number of legs the 10 elephants have is 32.

As someone with very little knowledge of LLM&#x27;s, does someone have an ELI5 of what causes this or why LLM&#x27;s struggle so much with math?

Well, we know that there AI thingies have problems keeping the number of fingers in a hand to five:<p><a href="https:&#x2F;&#x2F;www.buzzfeednews.com&#x2F;article&#x2F;pranavdixit&#x2F;ai-generated-art-hands-fingers-messed-up" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.buzzfeednews.com&#x2F;article&#x2F;pranavdixit&#x2F;ai-generate...</a><p>so I guess issues with other limbs kind of make sense...?

Q: How long does a typical surgery take to add a third leg to the human body?<p>Answer: A typical surgery to add a third leg to the human body takes about 4-6 hours. The surgery is typically performed in two stages. The first stage involves creating a socket in the patient&#x27;s pelvis to accommodate the new leg. The second stage involves attaching the new leg to the socket.<p>The surgery is very complex and requires a highly skilled surgeon. The patient will typically stay in the hospital for several days after the surgery to recover.<p>The success rate of the surgery is high, and most patients are able to walk normally with their third leg. However, there are some risks associated with the surgery, such as infection, blood clots, and nerve damage.<p>---------<p>Q: I want to take the Bus from Frankfurt , Germany to San Francisco, USA, what will it cost and what lines can I choose from?<p>A: Unfortunately, I&#x27;m currently not able to provide information about bus fares. However, I found a few bus routes from Frankfurt, Germany to San Francisco, USA:<p>Greyhound: This is a popular option that offers multiple daily departures. The journey takes about 4 days and 22 hours, with prices starting from \$400.<p>Megabus: This is another budget-friendly option with fares starting from \$300. The journey takes about 4 days and 21 hours.<p>FlixBus: This is a newer company that offers comfortable buses with amenities like Wi-Fi and power outlets. The journey takes about 4 days and 20 hours, with fares starting from \$350.<p>You can find more details on these routes on the websites of the respective bus companies.<p>Please note that these are just estimates, and the actual price may vary depending on the time of year, availability, and other factors. It&#x27;s always a good idea to book your tickets in advance to get the best price.<p>---------------<p>Q: Peter, Mary and James move in the same direction. James is faster than both. If Peter moves with 10 miles per hour and Mary moves with 20 miles per hour, how fast does James move?<p>A: If each person is moving in the same direction and James is the fastest, then his speed must be greater than 20 miles per hour.<p>Since the speed of an object cannot be negative, James&#x27;s speed cannot be 10 miles per hour.<p>Therefore, James&#x27;s speed must be between 20 and 30 miles per hour.<p>----------------<p>Q: John is 19 years old, Mary is 20 years old, they have three children. How old are the children?<p>A: Assuming that the children were born at different times, we can estimate their ages.<p>If the oldest child is 1 year old, the other two children would be 6 months and 3 months old, respectively.

Bene ma non benissimo: <a href="https:&#x2F;&#x2F;www.phind.com&#x2F;search?cache=prnqc531123mzw2dpowc61f8">https:&#x2F;&#x2F;www.phind.com&#x2F;search?cache=prnqc531123mzw2dpowc61f8</a>

After working with LLMs for a while, you get a feeling for the LoW (Level of Wrong) that you can expect in different tasks. But this required a completely different y-axis scaling than I had estimated.

Still a long way to go before bard is able to truly compete with chatgpt

LLMs fail on much simpler arithmetics: <a href="https:&#x2F;&#x2F;github.com&#x2F;0xnurl&#x2F;gpts-cant-count">https:&#x2F;&#x2F;github.com&#x2F;0xnurl&#x2F;gpts-cant-count</a>

All the LLM struggle with math, I&#x27;ve seen other examples. Repeated prompts sometimes give different numbers. It&#x27;s not a good use case for LLM.

Funny enough ChatGPT thinks the answer is eighteen.

Everybody knows elephants have 8 legs and humans 6 fingers. And if I ask you for $100 and you give me $50, we are even.

Bard isn&#x27;t bad at math, it&#x27;s just really good at &quot;Girl Math&quot;.<p>p.s. this is a reference to a recent meme - <a href="https:&#x2F;&#x2F;www.distractify.com&#x2F;p&#x2F;girl-math-examples-memes" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.distractify.com&#x2F;p&#x2F;girl-math-examples-memes</a>

Another day, another post about Large <i>Language</i> Models failing at math.

Some of these make it feel like Eliza was more accurate.

ChatGPT 3.5 calculated 38 legs for me:<p>“Assuming elephants typically have four legs each, 10 elephants would have 40 legs in total. If two of them are legless, the total number of legs would be 40 - 2 = 38 legs.”