Young children would rather explore than get rewards

Overall, this style is what Montessori-schools of teaching believe and how they operate. Essentially a self-exploratory based learning style.<p>There&#x27;s lots of benefit in letting kids simply explore. As a parent, I find I have to stop myself from pushing my child to the &#x27;best&#x27; result and let them be. That it&#x27;s okay to pick a less optimal solution.<p>Where I find this alarmingly true is when outcome&#x2F;results are negative (usually ending in pain). &quot;Don&#x27;t stand like that on the chair.&quot; &quot;Climb in this way&quot; &quot;Don&#x27;t eat that dirt, soap, car, whatever!!&quot;<p>I know my job as a parent is to guide while keeping them safe at the same time letting exploration happen, but man sometimes it&#x27;s just so hard. For example, letting my child explore while walking home can make a 5 minute walk take 10, 15 minutes longer.<p>Such things tend to be at odds with what I want but it is more important than myself.

Isn&#x27;t this the children solving the multi armed bandit problem?<p>In a child&#x27;s mind, they haven&#x27;t yet fully decided how things behave and react, so they are willing to try things to see if they&#x27;ve changed (because in fact often they do in their own mental models, as well as the resolution of those models.<p>If you think of it as a regression tree, their models start out fairly shallow and then slowly get deeper as they age. That&#x27;s a square thing. That&#x27;s a book. That&#x27;s a book about animals. That&#x27;s a book about marine animals. That&#x27;s a book about marine animals that I like. That&#x27;s a book about whales.<p>In trying to solve the multi armed bandit, they&#x27;re willing to explore to try to find better rewards because in their own world there are often better rewards.<p>If the game shifted to having a different alien be the best one half way through the game, I&#x27;d be curious how quickly the more maturely cognitive kids did. It&#x27;s possible that becoming fixated on something (the way adults are) can ultimately limit your abilities in a game. In adulthood, &quot;creative&quot; solutions can sometimes be better than more &quot;standard&quot; solutions, but incur more risk.

While the study classifies it as exploration and claims an intrinsic reward that will die out later in life, I would describe the behavior as novelty-seeking.<p>I&#x27;d wager that for adults, a game on a screen is just not new enough. But if you&#x27;d give adult males a choice of which female to undress, I&#x27;m pretty sure they would value &quot;exploration&quot; very highly again.<p>In a similar vain, when smartphones were new, the adult population was very active at buying new ones, comparing, and exploring the market. Now that we&#x27;ve had them for some years, phone upgrades have become a necessity and a lot less exciting.<p>So my theory would be that there is no loss in the intrinsic motivation, there is a loss in the amount of novelty.<p>If that is correct, then our school system is actually very appropriate even for highly intrinsically motivated kids, because they are introduced to new topics and areas of knowledge that are (hopefully) new to them.<p>That also aligns with my personal experience. While I hated getting up early and the concept of sitting in a chair just listening, I was excited about all the different things they showed me. And I liked best the teachers that would mention slightly irrelevant side details just for the fun of it.

Well ya. I&#x27;ve found at middle age that I&#x27;m most interested in connection and transcendence, finding meaning and such. When one realizes that material things truly are valueless compared to things like consciousness, friendship, love, dignity, etc etc etc, then everything else falls away. I often find myself realizing that I am looking at the world with the same childlike wonder I had when I was 5. To me, this search for meaning was what the 1960s was all about, as well as every other cultural renaissance and era of spiritual awakening.<p>Which makes the conceptual basis of things like economics suspect. The idea that humans are motivated by monetary rewards and material things turned out to be false. So did concepts like scarcity, reciprocity, commoditization, and so on. Those things worked at one time, up until the middle of the last century and dawn of the information age (where technology surpassed what was required to meet humanity&#x27;s basic needs), but now actively inhibit human evolution IMHO.<p>So how to fix the mess we&#x27;re in? I think it starts with questioning basic assumptions. Sadly, American culture seems to be racing away from that as fast as it can in these times. Dunno about the rest of the world.

For anyone interested in this type of stuff, I can recommend reading <i>Drive</i>.<p>Briefly, human behaviour can be motivated for extrinsic and intrinsic reasons. The rewards in this article are extrinsic motivators. Exploring is rewarding in an intrinsic way; it is a strive towards autonomy, mastery, and purpose.<p>In adults (and in older children) applying extrinsic motivators kills intrinsic motivation. Once the extrinsic motivators stop coming in, there is no desire left to do the task. Intrinsic motivation is practically infinite, as long as the environment is set up right to enable it.<p>Extrinsic motivation also tends to produce behaviour that does the bare minimum to get the reward (or avoid the negative consequences) whereas intrinsic motivation is what makes us want to excel.<p>Of course, I&#x27;ve skipped many important points and not countered any counterargument here, but I recommend reading Drive first if you think you disagree.<p>But the worst part of it all?<p>The schooling system, with its grades, signed slips, and whatnot, is set up through extrinsic motivation to teach obedience, conformity, and smothering the intrinsic drive so necessary for the creative work we will expect from the children later in life.

I guess I must have bever lost the child in me. I&#x27;ve been a fan of open world games, just so I can roam the world. I sometimes dont even play the storyline at all. I still don&#x27;t like that Steam added &#x27;achievements&#x27; that I can&#x27;t turn off, I&#x27;ll be in charge of what constitutes a goal thank you very much :)<p>Another poster had an interesting observation about academia vs corporate work. I&#x27;m 33 and still in academia, and I now realize a large part of that is the freedom it provides. I&#x27;ve see salary as a score on someone else&#x27;s scoreboard, and very uninteresting for that reason. OK, I&#x27;m old enough to have experienced a person needs income for practical reasons, but I&#x27;m not going to work for it ;)<p>I&#x27;m allergic to competition, scores, rewards, prestige, I guess that makes me child-like?

I&#x27;m reminded of a paper about an AI system with curiosity. Basically, the AI would learn to predict the effect of its actions, and would prefer to take actions where its prediction error was large. That way it would gather more data about stuff it didn&#x27;t know yet.<p>This works well to learn to play video games without defining an extrinsic reward. However, there is a problem when the system encounters the equivalent of TV. It then gets stuck watching the unpredictable stream of events.<p>paper and code: <a href="https:&#x2F;&#x2F;pathak22.github.io&#x2F;large-scale-curiosity&#x2F;" rel="nofollow">https:&#x2F;&#x2F;pathak22.github.io&#x2F;large-scale-curiosity&#x2F;</a><p>Coverage by &quot;2 minute papers&quot; youtube channel: <a href="https:&#x2F;&#x2F;youtu.be&#x2F;fzuYEStsQxc" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;fzuYEStsQxc</a>

Has anyone heard of Sudbury Valley schools?<p>Peter Hartkamp started one in the Netherlands, and wrote a book about it.<p><i>“Our current education systems do not trust children to learn what they need to know. Governments believe that children must be coerced into learning what they prescribe as necessary for future life even though they do not and cannot know what that future will be like. Yet we do know that coercion produces anxiety and fear of failure and that this in turn inhibits learning and destroys confidence. We also know that creativity, innovation and empathy are not encouraged in such a climate even though above all else these are the survival qualities for coping with an uncertain future.<p>In this short book Peter Hartkamp develops his arguments against coercive ‘education’ with a needle-sharp engineer’s logic. He invites us to imagine what schools would be like if they took the articles of the UN Convention on the Rights of the Child seriously, a not unreasonable position as all states are signatories.<p>I wholeheartedly and without reservation recommend this book to the many parents, students, teachers, employers and policy makers who know in their hearts that something is very wrong with the examination and testing factories that we are allowing our schools to become. It represents a beacon of hope that another way is possible.”</i> [1]<p>[1] <a href="http:&#x2F;&#x2F;hetgedwongenonderwijsvoorbij.nl&#x2F;en&#x2F;" rel="nofollow">http:&#x2F;&#x2F;hetgedwongenonderwijsvoorbij.nl&#x2F;en&#x2F;</a>

This video shows a slime mold doing exploration&#x2F;discovery and then exploitation: <a href="https:&#x2F;&#x2F;m.youtube.com&#x2F;watch?v=GwKuFREOgmo" rel="nofollow">https:&#x2F;&#x2F;m.youtube.com&#x2F;watch?v=GwKuFREOgmo</a><p>Relating it to the article, it seems we function in a similar way to the mold, but our balance between exploration and exploitation changes as we grow up.<p>Also reading other comments, it seems like different people have different balances or proportions between the exploration&#x2F;exploitation modes. I personally am very imbalanced towards exploration; exploitation makes me demotivate and stop doing very quickly.

This is completely expected. If you look at multiarmed bandits, getting rewards would be exploiting and the other option is exploring. If you have a longer time horizon as children will, it is better to explore and find a better return than exploit something already known which is likely to be suboptimal.

There is an interesting relation to this with regard to reinforcement learning (RL) where the trade-off between exploration and exploitation is one of the fundamental issues. Systematic or structured exploration has shown some success here as well.<p>What &#x27;structured&#x27; means here deeply depends on the representation the agent has of the world, i.e. which states and actions are similar to each other. Current RL setups typically learn such representations on the go. Abstractions can be very powerful here.<p>Arguably, people also perform structured exploration on learned representations. It may be the case that the adults have learned a representation of the &#x27;game&#x27; and their lies little exploratory value in suboptimal actions.

For those interested in this topic i recommend reading about the Montessori method.<p>The basic idea of the Montessori philosophy of education is that every child carries within him&#x2F;her the man&#x2F;woman he&#x2F;she will become. In order to develop the physical, intellectual, and spiritual powers required for this task to the fullest, there must be freedom—freedom to interact with a prepared environment.

Academia and Corporations.<p>Academics are dealt with as we do kids i.e. they are protected and allowed to explore. Corporations exploit what has already been explored for reward - without the reward there is nothing protecting them.

Exploration as the primary algorithm continues as long as we continue to get increasing variable rewards from it. When the rewards tapper off or we are pressured for money, we choose the maximum we&#x27;ve found so far. This instinct to collect options has probably served us well in foraging for food, picking a mate, and any other exploration endeavor that involves finding the best of a range of newly available options.<p>However it may also be the root of gambling addiction and any other variable rewards game systems. Gambling, lotteries can also become more attractive the more you are pressured for money - one could argue as a means of concentrating on your most approachable local maximum.

We use a variation of this &quot;four squares&quot; game at Sparkademy. The four squares of randomized point values (there&#x27;s a pattern to it, but I don&#x27;t want to give it away here.) The goal is to maximize your score which involves switching between exploring for a better payoff and exploiting what you think is the highest paying square over a large number of trials. We use it to as part of a criteria to identify if a person might be well suited for our innovation online course, and later be able to apply that knowledge in their company.

Still holds true as an adult for me at least.<p>It’s just that “survival” takes away too much time and energy from exploration.

&gt; But while adults then used that knowledge to maximize their prizes, children continued exploring the other options, just to see if their value may have changed.<p>I think it is not just &quot;semantics&quot; to consider that for children the reward is simply the rush of playing instead of what the researchers design as the intended award. And frankly speaking this is not at all a surprising result. Children learn through playing and they very much enjoy that process.

The &quot;exploring&quot; is because they&#x27;re told to make a choice. Is there something similar to developing object permanence but with abstract concepts or probabilities that happens after that age?<p>And the abstract is here: <a href="https:&#x2F;&#x2F;onlinelibrary.wiley.com&#x2F;doi&#x2F;10.1111&#x2F;desc.13026" rel="nofollow">https:&#x2F;&#x2F;onlinelibrary.wiley.com&#x2F;doi&#x2F;10.1111&#x2F;desc.13026</a>

Read: exploration is rewarding.

Anyone have access to the paper? As far as I can tell, the young children were perfect convex utilitarians, in deciding that more than &quot;enough&quot; stickers were not worth the more fun of clicking around.<p>How were the adults rewarded? Did they also get something intrinsically valuable at the end of the experiment, or did they just collect virtual points because they were told they were supposed to?<p>Working dogs have been specialised by breeding for overexpression of the various initial phases of the wildtype hunting sequence: herding, retrieval, etc. Does &quot;sex sells&quot; indicate we may have been bred to overexpress the &quot;identify attractive potential partner&quot; and &quot;do things they (appear to) like doing&quot; phases of the wildtype reproductive sequence?

This is by no means limited to young people; I much prefer video games where I can keep discovering things to the tedious business of performing tasks or winning beating bosses.

TIL I mostly think like a 4-year-old.

Seems like further evidence that nature has developed an optimal algorithm for solving the multi-armed bandit problem as it manifests in the typical environment humans evolved in. Unlike the artificial games used by the researchers, there is no such thing as a fixed reward in nature—everything is subject to change unexpectedly. Children are wired with an algorithm that heavily favors exploration in light of the dynamic environment.

If OP&#x27;s premise is true, I wonder how much that is changing now that parents are throwing electronics at their children. Many of the things that they get to interact with on an electronic aims to optimize rewards. Will this shape generations that are always in search of quick hits and less interested in the exploratory nature of things? How will something that seems to small as a parent reshape the children and society?

For people interested in this topic I highly recommend reading about summerhill school [1] and similar projects. The topic of alternative schooling systems is quite fascinating.<p>[1] <a href="https:&#x2F;&#x2F;en.m.wikipedia.org&#x2F;wiki&#x2F;Summerhill_School" rel="nofollow">https:&#x2F;&#x2F;en.m.wikipedia.org&#x2F;wiki&#x2F;Summerhill_School</a>

Exploring is its own reward apparently.

Reading between the lines, as we grow up, we get conditioned to follow instructions, rather than act independently.<p>For the adults, there&#x27;s no incentive to maximise how many virtual candies they collect, beyond doing it because they were told it was the aim.

As a kid, exploring was, and remains a reward.<p>Someone to help, share in it, make more possible? Golden.

Monkeys do the same thing:<p><i>Many non-human animals show exploratory behaviors. It remains unclear whether any possess human-like curiosity. We previously proposed three criteria for applying the term curiosity to animal behavior: (1) the subject is willing to sacrifice reward to obtain information, (2) the information provides no immediate instrumental or strategic benefit, and (3) the amount the subject is willing to pay depends systematically on the amount of information available. In previous work on information-seeking in animals, information generally predicts upcoming rewards, and animals’ decisions may therefore be a byproduct of reinforcement processes. Here we get around this potential confound by taking advantage of macaques’ ability to reason counterfactually (that is, about outcomes that could have occurred had the subject chosen differently). Specifically, macaques sacrificed fluid reward to obtain information about counterfactual outcomes. Moreover, their willingness to pay scaled with the information (Shannon entropy) offered by the counterfactual option. These results demonstrate the existence of human-like curiosity in non-human primates according to our criteria, which circumvent several confounds associated with less stringent criteria.</i><p>Paper: <a href="https:&#x2F;&#x2F;www.sciencedirect.com&#x2F;science&#x2F;article&#x2F;abs&#x2F;pii&#x2F;S0010027719300642" rel="nofollow">https:&#x2F;&#x2F;www.sciencedirect.com&#x2F;science&#x2F;article&#x2F;abs&#x2F;pii&#x2F;S00100...</a><p>Non-paywalled version: <a href="https:&#x2F;&#x2F;www.biorxiv.org&#x2F;content&#x2F;biorxiv&#x2F;early&#x2F;2018&#x2F;03&#x2F;29&#x2F;291708.full.pdf" rel="nofollow">https:&#x2F;&#x2F;www.biorxiv.org&#x2F;content&#x2F;biorxiv&#x2F;early&#x2F;2018&#x2F;03&#x2F;29&#x2F;291...</a>

This has surprising similarities with data science theory: multi-armed bandit with a decreasing-epsilon strategy (children) or an epsilon-first strategy (adults).

That’s why we train them to want rewards first, then use that to get them to do what we want

I can attest to this.<p>I tried offering my toddler a thousand dollars. She preferred to blow bubbles.

Some adults do as well, they are the ones who usually discover be things...

Science proving things that people already know anyway, as usual.

Interesting; Wish adults do the same;

Man I thought this was obvious!

Young people of any age

What does this say about Capitalism and the accumulation of wealth?

Offtopic but regarding the supression of the child from the parent: few people realize how severely the large majority of parents damage their children and supress their innate creativity and drive.<p>This is also very hard to realize as an adult because it gets unconsiously supressed.<p>The following books opened my eyes at the fact how dangerous it is for the grown up adult to then keep thinking &quot;yeah, but my parents did the best you could you know?&quot; even though they completely destroyed his innate creativity and freedom.<p>Alice Miller: The Drama of the Gifted Child<p>Alice Miller: The Body Never Lies<p>TLDR version of these books is that a large majority of parents tried to mold them as children and fit them into boxes or supressed their needs and wants as children and never truly listened to them. This then causes uncousious guilt&#x2F;anxiety&#x2F;etc... feeling in the person as adult and prevents him from &quot;taking oportunities&quot; etc..<p>And at the core of the issue is the forced-upon-us belief that we always have to respect our parents, even though we secretely hate them. Saying &quot;yeah but they did something good for me you know&quot; is actually a huge problem that will only keep us from seeing the fact that many in fact do not like&#x2F;love their parents very much because the parents did not truly listen to them etc...<p>As long as we try to weight the good vs the bad moments we will relapse into the false indoctrinated compassion&#x2F;guilt towards our parents, into denial of the cruelties we experienced as a child, all because people say that we should try to &quot;balance the good vs the bad&quot;. But this does not work in practice. This balancing process seems to be a reflection of how we tried to cope as children to survive. The adult must reject this balancing process because it only causes confusion without resolving anything. Many people when they break contact from parents feel guilty and think even more about their own parents: the &quot;experts&quot; and her parents have reinforced the indoctrinated belief in this person that &quot;this individual has no right to his own life, feelings and needs.&quot; It was this desire of the child to believe that the parents were good that led to these supressions because the child blamed himself. This is why when a therapists says &quot;try to see the good&quot; it will only cause great harm. regression and confusion: since it was this need of the child to &quot;try and see the good&quot; in his parents when there was none that caused these issues in the first place.<p>So anyone who even slightly suspects that their parents supressed him as a child and denied him freedom of expression etc... will find many answers in those books above.

One thing neither this article nor the linked study measure is if there is a difference in this behavior between boys and girls. I looked through the actual article to see if there was a statement that said if there was a statistical difference between the two or not, but although they do specify the numbers for the genders of the participants in the study, none of the analysis does any comparison between the genders.<p>It would be fascinating to see if there are gender differences in this behavior in childhood and adulthood and compare childhood and adulthood.