The Generative AI Race Has a Dirty Secret

Energy source &gt; Energy consumption.<p>Energy consumption is not a bogeyman and we&#x27;ll need to consume vastly more energy if we want to make people richer, healthier and happier.<p>We need to pivot to cleaner sources, so the focus should be on that.<p>Would be great if the journos could stop demonizing the wrong thing.

I kinda hate these articles about the carbon cost of compute- it&#x27;s utterly short sighted, gpt3 is infrastructure that creates huge efficiencies - the cost is a bargain. Not to mention this is like early days and we&#x27;re driving down the costs everyday.

Isn&#x27;t it the case that training a ML model consumes vastly more power than using the trained model for inference?<p>If so, the problem may be somewhat overstated. Training is a dispatchable power load. It can be scheduled for periods of surplus power in regions where surplus power is periodically abundant. Training a ML model could literally follow the sun.

Has someone already made a cryptocurrency that requires that miners train an AI to demonstrate proof of work?