Predictive CPU isolation of containers at Netflix (2019)

It seems like we are more and more getting away from OSes managing our resources<p>Runtimes&#x2F;vms implement memory management, varius threading techniques and things like we see here<p>Maybe in the future we will entirely skip OS&#x27;s overhead and run apps directly on HW and they will manager themselves more efficiently (their runtimes&#x2F;vms like jvm clr)

This is amazing, they use ML to predict utilization on the fly

Related:<p><i>Predictive CPU isolation of containers at Netflix using a MIP solver</i> - <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=21116565">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=21116565</a> - Sept 2019 (21 comments)<p><i>Predictive CPU Isolation of Containers at Netflix</i> - <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=20096699">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=20096699</a> - June 2019 (1 comment)

See also ghOSt by Google (2021):<p><a href="https:&#x2F;&#x2F;storage.googleapis.com&#x2F;pub-tools-public-publication-data&#x2F;pdf&#x2F;0ee589331b9bf270b13d40ba09453cde14006869.pdf" rel="nofollow">https:&#x2F;&#x2F;storage.googleapis.com&#x2F;pub-tools-public-publication-...</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;google&#x2F;ghost-userspace">https:&#x2F;&#x2F;github.com&#x2F;google&#x2F;ghost-userspace</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;google&#x2F;ghost-kernel">https:&#x2F;&#x2F;github.com&#x2F;google&#x2F;ghost-kernel</a>

Kind of an old article. It is pretty straight forward thing to do. If you spend enough time accurately load testing your environments you can dial in the container resources and shave thousands of dollars. Lots of places are too scared of under allocating. Limit and request exist for a reason. Limit is for surge and request is what is always guaranteed. It is okay to exceed your request as long as you balance add a scaling policy to balance out the surge. And be cautious with request and limit on memory not all applications benefit from this.