Google announcement:<p><a href="https://cloud.google.com/blog/products/ai-machine-learning/run-gemini-and-ai-on-prem-with-google-distributed-cloud" rel="nofollow">https://cloud.google.com/blog/products/ai-machine-learning/r...</a>
A bit thin on detail, but will this require confidential VMs with encrypted GPUs? (And I wonder how long before someone cracks SEV-SNP and TDX and pirate copies escape into the wild.)
This might be a great way for them to strengthen their model through federated learning.<p><a href="https://federated.withgoogle.com/" rel="nofollow">https://federated.withgoogle.com/</a>
Curious if this was forced on Google Cloud by Sundar, or was it something that Google Cloud as an org wanted to do?<p>At first glance, it seems Google Cloud might lose some revenue from customers who can now deploy Gemini in-house. On the other hand, it's not a complete loss, since presumably Google Cloud is still involved in providing some underlying tech? Not to mention, some customers would never consider using off-premises setup anyway.
I don't understand how Google is willing to do this but won't sell TPUs to other days centers. It should be obvious from Nvidia's market cap that they're missing a huge opportunity.
Is Gemini tied/benefitting from Google TPU hardware? Because you need hardware in the data center to run this, and I feel it is somewhat specialised.
It's still an advertising company you're doing business with.<p>I mean, would you buy cookies from a brand that is known for producing rodenticides?
I believe these are pure word tricks to suggest privacy without actually delivering it.<p>As context, you need to remember that Google deleted their "Don't Be Evil" motto and became a defense contractor. The customer will most likely receive a black box owned and set up by Google. That means they have no way of knowing if the system inside is phoning home or being remote controlled by an US government agency, or not. You can then say that the model is hosted in your own data center, which might make some people feel good, but using it with personal information is still a violation of the GDPR.<p>If Google, however, would make these boxes fully offline capable and I was also allowed to wipe all hard disks myself before returning it, that would convince me of their good intentions.