Hi, I have about 10K$ in startup credits on AWS, I have 1 year left to burn through them<p>I've been trying to get 8 A100 GPUs to run some of the largest LLMs for a while now, but so far all my requests have been denied, I have a quotas of 2x16 vCPUS for P instances, so just enough for 1 or 2 GPUs(and I'm not even sure you can even get one A100 with that...)<p>Did anyone here manage to get a quota increase approved? (especially with startup credits)<p>How did you do it?<p>Thanks
Request a GPU allocation, and use it, request again, etc.<p>Unfortunately it has been like this since around 2020/2021. It's sensible on AWS' side I guess.<p>If you really need them, you won't get credits but there are GPU-specific clouds.