
π Everything about EKS & AI Infrastructure Newsletter "#90" βοΈβ€π¨βπ»
The model gets the headlines. Everything around it decides how fast it runs.
Our Goal is Built a community of self reliant Cloud Architects , tech geeks who are eager to develop and help people around them.

The model gets the headlines. Everything around it decides how fast it runs.
Kubernetes 1.37 on EKS, autoscaling vLLM, sharing GPU clusters across teams, and a GPU plugin upgrade that fails only in production

Isolation and efficiency are turning out to be the same problem β plus a look at what actually breaks GPU inference at scale.

Where agent code runs, how to stop wasting GPUs, and what a token really costs

Memory, cold starts, and what infrastructure keeps forgetting β plus a big week for AWS User Group Vadodara.

Fixing GPU cold starts, catching bad nodes early, and letting agents watch your cluster while you sleep

Every fix this edition starts by admitting where the last one was quietly wrong.

Memory decides what you can serve β and what your agents can be trusted to say.

Asking for a thing and enforcing it are two different jobs.
