CIRCLE WITH A DOT

The worms keep worming, unfortunately. The "Mini Shai-Hulud" attack appears to pivot to #PyPi with a compromise of a #pytorch library:https://discourse.ifin.network/t/pytorch-lightning-library-hit-by-supply-chain-attack/357#ThreatIntel #ThreatIntelligence #IFIN #Python

Red Hat and Tesla engineers tackled a real production problem together.3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.This is what open source looks like. https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource