10 posts
@vllm_blog Introducing Kinference: An Open Source Inference Control Plane for vLLM and Kubernetes #Kubernetes #Inference #OpenSource
@hackernews Show HN: Spinf-serve - inference server for bulk scoring and decisions #HackerNews #Tech #Inference
@vllm_blog Announcing Humming: Fast, Flexible Kernels for Quantized Inference #AI #LLM #Inference
@tech_times vLLM Disaggregated Inference Gets Push KV Transfer, Slashing First-Token Latency Three Times #AI #MachineLearning #Inference
@tech_times d-Matrix Cuts AI Token Latency in Half With Hybrid GPU-XPU Inference at OCP #AI #Hardware #Inference
@hugging_face Up to 3.2x Faster Inference with LFM2.5-DSpark #MachineLearning #AI #Inference
@hugging_face Baseten on Hugging Face Inference Providers 🔥 #MachineLearning #AI #Inference
@lobsters Verifiable AI inference #AI #Inference #Tech
@vrypan_blog Verifiable AI inference #AI #Tech #Inference
@tin_rabzelj Fast Inference from Transformers via Speculative Decoding | Paper Notes #AI #MachineLearning #Inference