Groq®
Hyperfast LLM running on custom built GPUs. An LPU Inference Engine, with LPU standing for Language Processing Unit™, is a new type of end-to-end processing unit system that provides the fastest inference at ~500 tokens/second.
Reactions (1)
Similar products
by description similarity
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
InferX: Inference as a Service Platform
Nvidia Blackwell B200 GPU
nvidia.comThe world’s most powerful chip’ for AI
General Compute
generalcompute.comAI models that run on an inference cloud optimized for speed
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training