Groq®
Hyperfast LLM running on custom built GPUs. An LPU Inference Engine, with LPU standing for Language Processing Unit™, is a new type of end-to-end processing unit system that provides the fastest inference at ~500 tokens/second.
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
InferX: Inference as a Service Platform
Nvidia Blackwell B200 GPU
nvidia.comThe world’s most powerful chip’ for AI
General Compute
generalcompute.comAI models that run on an inference cloud optimized for speed
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training