Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.
TensorSharp
github.com
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
오픈소스
비슷한 프로덕트
설명이 비슷한 순
OpenCursor
Open-source Cursor-like AI coding agent for VS Code - agentic chat, multi-provider LLMs (OpenAI, Ollama, llama.cpp), semantic search, and MCP support
TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
TensorRT-Edge-LLM
High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI
Jlama
A fast Java inference engine for GPT and Llama models
I built a tensor library from scratch in C++/CUDA
Tensor library & inference framework for machine learning
