Built a tool solve the nightmare of chunking tables in PDF vs. Markdown
Stop using static chunk sizes. A lightweight, production-ready RAG ingestion toolkit. Uses Docling for layout-aware parsing and applies smart heuristics for optimal chunking (PDF vs Code vs MD). Extracted from a production RAG platform. After years of frustration with how LLMs handle complex documents, especially PDFs with tables, I decided to build a solution myself.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
RAG-chunk
github.comA CLI to test RAG chunking strategies
Chonkie
github.comA Fast, Lightweight Text Chunking Library for RAG
AutoRAG
github.comAutoML tool for RAG. Find an optimal RAG pipeline
RAGBuilder
github.comHyperparameter tuning on various RAG parameters
FastGraphRAG
github.comBetter RAG using good old PageRank