Simple CLI to aggregate repos

papers and docs for LLM ingestion. Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion. I created a tool that consolidates information from the following inputs: GitHub repository URL (e.g., https://github.com/jimmc414/onefilellm ) arXiv abstract URL (e.g., https://arxiv.org/abs/2401.14295 ) Local folder path (e.g., C:\python\PipMyRide) Youtube video URL (e.g., https://www.youtube.com/.

CLIOpen source

2,024 stars · GitHubexternal site

Visit github.comexternal site