Using DSPy to enrich a dataset of the Nobel laureate network
I've been working a fair bit with DSPy lately, and I did some work in combining the benefits of vector search and LLMs (via a DSPy pipeline) to disambiguate records with a high degree of accuracy to help enrich a dataset.
Reactions (1)
Similar products
by description similarity
High-performance vector similarity library in Rust with Python bindings: Spearman, Kendall, distance correlation, Jensen-Shannon, Hoeffding's D, and bootstrapped confidence intervals
Bridge-ds
github.comDataset handling for any modality a la Pandas
A Vector Store written in Go - Supports hybrid retrieval over BM25, Flat, HNSW, IVF, PQ and IVFPQ Index with Quantization, Metadata Filtering, Reranking, Reciprocal Rank Fusion, Soft Deletes, Index Rebuilds and much much more
I'd love to get some people to mess around with a little side project I built to teach myself DSPy!
I used an LLM to parse HN Who's Hiring comments to structured job data
hnjobsai.vercel.appDiscover the best AI jobs at frontier AI companies across machine learning, AI research, data science, AI training, and robotics.