Today, I'm sharing AgentSearch, an open-core effort to make humanity's knowledge accessible for LLM agents.
To start, I have embedded all of Wikipedia, Arxiv, filtered common crawl, and more.
The result is over 1 billion embedding vectors, try it at .