What is embedding? Embedding is just a vector, a list of numbers with a semantic meaning only understandable by the machine. This is useful because it allows computers to understand the meanings of words and how they relate to each other, even though they are just a bunch of letters to a computer. For example, let’s say we have the words “dog” an...
What is a vector database? A vector database is a type of database that stores information as vectors or arrays of numbers. Each piece of information is represented as a vector, where each number in the vector corresponds to a specific attribute or feature of the data. In this case, you can use a vector as the index to search and retrieve data fro...
Store each chunk in the vector database. Each chunk is indexed by a chunk embedding vector
Divide your long text into small chunks that are consumable by GPT
We use two OpenAI models in this demo: gpt-3.5-turbo — your most familiar model: ChatGPT. text-embedding-ada-002 — an OpenAI model specifically designed for generating accurate embedding vectors at a very low cost
Glasp is a social web highlighter that people can highlight and organize quotes and thoughts from the web, and access other like-minded people’s learning.