Lesson 8: The Context Window — an LLM's Short-Term Memory
What the context window is, why it has a limit, what happens when you exceed it, and why an LLM doesn’t remember previous conversations.
What the context window is, why it has a limit, what happens when you exceed it, and why an LLM doesn’t remember previous conversations.
The types of agent memory, what embeddings are, how RAG works, and why memory is the hardest problem.