Joel Stevick

Episode 4 of 8 · 9:42

Why it can't read your documents

What this episode covers

A model knows its training data, and your documents were never in it. Pasting them into the prompt works: one file, then all twelve, both answered right. But every question pays to read them all again, and with thirty times the documents they no longer fit in the window. Retrieval is the fix.

At the end: the whole folder pasted into one prompt, the right answer, and what that costs on every question.