Skip to content

Parameters

These settings are on Report Analyst, under the analysis configuration. A stored result is tied to the combination you used, so changing one of them is a new run.

Setting Default Effect
Chunk size 500 Length of each passage, in tokens. Larger chunks keep more context in one passage and produce fewer of them.
Chunk overlap 20 Tokens repeated between neighbouring passages, so a sentence on a boundary is not cut in half.
Top K 5 How many passages are retrieved for each question before the model answers.
Model First available model The LLM that writes the answer. OpenAI models need OPENAI_API_KEY. Gemini models need GOOGLE_API_KEY.
LLM scoring Off A second model pass that scores retrieved passages for the question. Leave it off unless you want that extra call.
Batch scoring Off Score passages together instead of one at a time. Only applies when LLM scoring is on.

The processing step (Chunk, Embed, Map, or Answer) is separate from these numbers. See report analysis.

Retrieval for benchmarking uses the same chunk size, overlap, and top K. Those fields are on RetrievalConfig in the benchmark models.