TOPIC

#llm

A collection of 3 technical articles about #llm.

The model proposes, your code executes

The model sees only a tool declaration, never its execution. A tool call is a structured request your code validates, authorises, and then decides to run.

tusginoSep 21, 20261 min read

#ai-engineering#architecture#security

A budget bar filling up block by block, the final block cut off past the limit line

The context window is not memory

A context window is a finite budget, not a memory. On the same request, two published token ratios differ by 1.6x, and you cannot tell which one you are on.

tusginoSep 20, 20261 min read

#ai-engineering#architecture#llm

Two separate API calls, where the second one carries the entire history of the first

Call the API, then forget

Every API call is a pure function: text in, text out, then nothing. The memory you think the model has is history you resend yourself, and you pay for it.

tusginoSep 19, 20261 min read

#ai-engineering#architecture#llm

The model proposes, your code executes↗

The context window is not memory↗

Call the API, then forget↗

The model proposes, your code executes

The context window is not memory

Call the API, then forget