Skip to content

Fix context trimming in Chainlit - #1096

Merged
rasbt merged 1 commit into
mainfrom
model-improvements-7
Oct 1, 2026
Merged

rasbt merged 1 commit into
mainfrom
model-improvements-7

Conversation

@rasbt

@rasbt rasbt commented Oct 1, 2026

Copy link
Copy Markdown
Owner

Fixes #1089 context trimming issue.

@rasbt
rasbt merged commit faa6205 into main Oct 1, 2026
14 checks passed
@rasbt
rasbt deleted the model-improvements-7 branch October 1, 2026 17:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

KV-cache streaming generation ignores context_size for long prompts

1 participant