Make the current context window visibly explicit

Hello. I was reading about some of the limitations of LLMs in general, particularly in terms of how much they can remember and this just came to me.

Sometimes I’m in the middle of a chat noticing that there is something wrong with the replies but not quite getting why yet until some one makes me finally notice that some key detail that was important for context must have gone out of the context window.

It would be great if there was some easy way to just see what’s still in context and what’s not instead of having to guess or ask the AI if “do you still remember x and y?” or similar.
Could you either put a visual marker indicating where the current context window starts or maybe just give the chat posts a different background color based if they are in the current context window or not?

This should be relatively easy and fast to implement and would make it obvious for the user and be a great help in that way. Lots of utility for a very small amount of work ;)

Please authenticate to join the conversation.

Upvoters
Status

Backlog

Board
💡

Feature Requests

Tags

UI Design

Date

7 months ago

Author

[B0rg]

Subscribe to post

Get notified by email when there are changes.