Skip to main content

Reintroduce System Promts on Refresh

Feature Requests

A feature that re-injects the system prompt into the context window on refresh, making it easy by just hitting F5. If you instead copy and paste the system prompt back in it’s more cumbersome and prompts a response by the model. Dunno if this would cause issues though, like with downloading the chat having the system prompt randomly appear again and again but not in the chat view itself.

Status: Rejected2 comments

Log in to comment and vote

Comments2

  • JP

    Team•

    Mar 8, 2025

    The system prompt is always injected as the first message we send the LLM before any of the user context is sent, so you don’t need to include it in your box.

    • Silver River

      •

      Mar 8, 2025

      Yeah but it forgets in lengthy conversations unless it’s regularly reminded by either prompts or it’s own responses. So If I give it the protagonists name for example it’s repetition throughout the story reinforces it to keep appearing.

      But if your system prompt is complex than it will keep forgetting, for example if you tell it to choose from a more diverse set of names for characters in your system prompt and it forgets, you’ll suddenly find that a lot of bad guys are called Victor, a lot of Dr Lee’s around and a lot of female characters are Elara from now on. Those examples are from Llama 3.1 405b.

      That’s why if you can regularly re-inject the system prompt without it responding it would be a good idea for long form conversations. I know you guys have been interested in working to that as well.