Skip to main content

Adjustable repetition penalty

Currently, model responses in character chats exceeding ~300 tokens become unintelligible, progressively lacking more conjunctions, prepositions, commas, and quickly degrading into just a string of adjectives. I assume this is because the repetition penalty parameter is set too high, but we have no way of adjusting this. Please add a slider for repetition penalty alongside the top_p and temperature parameters.

Status: Backlog2 comments

Log in to comment and vote

Comments2

  • Jade Clay

    •

    Dec 1, 2025

    Also. Why is there a character limit on user input for chat?

  • Silver River

    •

    Jun 22, 2025

    This would be better as a bug report imo. But I’ve also wondered about this.