Skip to main content

add model for auto-complete (FITM, fill in the middle)

This would plug beautifully into Continue and others that leverage FITM models with custom endpoints like Venice.ai API

“An "autocomplete model" is an LLM that is trained on a special format called fill-in-the-middle (FIM). This format is designed to be given the prefix and suffix of a code file and predict what goes between. This task is very specific, which on one hand means that the models can be smaller (even a 3B parameter model can perform well). On the other hand, this means that Chat models, though larger, will perform poorly.”
https://docs.continue.dev/customize/model-types/autocomplete

Status: Backlog12 comments

Log in to comment and vote

Comments12

  • Silver Stapler

    •

    Feb 23, 2025

    It would be great to be able to use Qwen2.5-Coder 1.5B or Qwen2.5-Coder 3B for tab auto-completion in Continue. I have currently signed up for Mistral and use codestral-latest model.

  • Amethyst Lynx

    •

    Mar 8, 2025

    Yes please and it would be amazing if Codestral 22b was one of the supported models.