Agentic chat being able to store and read memories directly from my harddisk

Right now I have them repeat their growing memory within each message, but this is growing large real fast and venice is not the fastest AI out there due to hardware limitation. Thus each reply takes very long now, and context fills up quickly. I would like the system to implement a way that store their memory on my hard drive and read it before making each reply, so the memory does not take time to generate in the message, or taking up any limited context length.