Persisting the DB?

[samcov]

More of a question!

Is it possible to persist the database, i.e. to a file?

[crpietschmann]

@samcov As in in-memory database used to help with implementing RAG (retrieval augmented generation) in an AI solution, the library wasn't designed to support database persistence. However, this is something that I've thought about adding.

Do you have a specific scenario in mind for where you would like persistence? I'd like to better understand more about why you're asking for this feature.

[samcov]

I haven't even used your library yet, which I'll try next week, but my thoughts were two. Keep in mind that my thoughts are likely naive since I'm just starting my RAG journey :)

1. Persisting would allow us to keep frequently used items available. caching could accomplish this, but it's not ideal
2. In general, persisting would allow the features(limited) of other vector DB's

As is, a memory DB, is almost like a context window because it will go away, so I guess item 1 is the more likely use case to avoid the complete loss of data.

[crpietschmann]

This feature will be added to the next release. (#23)