MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generation
Zijie J. Wang, Duen Horng Chau · 2024
Fig. 1: MeMemo is the first open-source JavaScript toolkit for in-browser dense neural retrieval.We demonstrate the capabilities of MeMemo by developing RAG Playground that enables AI developers to prototype retrieval-augmented text generation (RAG) apps locally in their browsers.With RAG Playground, developers can (A) enter various user queries, (B) search for semantically similar documents from an in-browser vector database, and (C) augment a text prompt with retrieved documents.(D) This allows developers to rapidly test if in-browser large language models generate more reliable responses to the query.