Arxiv paper - Improving Factuality with Explicit Working Memory

In this episode, we discuss Improving Factuality with Explicit Working Memory by Mingda Chen, Yang Li, Karthik Padthe, Rulin Shao, Alicia Sun, Luke Zettlemoyer, Gargi Gosh, Wen-tau Yih. The paper presents Ewe, a novel method that incorporates explicit working memory into large language models to improve factuality in long-form text generation by updating memory in real-time based on feedback from external resources. Ewe demonstrates superior performance over existing approaches across four datasets, boosting the VeriScore metric without compromising response helpfulness. The study highlights the significance of memory update rules, configuration, and retrieval datastore quality in enhancing the model's accuracy.