Stream of Search: Teaching Language Models the Language of Search

Generative AI needs to learn from mistakes

Language models have demonstrated remarkable abilities in various tasks, from natural language processing to code generation. However, these models often struggle with complex problem-solving that requires planning, searching, and backtracking. A recent paper by Gandhi et al. (2024) introduces a novel approach called Stream of Search (SoS), which aims t…