Arseny Moskvichev dreams of the day he can have a meaningful conversation with artificial intelligence. “By meaningful, I mean a conversation that has the power to change you,” says the cognitive and computer scientist. “The problem,” says Moskvichev, “is that LLMs are complete amnesiacs. They only have so much context they can attend to. If you’re out of this context, they forget everything you spoke about with them.” Even the most advanced chatbots can only process about 16,000 words of text... Read this story
