Karpathy LLM memory consolidation
Karpathy highlighted a key limitation of LLMs: they lack the sleep-based memory consolidation that the human brain relies on. Every time a model starts a new chat, it begins from scratch with no memory of prior interactions. Humans, by contrast, lock in the day's learning during sleep, solidifying memories overnight. AI simply forgets everything the moment the tab is closed.
2mo
Karpathy LLM memory consolidation
Karpathy highlighted a key limitation of LLMs: they lack the sleep-based memory consolidation that the human brain relies on. Every time a model starts a new chat, it begins from scratch with no memory of prior interactions. Humans, by contrast, lock in the day's learning during sleep, solidifying memories overnight. AI simply forgets everything the moment the tab is closed.
2mo
Ancora nessun commento. Sii il primo!
Commenti
Ancora nessun commento. Sii il primo!