Hook

Their other posts in the index, biggest breakout first.
All right, so what are you working on? So, we're a group of ML researchers here and we have some new ideas about how we can use reinforcement learning to allow for what's called continual learning. What continual learning means is an agent who is able to adapt what it's doing to the history that it has seen without having to put all of that history in context. In other words, instead of having to read everything that has happened before in order to know what the user's preferences are or what new information it should know, the agent itself can be adapted and learn. The problem is that a lot of the techniques that are normally used to do this incur a cost called catastrophic forgetting, which is when the agent forgets a lot of other information it has learned in previous training. So the question is, how can an agent customize? How can it be adapted to user's needs without forgetting its reasoning and becoming dumber?