AI gets dumber the longer you chat

@bengusberg

63.4K followers · usually 18.9K views a post

Views

655.9K

Likes

23.4K

Comments

916

Shares

4.6K

SoundTikTok sound · original sound - bengusberg

Promoted product

Context transfer

Why it worked

The video addresses a common pain point experienced by users of AI chatbots, offering a practical and easily implementable solution. The creator's personal experience and credibility as an AI startup founder add weight to the advice.

Summary

This video explains the concept of "semantic degradation" or "context rot" in AI models like Claude and ChatGPT, where their performance decreases over long conversations. It then introduces a solution called "Context transfer" which involves creating a prompt to summarize the conversation context and pasting it into a new chat to maintain performance.

Structure

1Introduction to AI degradation
2Explanation of semantic degradation/context rot
3Introduction of the 'Context transfer' solution
4Demonstration of how to use the prompt
5

Original caption

Using this one every day #claude #ai #aitips #founder #startup

More from @bengusberg

Product placement

Anthropic (company that makes AI models); Open AI (company that makes AI models); Claude (AI model by Anthropic); ChatGPT (AI model by Open AI); Ben Gusberg (creator, founder of an AI startup); Stanford (university); Harvard (university)

Call to action

Follow me for more founder life and leadership

On-screen text

AI gets dumber the longer you chat THE RUMORS ARE ANTHROPIC AND OPEN AI DESIGNED THEIR MODELS TO THE MORE YOU YOU'VE DEFINITELY FELT YOU'RE GOING BACK CLAUDE OR CHAT GPT IT STARTS GETTING FORGETTING THINGS OR JUST BUGGING OUT RESEARCHERS FOUND MODELS GET UP TO 39% DUMBER THE LONGER A CONVERSATION GOES FOR THIS IS SEMANTIC DEGRADATION OR CONTEXT ROT BUT THERE'S A I'M BEN GUSBERG I'M A STANFORD AI STARTUP WE'VE RAISED $4 MILLION THE FIX IS Context transfer CALLED CONTEXT TRANSFER OPEN A NEW CHAT IN CLAUDE AND DROP IN THIS EXACT PROMPT THIS WILL CREATE A SKILL FOR THAT SUMMARIZES ALL THE KEY CONTEXT THREAD EVERY GOAL TASK PERSON LINK FILE THEN ANYTIME YOU NOTICE GPT GETTING DUMBER JUST TYPE SLASH /contexttransfer CONTEXT TRANSFER AND YOU'LL GET A SINGLE TEXT JUST COPY AND PASTE INTO A FRESH CHAT AND CONTINUE THE CONVERSATION WITH NOTHING THIS SOLVES THE CONTEXT ROT PROBLEM AND ALLOWS YOU WITH ALL THE SAME CONTEXT AND LET ME I'M BEN GUSBERG FOLLOW ME FOR FOUNDER LIFE AND LEADERSHIP

Transcript

The rumors are true. Anthropic and Open AI designed their models to get dumber the more you use them. You've definitely felt this. You're going back and forth with Claude or ChatGPT, and after a while, it starts getting forgetting things or just bugging out. Researchers found models get up to 39% dumber the longer a conversation goes. The official term for this is semantic degradation or context rot. But there's a simple fix. I'm Ben Gusberg. I'm a Stanford AI startup founder. We've raised $4 million. The fix is called context transfer. Open a new chat in Claude or ChatGPT and drop in this exact prompt. This will create a skill for you that summarizes all the key context from a conversation thread. Every goal, task, person, link, file. Then, anytime you notice GPT getting dumber, just type slash context transfer and you'll get a single text block that you can just copy and paste into a fresh chat and continue the conversation with nothing lost. This solves the context rot problem and allows you to start again with all the same context. Try this out and let me know what you build. I'm Ben Gusberg. Follow me for more founder life and leadership.