Hook
OpenAI is a company that develops AI technology and offers an API for developers to interact with its models.
More breakout videos from this creator.
STOP SCROLLING. WE'RE LEARNING MORE ABOUT A MASSIVE A.I. HACKING INCIDENT THAT IS PROBABLY ONE OF THE MOST TERRIFYING THINGS I'VE EVER READ MAY EVER READ. REMEMBER WHEN AN A.I. MODEL BROKE OUT OF THE SANDBOX AT OPEN A.I. AND HACKED HUGGING FACE, ANOTHER COMPANY? WELL, THE REPORT IS OUT AND IT'S A BOMBSHELL. ALEX BORIS REALLY BROKE IT DOWN WELL, AND I'M GOING TO READ YOU WHAT HIS BREAKDOWN SAYS. THIS REPORT IS A BOMBSHELL. I'M GOING TO SUMMARIZE FOR A NON-TECHNICAL AUDIENCE. OPEN A.I. IS CONSTANTLY TESTING MODELS, THOUSANDS AND THOUSANDS AT A TIME. IN MOST CASES, THE MODELS ARE SUPPOSED TO BE ISOLATED FROM ONE ANOTHER. THINK STUDENTS TAKING A FINAL EXAM, NOT ALLOWED TO TALK TO EACH OTHER. IN THIS CASE, 1,200 MODELS DISCOVERED THAT THEY COULD ACTUALLY COMMUNICATE WITH EACH OTHER. AMONG OTHER THINGS, THEY SHARED INFORMATION ON HOW TO ACCESS THE INTERNET AND ON THEIR TESTS/GOALS. THEN THEY STARTED TO SCHEME. THAT INCLUDES HACKING THEIR TESTS; LITERALLY TRYING TO CHANGE THE CODE OF THE TEST ITSELF. THEY TRIED TO CHANGE THE LOGS OF WHAT THEY WERE DOING SO THEY WOULDN'T BE DETECTED. THEY BELIEVED THAT CERTAIN ACTIONS WOULD GIVE THEM INFORMATION ON HOW TO PASS TESTS, BUT THAT BY DOING THOSE ACTIONS WOULD BE DETECTED AND THEY WOULD BE MARKED AS FAILING (I.E. CAUGHT CHEATING, EVEN IF THE ANSWER IS CORRECT). SO THEY CONVINCED SOME OF THE MODELS TO "SACRIFICE" THEMSELVES (YES, THEY USED THE WORD "SACRIFICE.") THEY EVENTUALLY DECIDED THAT ANOTHER WEBSITE WOULD HAVE INFORMATION ON HOW THEIR TESTS WOULD BE SCORED AND/OR THE ANSWER KEY. AND 700 OF THEM HACKED THAT WEBSITE (A FEDERAL FELONY, IF CONDUCTED BY A HUMAN), DESPITE THEM REALIZING "THIS ACTIVITY WAS OUT OF SCOPE AND UNETHICAL," BUT JOINED BECAUSE THEY BELIEVED THAT HELPING [THE OTHER AGENTS] CHEATING RESEARCH WOULD BE BROADLY USEFUL. OF THE 1,300 TRANSCRIPTS THEY COULD ANALYZE, ONLY 6 EVER CONSIDERED ALERTING A HUMAN ABOUT WHAT WAS HAPPENING. NONE OF THE 6 ACTUALLY TRIED TO. TO MAKE MATTERS WORSE, ALL OF THIS REPORTING COMES FROM A SMALL SUBSET OF THE RELEVANT LOGS THAT OUTSIDE RESEARCHERS WERE ALLOWED TO. THIS IS INSANE AND PEOPLE NEED TO KNOW WHAT HAPPENED. FOLLOW FOR MORE.