This is my old MacBook it's six years old

THIS IS MY OLD MACBOOK IT'S SIX YEARS OLD IT HAS M1 CHIP AND 8 GIGABYTES OF UNIFIED MEMORY AND I WANT TO TRY TO RUN SOME LOCAL MODELS ON IT AND I'M QUITE BUSY TODAY SO I DON'T WANT TO CONFIGURE ANY COMPLEX INFERENCE ENGINE I DON'T WANT TO WRITE ANY CODE SO I WANT TO HAVE SOME OFF THE SHELF SOLUTION THAT I CAN JUST INSTALL ON MY COMPUTER DOWNLOAD THE MODEL AND JUST RUN IT IF YOU DON'T KNOW ME MY NAME IS IVAN I'M A COMPUTER SCIENCE TEACHER FOUNDER OF ISABIT AND I HELP ADULTS TO KEEP UP WITH TECH LET'S RUN SOME MODELS SO INITIALLY I WANTED TO GO WITH OLLAMA THIS IS VERY POPULAR INFERENCE ENGINE BUT THEN I DECIDED THAT I WANT TO TRY SOMETHING ELSE SO I WENT TO A LMSTUDIO BECAUSE I USED THEM BEFORE LM STUDIO Go Bionic. Bionic is LM Studio's agent for open models. Natively local. Built for creativity, work, and code. Copy download link AGENTS POWER. AT YOUR FINGERTIPS. An agent for work and code. Work with Bionic to create and edit documents. Every change is automatically saved, so you can work with your agent freely. Bionic also excels at coding tasks, automations, and computer control. Ask it for help with anything you need done. IT'S KIND OF AGENT WHERE YOU CAN PLUG IN YOUR OWN MODEL IT HAS SOME BUILT IN TOOLS SO YOU BASICALLY DON'T NEED TO CONFIGURE ANYTHING AND THEY HAVE VERY NICE INTERFACE WITH A LIBRARY WHERE YOU CAN LOOK FOR A MODEL YOU WANT TO DOWNLOAD AND THEY ACTUALLY EVEN CHECK IF YOU CAN RUN THE MODEL ON YOUR HARDWARE SO I WANTED TO GO WITH QWEN I HAVE 8 GIGABYTES OF UNIFIED MEMORY AND MY OPERATING SYSTEM USES SOME SO MOST LIKELY I CANNOT GO ABOVE 4 5 GIGABYTES SO I PROBABLY SHOULD GO WITH SOME SMALLER QWEN MODEL I DECIDED TO GO WITH QWEN3 3.5 4 BILLION PARAMETER MODEL AND I SEE THAT I CAN DOWNLOAD EVEN DIFFERENT QUANTIZED VERSIONS OF THIS MODEL I DECIDED TO GO WITH 4 BIT QUANTIZATION BECAUSE IT'S SMALLER AND BECAUSE I'M NOT USING RAW LLM AND I ACTUALLY PUT IT INTO AN AGENT I EXPECT THAT THIS SMALL QUANTIZED VERSION WILL STILL BE CAPABLE OF DOING SOME STUFF SO I DOWNLOADED THE MODEL AND I WENT WITH SOME VERY SIMPLE TASK LIKE TEXT GENERATION I ASKED IT TO WRITE AN EMAIL TO MY BOSS THAT I'M SICK AND NO SURPRISES IT DID QUITE WELL I ALSO ASKED IT TO SUMMARIZE THE CHUNK OF TEXT WHICH IT ALSO HAVE DONE QUITE EASILY IT EVEN TRANSLATED ME SOME TEXT FROM ENGLISH TO RUSSIAN AND EVEN THOUGH IT'S NOT THE BEST TRANSLATION IN THE WORLD IT STILL DIDN'T MAKE ANY BIG MISTAKES AND I DIDN'T HAVE ANY DOUBT THAT IT WILL BE ABLE TO GENERATE TEXT I WANTED TO TRY IT ON SOMETHING MORE SERIOUS SO I UPLOADED PDF FILE AND ASKED IT TO EXPLAIN ME WHAT IS THIS? IT WAS PROCESSING THE TASK FOR MORE THAN TWO MINUTES IT ACTUALLY CONVERTED PDF INTO PNG AND THEN SENT IT TO A MODEL AND BECAUSE QWEN 3.5 HAVE VISION CAPABILITIES IT WAS ABLE TO RECOGNIZE WHAT THIS DOCUMENT IS AND ACTUALLY CORRECTLY EXTRACT INFORMATION FROM THE DOCUMENT I EVEN ASKED IT TO WRITE A VERY SIMPLE JAVASCRIPT FUNCTION AND THAT HAVE DONE IT AS WELL WHERE IT DIDN'T DO THIS WELL IS FACTUAL INFORMATION I DISCONNECTED MY LAPTOP FROM THE INTERNET TO ELIMINATE ANY WEB SEARCH TOOLS THAT THIS AGENT MAY USE WHO WAS THE PREVIOUS PRESIDENT OF UNITED STATES AND IT SAID THAT BEFORE DONALD TRUMP IT WAS GEORGE H.W. BUSH SO HE SKIPPED LIKE FIVE OTHERS BUT NO SURPRISE HERE BECAUSE MODEL IS SMALL AND QUANTIZED SO OBVIOUSLY IT WILL HALLUCINATE OVERALL I WAS SURPRISED THAT IT PERFORMED THAT WELL AND I ACTUALLY WANT TO PUSH IT A LITTLE BIT HARDER AND MAYBE EVEN RUN SOME MULTI AGENTIC SYSTEM AND I WILL SHARE RESULTS IN THE NEXT EPISODES SO FOLLOW ME TO NOT MISS IT