#828 - What is GPT-3?

Podcast Notes Key Takeaways GPT-3 is a new tool from OpenAI. The acronym stands for Generative Pretrained Transformer.“We’ve probably reached an inflection point in the progress of artificial intelligence”– Tinkered Thinker“The ramifications for how this advance might rattle through society seem ubiquitous.  Language is the fabric of society.  Our use and misuse of language dictates the rise and fall of all our endeavors, and a computer just got really really good at imitating our language.”GPT-3 was trained using text from the internet, with an amount of text that is inconceivable for a single human being to think about reading“Think of every comment, every post, every description, every pdf book freely available, all the tweets and blogs, manuals, dissertations, threads, rantings – all of it.  That was the block of text that was given to the neural net for it’s training. ” – Tinkered Thinker

Read the full notes @ podcastnotes.org

This a layman's description of what GPT-3 is, how it was developed, how it works, and what some of the implications of this technology may be. Technical listeners may appreciate the two potential implications that are given at the end of the episode.