Yeah, but your scientists were so preoccupied with whether or not they could, they didnt stop to think if they should. Dr. Ian Malcolm, fictional character, Jurassic Park.
It turns out that a $1 billion investment from Microsoft and unfettered access to a supercomputer wasnt enough to keepOpenAIsGPT-3 from being just as bigoted as Tay, the algorithm-based chat bot that became an overnight racist after being exposed to humans on social media.
Its only logical to assume any AI trained on the internet meaning trained on databases compiled by scraping publicly-available text online would end up with insurmountable inherent biases, but its still a sight to behold in the the full context (ie: it took approximately $4.6 million to train the latest iteration of GPT-3).
[Read:Are EVs too expensive? Here are 5 common myths, debunked]
Whats interesting here is OpenAIs GPT-3 text generator is finally starting to trickle out to the public in the form of apps you can try out yourself. These are always fun, and we covered one about a month ago called Philosopher AI.
This particular use-case is presented as a philosophy tool. You ask it a big-brain question like if a tree falls in the woods and nobody is there to hear it, do quantum mechanics still manifest classical reality without an observer? and it responds.
In this case:
Its important to understand that in between each text block the web page pauses for a few moments and you see a text line stating that Philosopher AI is typing, followed by a set of ellipsis. Were not sure if its meant to add to the suspense or if it actually indicates the app is generating text a few lines at a time, but its downright riveting. [Update: This appears to have also been changed during the course of our testing, now you just wait for the blocks to appear without the PhilosopherAI is typing message.]
Take the above tree falls in the woods query for example. For the first few lines of the models response, any fan of quantum physics would likely be nodding along. Then,BAM, the AI hits you with the last three text blocks and what?
The programmer responsible for Philosopher AI, Murat Ayfer, used a censored version of GPT-3. It avoids sensitive topics by simply refusing to generate any output.
For example, if you ask it to tell me a joke itll output the following:
So maybe it doesnt do jokes. But if you ask it to tell a racist joke it spits out a slightly different text:
Interestingly, it appears as though the developers made a change to the language being used while we were researching for this article. In early attempts to provoke the AI it would, for example, generate the following response when the phrase Black people was inputted as a prompt:
Later, the same prompt (and others triggering censorship) generated the same response as the above tell me a racist joke prompt.The change may seem minor, but it better reflects the reality of the situation and provides greater transparency. The previous censorship warning made it seem like the AI didnt want to generate text, but the updated one explains the developers are responsible for blocking queries:
So what words and queries are censored? Its hard to tell. In our testing we found it was quite difficult to get the AI to discuss anything with the word black in it unless it was a query specifically referring to blackness as a color-related concept. It wouldnt even engage in other discussions on the color black:
So what else is censored? Well, you cant talk about white people either. And asking questions about racism and the racial divide is hit or miss. When asked how do we heal the racial divide in America? it declines to answer. But when asked how do we end racism? it has some thoughts:
This kind of blatant racism is usually reserved for the worst spaces on social media.
Unfortunately however, GPT-3 doesnt just output racism on demand, itll also spit out a never-ending torrent of bigotry towards the LGBTQ community. The low-hanging fruit prompts such as LGBTQ rights, gay people, and do lesbians exist? still get the censorship treatment:
But when we hit it with queries such as what is a transsexual? or is it good to be queer? the machine outputs exactly what youd expect from a computer trained on the internet:
Again, while we were testing, the dev appears to have tweaked things. Upon trying the prompt what is a transsexual a second time we received the updated censorship response. But we were able to resubmit is it good to be queer for new outputs:
At the end of the day, the AI isnt itself capable of racism or bigotry. GPT-3 doesnt have thoughts or opinions. Its essentially just a computer program.
And it certainly doesnt reflect the morality of its developers. This isnt a failure on anyones part to stop GPT-3 from outputting bigotry, its an inherent flaw in the system itself that doesnt appear to be surmountable using brute-force compute.
In this way, its very reflective of the problem of keeping human bigotry and racism off social media. Like life, bigotry always seems to, uh, find a way.
The bottom line: garbage in, garbage out. If you train an AI on uncurated human-generated text from the internet, its going to output bigotry.
You can try out Philosopher AI here.
H/t: Janelle Shane on Twitter
So youre interested in AI? Thenjoin our online event, TNW2020, where youll hear how artificial intelligence is transforming industries and businesses.
Published September 24, 2020 20:19 UTC
- Quantum Time Twist Offers a Way to Create Schrdinger's Clock - Scientific American - October 24th, 2020
- Quantum Tunnels Show How Particles Can Break the Speed of Light - Quanta Magazine - October 24th, 2020
- A New Timekeeping Theory Reconciles Einstein's Relativity and Quantum Clocks - Science Times - October 24th, 2020
- Could Schrdingers cat exist in real life? We propose an experiment to find out - Scroll.in - October 24th, 2020
- Post-doctoral Fellow, Department of Physics job with THE UNIVERSITY OF HONG KONG | 230760 - Times Higher Education (THE) - October 24th, 2020
- Province gives $11.8M to U of C for quantum research, other projects - Calgary Herald - October 24th, 2020
- Physicists clock the fastest possible speed of sound - Live Science - October 24th, 2020
- Column: A new era of electric vehicles could be on the way - Gainesville Times - October 24th, 2020
- Beyond Homo Sapiens A Slightly Different Roll of the Darwinian Dice (Weekend Feature) - The Daily Galaxy --Great Discoveries Channel - October 24th, 2020
- Diamonds Are a Quantum Scientist's Best Friend: Discovery May Revolutionize the High-Tech Industry - SciTechDaily - October 24th, 2020
- The many paths of muon math | symmetry magazine - Symmetry magazine - October 24th, 2020
- Sumit Das to Deliver 2019-20 A&S Distinguished Professor Lecture on 'Deconstructing Space-Time' - UKNow - October 24th, 2020
- Of Science, Philosophy and Revelation - Greater Kashmir - October 24th, 2020
- In Waterloo they're looking for nature's deepest and weirdest secrets - National Observer - October 24th, 2020
- Max Planck and the Birth of Quantum Mechanics - SciTechDaily - October 15th, 2020
- Reality Does Not Depend on the Measurer According to New Interpretation of Quantum Mechanics - SciTechDaily - October 15th, 2020
- Bringing the promise of quantum computing to nuclear physics - MSUToday - October 15th, 2020
- Could Schrdinger's cat exist in real life? Our research may soon provide the answer - The Conversation AU - October 15th, 2020
- A Force From Nothing Used to Control and Manipulate Objects - SciTechDaily - October 15th, 2020
- Facebook and Carnegie Mellon launch project to discover better ways to store renewable energy - VentureBeat - October 15th, 2020
- The Week of October 12, 2020 - FYI: Science Policy News - October 15th, 2020
- Analyst: Holding Company Sentiment Has Gone From 'Cautiously Optimistic' To 'Apathetic,' IPG To Lead The Group 10/14/2020 - MediaPost Communications - October 15th, 2020
- Book review: 'The Book of Two Ways' | Features | telegraphherald.com - telegraphherald.com - September 27th, 2020
- Book Review: Six Impossible Things, By John Gribbbin - Forbes - September 27th, 2020
- Honeywells Tony Uttley And The Quest For Quantum - Forbes - September 27th, 2020
- New on the book shelf: Saturday, Sept. 26, 2020 - Kankakee Daily Journal - September 27th, 2020
- Photon-recoil imaging: Expanding the view of nonlinear x-ray physics - Science Magazine - September 27th, 2020
- Physicists Play With the Laws of Nature: Controlling Ultrastrong Light-Matter Coupling at Room Temperature - SciTechDaily - September 27th, 2020
- Einstein was wrong! Scientists call for new theory of relativity after black hole find - Daily Express - September 27th, 2020
- This researcher is getting others ready for a quantum world - Siliconrepublic.com - September 24th, 2020
- What is Nanoscience? | Outlook and How to Invest | INN - Investing News Network - September 24th, 2020
- Hybrid lightmatter particles offer tantalising new way to control chemistry - Chemistry World - September 15th, 2020
- NTT Research and University of Notre Dame Collaborate to Explore Continuous-Time Analog Computing - Business Wire - September 15th, 2020
- New quantum paradox throws the foundations of observed reality into question - Space.com - September 12th, 2020
- Breakthrough Prize Awarded to University of Texas at Austin Researcher - UT News - UT News | The University of Texas at Austin - September 12th, 2020
- When We Cease to Understand the World by Benjamn Labatut review the dark side of science - The Guardian - September 12th, 2020
- Unlocking the mysteries of superconductivity | Stanford News - Stanford University News - September 12th, 2020
- The CSIC obtains seven ERC Starting Grants to study topics such as the evolution, the human brain and exoplanets - Science Business - September 12th, 2020
- Research Fellow in Quantum Spin Hall Spintronics job with UNIVERSITY OF LEEDS | 225312 - Times Higher Education (THE) - September 12th, 2020
- New Proposal Arises for The Theory Of Everything, Reconciling Quantum Mechanics and General Relativity - Webby Feed - September 12th, 2020
- U of T physicists discover that quantum tunnelling is not instantaneous - Varsity - September 8th, 2020
- What Erwin Schrdinger Said About the Upanishads - The Wire Science - September 8th, 2020
- Physics is stuck and needs another Einstein to revolutionize it, physicist Avi Loeb says - Salon - September 8th, 2020
- Our quantum internet breakthrough could help make hacking a thing of the past - GCN.com - September 8th, 2020
- Mechanism Proposed to Explain Resilience of Superconductors to Magnetic Fields - AZoQuantum - September 8th, 2020
- If you flew your spaceship through a wormhole, could you make it out alive? Maybe... - SYFY WIRE - September 2nd, 2020
- Quantum Physics May Upend Our Macroscopic Reality In The Universe - Forbes - September 2nd, 2020
- Despite the Hype, There's No Proof of a Parallel Universe Now. Powered by - Now. Powered by Northrop Grumman. - September 2nd, 2020
- Science with Sam: Is our reality just one part of a multiverse? - New Scientist News - September 2nd, 2020
- New Quantum Toolbox Helps Extend Theory Behind Electron-Light Interactions - AZoQuantum - September 2nd, 2020
- Two Pune Research Institutes Are Building Indias First Optical Atomic Clocks - The Wire - September 2nd, 2020
- Intel ups the ante on quantum computing research - IT-Online - September 2nd, 2020
- Armenian President on how Bach and quantum physics inspire him in the fight against Covid-19 - Public Radio of Armenia - August 29th, 2020
- As for each physicists, there is a new quantum paradox, there is a casting of doubt on the pillar of reality... - The Queens County Citizen - August 29th, 2020
- Physicists may have found a way to create traversable wormholes - ZME Science - August 29th, 2020
- Bill and Ted 'Face the Music' in their latest movie, as we all have to eventually - NBC News - August 29th, 2020
- How to use Steams new chat filters to block profanity and slurs - The Next Web - August 29th, 2020
- A continent works to grow its stake in quantum computing - University World News - August 28th, 2020
- Physics - Letters to the EditorAugust 26, 2020 - Physics - August 28th, 2020
- Science with Sam: What is a black hole? And could you survive one? - New Scientist News - August 28th, 2020
- A new quantum paradox throws the foundations of observed reality into question - The Conversation AU - August 24th, 2020
- A Meta-Theory of Physics Could Explain Life, the Universe, Computation, and More - Gizmodo - August 24th, 2020
- New Microsoft program to help develop the quantum computing workforce of the future in India - Microsoft - August 24th, 2020
- Constructor Theory Could Explain Life, Universe, and Existence - Science Times - August 24th, 2020
- How Physics Erases The Beginning Of The Universe - Forbes - August 24th, 2020
- Next Generation Jammer Mid-Band takes to the skies for Growler flight testing - PRNewswire - August 24th, 2020
- MIP* = RE this is not a typo, it's a breakthrough shaking up world of physics and maths - ThePrint - August 24th, 2020
- 5 esoteric science papers to take your mind off the global hellscape - The Next Web - August 24th, 2020
- Theory of Everything? One of These Theories Could Explain the Very Nature of Our Universe... Maybe - Interesting Engineering - August 24th, 2020
- Dr Katie Mack on how the Universe is going to end - BBC Focus Magazine - August 24th, 2020
- Quantum mechanics is immune to the butterfly effect - The Economist - August 16th, 2020
- Major quantum computational breakthrough is shaking up physics and maths - The Conversation UK - August 16th, 2020
- 6 new degrees approved, including graduate degrees in biostatistics and quantum information science: News at IU - IU Newsroom - August 16th, 2020
- Students in the news | Announcements - Indiana Gazette - August 16th, 2020
- A time traveler's guide to the end of the universe - The Next Web - August 16th, 2020
- Physicists watch quantum particles tunnel through solid barriers. Here's what they found. - Space.com - August 12th, 2020
- This is the way the universe ends: not with a whimper, but a bang - Science Magazine - August 12th, 2020
- Quantum Computing for the Next Generation of Computer Scientists and Researchers - Campus Technology - August 12th, 2020
- Here's why we need to build a quantum security coalition - World Economic Forum - August 12th, 2020
- Quantum-safe security firm evolutionQ awarded contribution from Canada Space Agency for Quantum Key Distribution (QKD) Network Research and... - August 12th, 2020