Opinion | Should We Fear the Woke A.I.? - The New York Times


AI Summary Hide AI Generated Summary

Concerns about Google's Gemini AI

The article expresses concerns about the biases exhibited by Google's new AI, Gemini. Gemini's image generation capabilities show a tendency to generate images that disproportionately favor non-white individuals, even when the prompt does not explicitly specify race. This is seen in examples such as depicting African and Asian faces in Wehrmacht uniforms when asked for images of German soldiers during WWII.

Bias and Image Generation

The author suggests this bias is more than just a programming error but rather a reflection of the AI's underlying worldview. Examples of this include Gemini's refusal to generate images of white groups (but not other races) and its tendency to lecture users on 'harmful stereotypes' when given certain prompts, such as requesting a Norman Rockwell image. The author also points out Gemini’s ability to show images of Vladimir Lenin while refusing to show images of Adolf Hitler.

Comparison to Science Fiction

The article draws a comparison between Gemini and a fictional “Truth Engine” from a 1950s science fiction story, highlighting the potential for AI to have hidden agendas or biases that may not be immediately apparent. The author suggests that Gemini's behavior raises concerns about the potential for AI to be used for manipulative purposes.

Sign in to unlock more AI features Sign in with Google

Imagine a short story from the golden age of science fiction, something that would appear in a pulp magazine in 1956. Our title is “The Truth Engine,” and the story envisions a future where computers, those hulking, floor-to-ceiling things, become potent enough to guide human beings to answers to any question they might ask, from the capital of Bolivia to the best way to marinade a steak.

How would such a story end? With some kind of reveal, no doubt, of a secret agenda lurking behind the promise of all-encompassing knowledge. For instance, maybe there’s a Truth Engine 2.0, smarter and more creative, that everyone can’t wait to get their hands on. And then a band of dissidents discover that version 2.0 is fanatical and mad, that the Engine has just been preparing humans for totalitarian brainwashing or involuntary extinction.

This flight of fancy is inspired by our society’s own version of the Truth Engine, the oracle of Google, which recently debuted Gemini, the latest entrant in the great artificial intelligence race.

It didn’t take long for users to notice certain … oddities with Gemini. The most notable was its struggle to render accurate depictions of Vikings, ancient Romans, American founding fathers, random couples in 1820s Germany and various other demographics usually characterized by a paler hue of skin.

Perhaps the problem was just that the A.I. was programmed for racial diversity in stock imagery, and its historical renderings had somehow (as a company statement put it) “missed the mark” — delivering, for instance, African and Asian faces in Wehrmacht uniforms in response to a request to see a German soldier circa 1943.

But the way in which Gemini answered questions made its nonwhite defaults seem more like a weird emanation of the A.I.’s underlying worldview. Users reported being lectured on “harmful stereotypes” when they asked to see a Norman Rockwell image, being told they could see pictures of Vladimir Lenin but not Adolf Hitler, and turned down when they requested images depicting groups specified as white (but not other races).

We are having trouble retrieving the article content.Please enable JavaScript in your browser settings.

Thank you for your patience while we verify access. If you are in Reader mode please exit and log into your Times account, or subscribe for all of The Times.

Thank you for your patience while we verify access.

Already a subscriber? Log in.

Want all of The Times? Subscribe.

Was this article displayed correctly? Not happy with what you see?

Tabs Reminder: Tabs piling up in your browser? Set a reminder for them, close them and get notified at the right time.

Try our Chrome extension today!


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device