• Follow us

Social Media

The adversarial persuasion machine: a conversation with James Williams – TechCrunch

James Williams may not be a household name yet in most tech circles, but he will be.

For this second in what will be a regular series of conversations exploring the ethics of the technology industry, I was delighted to be able to turn to one of our current generation’s most important young philosophers of tech.

Around a decade ago, Williams won the Founder’s Award, Google’s highest honor for its employees. Then in 2017, he won an even rarer award, this time for his scorching criticism of the entire digital technology industry in which he had worked so successfully. The inaugural winner of Cambridge University’s $100,000 “Nine Dots Prize” for original thinking, Williams was recognized for the fruits of his doctoral research at Oxford University, on how “digital technologies are making all forms of politics worth having impossible, as they privilege our impulses over our intentions and are designed to exploit our psychological vulnerabilities in order to direct us toward goals that may or may not align with our own.” In 2018, he published his brilliantly written book Stand Out of Our Light, an instant classic in the field of tech ethics.

In an in-depth conversation by phone and email, edited below for length and clarity, Williams told me about how and why our attention is under profound assault. At one point, he points out that the artificial intelligence which beat the world champion at the game Go is now aimed squarely — and rather successfully — at beating us, or at least convincing us to watch more YouTube videos and stay on our phones a lot longer than we otherwise would. And while most of us have sort of observed and lamented this phenomenon, Williams believes the consequences of things like smartphone compulsion could be much more dire and widespread than we realize, ultimately putting billions of people in profound danger while testing our ability to even have a human will.

It’s a chilling prospect, and yet somehow, if you read to the end of the interview, you’ll see Williams manages to end on an inspiring and hopeful note. Enjoy!

Editor’s note: this interview is approximately 5,500 words / 25 minutes read time. The first third has been ungated given the importance of this subject. To read the whole interview, be sure to join the Extra Crunch membership. ~ Danny Crichton

Introduction and background

Greg Epstein: I want to know more about your personal story. You grew up in West Texas. Then you found yourself at Google, where you won the Founder’s Award, Google’s highest honor. Then at some point you realized, “I’ve got to get out of here.” What was that journey like?

James Williams: This is going to sound neater and more intentional than it actually was, as is the case with most stories. In a lot of ways my life has been a ping-ponging back and forth between tech and the humanities, trying to bring them into some kind of conversation.

It’s the feeling that, you know, the car’s already been built, the dashboard’s been calibrated, and now to move humanity forward you just kind of have to hold the wheel straight

I spent my formative years in a town called Abilene, Texas, where my father was a university professor. It’s the kind of place where you get the day off school when the rodeo comes to town. Lots of good people there. But it’s not exactly a tech hub. Most of my tech education consisted of spending late nights, and full days in the summer, up in the university computer lab with my younger brother just messing around on the fast connection there. Later when I went to college, I started studying computer engineering, but I found that I had this itch about the broader “why” questions that on some deeper level I needed to scratch. So I changed my focus to literature.

After college, I started working at Google in their Seattle office, helping to grow their search ads business. I never, ever imagined I’d work in advertising, and there was some serious whiplash from going straight into that world after spending several hours a day reading James Joyce. Though I guess Leopold Bloom in Ulysses also works in advertising, so there’s at least some thread of a connection there. But I think what I found most compelling about the work at the time, and I guess this would have been in 2005, was the idea that we were fundamentally changing what advertising could be. If historically advertising had to be an annoying, distracting barrage on people’s attention, it didn’t have to anymore because we finally had the means to orient it around people’s actual intentions. And search, that “database of intentions,” was right at the vanguard of that change.

The adversarial persuasion machine

Photo by joe daniel price via Getty Images

Greg: So how did you end up at Oxford, studying tech ethics? What did you go there to learn about?

James: What led me to go to Oxford to study the ethics of persuasion and attention was that I didn’t see this reorientation of advertising around people’s true goals and intentions ultimately winning out across the industry. In fact, I saw something really concerning happening in the opposite direction. The old attention-grabby forms of advertising were being uncritically reimposed in the new digital environment, only now in a much more sophisticated and unrestrained manner. These attention-grabby goals, which are goals that no user anywhere has ever had for themselves, seemed to be cannibalizing the design goals of the medium itself.

In the past advertising had been described as a kind of “underwriting” of the medium, but now it seemed to be “overwriting” it. Everything was becoming an ad. My whole digital environment seemed to be transmogrifying into some weird new kind of adversarial persuasion machine. But persuasion isn’t even the right word for it. It’s something stronger than that, something more in the direction of coercion or manipulation that I still don’t think we have a good word for. When I looked around and didn’t see anybody talking about the ethics of that stuff, in particular the implications it has for human freedom, I decided to go study it myself.

Greg: How stressful of a time was that for you when you were realizing that you needed to make such a big change or that you might be making such a big change?

James: The big change being shifting to do doctoral work?

Greg: Well that, but really I’m trying to understand what it was like to go from a very high place in the tech world to becoming essentially a philosopher critic of your former work.

James: A lot of people I talked to didn’t understand why I was doing it. Friends, coworkers, I think they didn’t quite understand why it was worthy of such a big step, such a big change in my personal life to try to interrogate this question. There was a bit of, not loneliness, but a certain kind of motivational isolation, I guess. But since then, it’s certainly been heartening to see many of them come to realize why I felt it was so important. Part of that is because these questions are so much more in the foreground of societal awareness now than they were then.

Liberation in the age of attention

Greg: You write about how when you were younger you thought “there were no great political struggles left.” Now you’ve said, “The liberation of human attention may be the defining moral and political struggle of our time.” Tell me about that transition intellectually or emotionally or both. How good did you think it was back then, the world was back then, and how concerned are you now?

What you see a lot in tech design is essentially the equivalent of a circular argument about this, where someone clicks on something and then the designer will say, “Well, see, they must’ve wanted that because they clicked on it.”

James: I think a lot of people in my generation grew up with this feeling that there weren’t really any more existential threats to the liberal project left for us to fight against. It’s the feeling that, you know, the car’s already been built, the dashboard’s been calibrated, and now to move humanity forward you just kind of have to hold the wheel straight and get a good job and keep recycling and try not to crash the car as we cruise off into this ultra-stable sunset at the end of history.

What I’ve realized, though, is that this crisis of attention brought upon by adversarial persuasive design is like a bucket of mud that’s been thrown across the windshield of the car. It’s a first-order problem. Yes, we still have big problems to solve like climate change and extremism and so on. But we can’t solve them unless we can give the right kind of attention to them. In the same way that, if you have a muddy windshield, yeah, you risk veering off the road and hitting a tree or flying into a ravine. But the first thing is that you really need to clean your windshield. We can’t really do anything that matters unless we can pay attention to the stuff that matters. And our media is our windshield, and right now there’s mud all over it.

Greg: One of the terms that you either coin or use for the situation that we find ourselves in now is the age of attention.

James: I use this phrase “Age of Attention” not so much to advance it as a serious candidate for what we should call our time, but more as a rhetorical counterpoint to the phrase “Information Age.” It’s a reference to the famous observation of Herbert Simon, which I discuss in the book, that when information becomes abundant it makes attention the scarce resource.

Much of the ethical work on digital technology so far has addressed questions of information management, but far less has addressed questions of attention management. If attention is now the scarce resource so many technologies are competing for, we need to give more ethical attention to attention.

Greg: Right. I just want to make sure people understand how severe this may be, how severe you think it is. I went into your book already feeling totally distracted and surrounded by totally distracted people. But when I finished the book, and it’s one of the most marked-up books I’ve ever owned by the way, I came away with the sense of acute crisis. What is being done to our attention is affecting us profoundly as human beings. How would you characterize it?

James: Thanks for giving so much attention to the book. Yeah, these ideas have very deep roots. In the Dhammapada the Buddha says, “All that we are is a result of what we have thought.” The book of Proverbs says, “As a man thinketh in his heart, so is he.” Simone Weil wrote that “It is not we who move, but images pass before our eyes and we live them.” It seems to me that attention should really be seen as one of our most precious and fundamental capacities, cultivating it in the right way should be seen as one of the greatest goods, and injuring it should be seen as of the greatest harms.

In the book, I was interested to explore whether the language of attention can be used to talk usefully about the human will. At the end of the day I think that’s a major part of what’s at stake in the design of these persuasive systems, the success of the human will.

“Want what we want?”

Photo by Buena Vista Images via Getty Images

Greg: To translate those concerns about “the success of the human will” into simpler terms, I think the big concern here is, what happens to us as human beings if we find ourselves waking up in the morning and going to bed at night wanting things that we really only want because AI and algorithms have helped convince us we want them? For example, we want to be on our phone chiefly because it serves Samsung or Google or Facebook or whomever. Do we lose something of our humanity when we lose the ability to “want what we want?”

James: Absolutely. I mean, philosophers call these second order volitions as opposed to just first order volitions. A first order volition is, “I want to eat the piece of chocolate that’s in front of me.” But the second order volition is, “I don’t want to want to eat that piece of chocolate that’s in front of me.” Creating those second order volitions, being able to define what we want to want, requires that we have a certain capacity for reflection.

What you see a lot in tech design is essentially the equivalent of a circular argument about this, where someone clicks on something and then the designer will say, “Well, see, they must’ve wanted that because they clicked on it.” But that’s basically taking evidence of effective persuasion as evidence of intention, which is very convenient for serving design metrics and business models, but not necessarily a user’s interests.

AI and attention

STR/AFP/Getty Images

Greg: Let’s talk about AI and its role in the persuasion that you’ve been describing. You talk about, a number of times, about the AI behind the system that beat the world champion at the board game Go. I think that’s a great example and that that AI has been deployed to keep us watching YouTube longer, and that billions of dollars are literally being spent to figure out how to get us to look at one thing over another.

Read More



Leave A Comment

More News

TechCrunch » Social

Facebook makes its first browser API contribution 2019-04-22 12:39:06Facebook today announced that it has made its first major API contribution to Google’s Chrome browser. Together with Google, Facebook’s te

3 fixes for Netflix’s ‘What to watch?’ problem 2019-04-20 10:51:11Wasting time every night debating with yourself or your partner about what to watch on Netflix is a drag. It burns people’s time and good will,

How do you hire a great growth marketer? 2019-04-19 12:05:06Editors Note: This article is part of a series that explores the world of growth marketing for founders.

Instagram hides Like counts in leaked design prototype 2019-04-18 16:57:47“We want your followers to focus on what you share, not how many likes your posts get. During this test, only the person who shares a post will

Facebook now says its password leak affected ‘millions’ 2019-04-18 13:57:36Facebook has confirmed its password-related security incident last month now affects “millions” of Instagram users, not “tens of tho

Snap CEO Evan Spiegel will reappear at Disrupt 2019-04-18 13:00:27He invented modern social media, then had it stolen from him. So how does Evan Spiegel feel about it, and how will he turn Snapchat’s product le

Wonderloop’s networking app lets you swipe left on 2019-04-17 17:00:40There isn’t much left to be done in online networking apps. We are all familiar with professional (LinkedIn), social (Facebook), real time (Twit

Twitter acqui-hires highlight-sharing app Highly 2019-04-17 14:19:18Quotes from articles are much more eye-catching than links on Twitter, so the social giant is scooping up the team behind highlight-sharing app Highly

How-to video maker Jumprope launches to leapfrog YouTube 2019-04-17 12:13:02Sick of pausing and rewinding YouTube tutorials to replay that tricky part? Jumprope is a new instructional social network offering a powerful how-to

Meet the first judges for The Europas Awards 2019-04-17 10:06:11I’m excited to announce that The Europas Awards for European Tech Startups is really shaping up! The awards will be held on 27 June 2019, in Lon

Facebook’s Portal will now surveil your living room 2019-04-16 17:39:00No, you’re not misremembering the details from that young adult dystopian fiction you’re reading — Facebook really does sell a video

Jack Dorsey says it’s time to rethink the 2019-04-16 14:06:12Twitter CEO Jack Dorsey took the stage today at the TED conference. But instead of giving the standard talk, he answered questions from TED’s Ch

Mashable

Best TV deals this week: Save on Sony New! 2019-04-22 13:53:32Now that Easter weekend is over, we're officially on the fast track to summer. Opportunities to use chilly weather as an excuse for spending Friday n

Richard Madden shares ‘Game of Thrones’ throwback picture New! 2019-04-22 13:51:02The actor took to Instagram to share a picture of himself and fellow castmates before the hit HBO show began. Read more...More about Mashable Video, G

BTS' 'Boy With Luv' shatters viewing records on New! 2019-04-22 13:50:29The male K-Pop group's latest song notched 100 million views in less than 48 hours. It is the quickest to ever hit the milestone on YouTube. Read mor

Scientists successfully 3D-prints heart from human cells New! 2019-04-22 13:49:57Professor Cal Dvir is the first person to engineer and print an entire heart filled with cells, blood vessels, ventricles, and chambers. Read more...M

'Knock Down the House' trailer provides inspiring insight New! 2019-04-22 13:09:26 Rachel Lears's moving documentary Knock Down the House chronicles the merited campaigns of four progressive women candidates — Alexandria Oc

This charging hub can power six devices at New! 2019-04-22 13:08:29Between your laptop, tablet, phone, earphones, and smartwatch, charging them all at once is one giant headache. Combine your collection of gadgets wit

This portable safe bag is the perfect accessory 2019-04-22 12:37:44Summer is coming. As you plot the days you're planning on going to the beach to soak up the sun, thieves are also rubbing their hands in anticipation

This 55-inch 4K TV from Insignia has built-in 2019-04-22 12:25:31The TV market is like the wild, wild west, but that doesn't mean you should wait until Black Friday sales tell you which one to get. Summer 2019 dese

Dell’s G3 gaming laptop lets you take your 2019-04-22 12:17:06Many PC gamers claim that playing on a personal computer is the best way to experience video games in general due to their power, customization option

Cuisinart's juice extractor is on sale for $34 2019-04-22 12:05:49If you’ve been toying with the idea of at-home juicing, now is a good time to take the leap and commit. Fruits and veggies are coming back into

Samsung will delay the U.S. release of its 2019-04-22 12:03:02UPDATE: April 22, 2019, 1:07 p.m. ET: This story was updated to include the news that Samsung confirmed it was delaying the launch of the Samsung Gala

Jon Snow just did the one thing every 2019-04-22 11:40:56Of all the great houses in Game of Thrones, House Stark is the one best known for adhering to a sense of honor. They are a strong, stalwart house who

The Next Web

Post Foldgate, Samsung delays Galaxy Fold launch in 2019-04-22 04:20:08Samsung has reportedly postponed the launch events for its $2,000 Galaxy Fold smartphone in Hong Kong and Shanghai, according to reports by SamMobile

Why philosophy and business should go hand in 2019-04-22 04:00:14Business people and entrepreneurs like myself often talk about ‘nice to have’ and ‘need to have.’ The latter refers to things

CHEAP: Level up your gaming with $300 off 2019-04-22 03:31:08If you spend plenty of time playing PlayerUnknown’s Battlegrounds (PUBG) or Fortnite on your phone, it might be worth upgrading to something tha

What founders can learn from poker players about 2019-04-22 02:30:03As entrepreneurs and creatives, we are often told to never quit in pursuit of our dreams. Conversely, professional gamblers and e-sports players are t

Full moon patents: IBM’s ‘eye contact’ file transfer 2019-04-22 01:00:15Ugh, the Gregorian calendar is so boring. That’s why we’re disrupting monthly series with a lunar cycle-based series about the best patent

Score a domain that better suits what you 2019-04-21 09:00:00While .com addresses are stacked to the rafters, new top-level domains like .tech are fresh and ready to accommodate for the right businesses and serv

CHEAP: At $599, Lenovo’s 2018 Premium ThinkPad is 2019-04-21 08:24:14Your kids or your parents might often ask you to borrow your computer just when you need it the most. So, it’s never a bad idea to keep another

Readitfor.me boils down bestsellers in just 12 minutes 2019-04-20 09:00:00With Readitfor.me, you’ll have access to some of the greatest books ever written on business and self-improvement, all boiled down to their esse

Cornell scientists create ‘living’ machines that eat, grow, 2019-04-19 18:56:11The field of robotics is going through a renaissance thanks to advances in machine learning and sensor technology. Each generation of robot is enginee

Happy 4/20: Here’s some science to shut up 2019-04-19 15:08:50April 20th is a holy day for many who imbibe cannabis. For some, it’s just a great day to watch stoner flicks and smoke herb all day. Others vie

A Q&A with Roland CEO Jun-ichi Miki on 2019-04-19 12:34:53The Roland Corporation is a global powerhouse in the field of music technology. We interviewed Mr. Jun-ichi Miki, Roland Corporation CEO and Represent

TNW2019 Daily: The latest conference news 2019-04-19 11:19:04In the blink of an eye, it’s suddenly Friday again. The countdown to TNW Conference is going by in a flash! With only 20 days to go, let’s

Entrepreneur

How Raising Your Prices Can Actually Help You New! 2019-04-22 13:30:00Plus, this Amazon entrepreneur breaks down how to make the most of the online marketplace.

Why Young Professionals Don't Negotiate Salary (and Why 2019-04-22 11:00:00Getting paid what you are worth requires more deliberate planning than most employees -- and entrepreneurs -- are willing to implement.

Was That CBD Gum Tiger Woods and Phil 2019-04-22 11:00:00Only they know if it's CBD gum they were chewing but there are many reasons why they might.

7 Essential Strategies You Can Use to Grow 2019-04-22 10:30:00It's important to remain optimistic while running your own company.

The Far-Reaching Impact of Embedding a Sustainable Workplace 2019-04-22 10:00:00Today's observance is a great opportunity to put 'sustainability' into your mission statement if it's not already there.

These Types of Music Will Improve Your Productivity 2019-04-22 09:45:00Here are three types of music that will give you a major boost in productivity.

How to Find an Introvert-Friendly Work Culture 2019-04-22 09:30:00How can an introvert get the alone time they crave and need in an office environment?

Read More In Less Time With the Leading 2019-04-22 09:30:00Readitfor.me is the leading book-summary service for entrepreneurs, executives and business coaches.

How a Million-Dollar Deal Helped These Coffee Entrepreneur 2019-04-22 09:00:00The Barrow brothers, owners of Denver-based Boyer's Coffee, recently launched an exclusive line for the retail giant.

How the 'LinkedIn on Steroids' Sales Navigator App 2019-04-22 08:45:00Let us show you how this premium app could be worth its weight in superior sales leads.

How These Women CEOs Raise Money in Rooms 2019-04-22 08:30:00The founders of furniture startup Hutch talk about the various obstacles they've come up against while fundraising.

Are You Doing These 3 Things to Foster 2019-04-22 08:30:00It's never too late to course-correct and treat your customers as if they are welcome guests and members of a valued community.

E-Commerce Times

Philanthropy Is Good for Business 2019-04-16 14:22:07The other day Salesforce announced that it was integrating its philanthropic arm, the nonprofit Salesforce.org, into the larger organization, Salesfor

Hackers Use Microsoft Help Desk to Pull Off 2019-04-16 13:31:06Hackers piggybacked onto a Microsoft customer support portal between Jan. 1 and March 28 to gain access to the emails of noncorporate account holders

The Rise of Headless Commerce 2019-04-15 15:49:52"Headless commerce" has become an e-commerce buzzword lately, but how can brands use it to their advantage? "In its most basic terms, 'headless co

SEO: How Important Is It to Make the 2019-04-12 08:00:00In a recent E-Commerce Times poll, only 4.32 percent of respondents said there was always enough information on the first page of search results to me

What Matters Most in the Race to 5G 2019-04-11 14:01:34With 5G knocking on our door, a growing number of wireless competitors have been getting on their high-horses and trying to knock down the current lea

What Sellers Are Missing From CRM 2019-04-11 08:00:00As the B2B buyer continues to evolve, B2B sellers have more solutions than ever in their technology stacks. From CRM, sales content and asset manageme

Alphabet's Wing Delivery Service Takes Flight in Australia 2019-04-10 15:43:16Alphabet's Project Wing on Monday launched a commercial air delivery service in North Canberra, Australia, providing customers with fresh food, hot c

Social Media's Next Act 2019-04-09 15:07:19A little over 10 years ago, we were toasting social media as the great innovation that would enable CRM to traverse the mythical last mile between ven

10 Steps to Create a Seamless Omnichannel Business 2019-04-09 08:00:00During the last year, longstanding brick-and-mortar retailer chains such as Toys "R" Us, Payless, and Diesel USA have filed for bankruptcy. Failures

Zuckerberg Tries, Tries Again 2019-04-06 08:00:00Mark Zuckerberg's most recent effort to change the conversation about Facebook seems like just another attempt at self-justification. In a recent op-

The Power of Influencer Marketing 2019-04-05 08:00:00Influencer marketing uses the popularity of people who have many followers and a wide reach to sway opinions. It's very much a strategy for the socia

With More Than 8 Billion Things, Where Are 2019-04-04 12:12:02No knows for sure how many "things" are connected to the Internet, but the Federal Trade Commission reported last year that it was more than 8 billi

Social News Daily

He’s the President of the U.S. Virgin Islands 2019-04-19 12:04:01Donald Trump is a moron. And not just for being the President of the United States. He has proven to be dumber than the average Joe by not knowing som

The New Child’s Play Trailer Has Arrived – 2019-04-18 20:17:01There is a Child’s Play reboot on the way and a new trailer just released for it. And, guess what? It appears every bit as spooky as the origina

Canadians Are on the Hunt For a “Tiny 2019-04-18 18:12:59Well, this is the most magical news story we’ve heard in ages (perhaps ever). Canadian citizens are on the hunt for a “tiny pink horse&rdq

Former Heroin Addict Who Almost Lost Arms to 2019-04-18 17:34:26An ex-heroin user is sharing photos of her drug-ravaged arms online in a bid to help other addicts. Drugs survivor Rachael Keogh posted the disturbing

After He Tried To Break Up Woman Beat 2019-04-18 16:42:12A woman, who beat down her boyfriend with his own prosthetic leg because he attempted to break up with her, was arrested on Wednesday. Michelle Jackso

Twitch Streamer Banned After Blackface Cosplay Of Black 2019-04-18 12:57:32Casual racism is as much a problem as intended racism. It might not be as dangerous, but it can be unaddressed, owing to the fact that it is often unn

Urine For A Treat: Yoga Master Snorts His 2019-04-18 12:15:21Urine is not usually what comes to mind when looking for some health hacks and tricks. However, previous civilizations, such a the Romans have actuall

6 Illogical Statements Made By Betsy DeVos That 2019-04-18 11:02:33Education Secretary Betsy DeVos is hardly known for being a wordsmith. More often than not, when she speaks she ends up putting her foot in her mouth.

Science Teacher Reportedly Taught Students To Make Ecstasy 2019-04-18 09:44:02Professor Tatsunori Iwamura allegedly admitted coaxing students in his pharmaceutical class at Matsuyama University to make 3,4-Methylenedioxymethamph

Dead Bodies Can Attend Their Own Funerals With 2019-04-17 16:46:48Dead bodies are being preserved and exhibited in life-like situations so loved ones can view them as they knew before they are ultimately laid to rest

Couple Do DNA Test “For Fun” and Accidentally 2019-04-17 12:57:43Based on the internet, doing a DNA test “for fun” is never a good idea. Companies such as 23 and Me and ancestry.com make DNA tests seem l

Space Junk Could Darken Skies, Block Sunlight In 2019-04-17 11:04:37Ever since rockets have been made capable of breaking through the Earth’s atmosphere, mankind has been sending countless space junk just above t


Disclaimer and Notice:WorldProNews.com is not responsible of these news or any information published on this website.