Also by Roger McNamee

The New Normal

The Moonalice Legend: Posters and Words, Volumes 1–9

PENGUIN PRESS

An imprint of Penguin Random House LLC

penguinrandomhouse.com

Copyright © 2019 by Roger McNamee

Penguin supports copyright. Copyright fuels creativity, encourages diverse voices, promotes free speech, and creates a vibrant culture. Thank you for buying an authorized edition of this book and for complying with copyright laws by not reproducing, scanning, or distributing any part of it in any form without permission. You are supporting writers and allowing Penguin to continue to publish books for every reader.

“The Current Moment in History,” remarks by George Soros delivered at the World Economic Forum meeting, Davos, Switzerland, January 25, 2018. Reprinted by permission of George Soros.

LIBRARY OF CONGRESS CATALOGING-IN-PUBLICATION DATA

Names: McNamee, Roger, author.

Title: Zucked : waking up to the facebook catastrophe / Roger McNamee.

Description: New York : Penguin Press, 2019. | Includes bibliographical references and index.

Identifiers: LCCN 2018048578 (print) | LCCN 2018051479 (ebook) | ISBN 9780525561361 (ebook) | ISBN 9780525561354 (hardcover) | ISBN 9781984877895 (export)

Subjects: LCSH: Facebook (Electronic resource)—Social aspects. | Online social networks—Political aspects—United States. | Disinformation—United States. | Propaganda—Technological innovations. | Zuckerberg, Mark, 1984– —Influence. | United States—Politics and government.

Classification: LCC HM743.F33 (ebook) | LCC HM743.F33 M347 2019 (print) | DDC 302.30285—dc23

LC record available at https://lccn.loc.gov/2018048578

While the author has made every effort to provide accurate telephone numbers, internet addresses, and other contact information at the time of publication, neither the publisher nor the author assumes any responsibility for errors or for changes that occur after publication. Further, the publisher does not have any control over and does not assume any responsibility for author or third-party websites or their content.

Version_1

To Ann, who inspires me every day

Technology is neither good nor bad; nor is it neutral.

—Melvin Kranzberg’s First Law of Technology

We cannot solve our problems with the same thinking we used when we created them.

—Albert Einstein

Ultimately, what the tech industry really cares about is ushering in the future, but it conflates technological progress with societal progress.

—Jenna Wortham

CONTENTS

Also by Roger McNamee

Title Page

Copyright

Dedication

Epigraph

Prologue

1  The Strangest Meeting Ever

2  Silicon Valley Before Facebook

3  Move Fast and Break Things

4  The Children of Fogg

5  Mr. Harris and Mr. McNamee Go to Washington

6  Congress Gets Serious

7  The Facebook Way

8  Facebook Digs in Its Heels

9  The Pollster

10  Cambridge Analytica Changes Everything

11  Days of Reckoning

12  Success?

13  The Future of Society

14  The Future of You

Epilogue

Acknowledgments

Appendix 1: Memo to Zuck and Sheryl: Draft Op-Ed for Recode

Appendix 2: George Soros’s Davos Remarks: “The Current Moment in History”

Bibliographic Essay

Index

About the Author

Prologue

Technology is a useful servant but a dangerous master. —CHRISTIAN LOUS LANGE

November 9, 2016

“The Russians used Facebook to tip the election!”

So began my side of a conversation the day after the presidential election. I was speaking with Dan Rose, the head of media partnerships at Facebook. If Rose was taken aback by how furious I was, he hid it well.

Let me back up. I am a longtime tech investor and evangelist. Tech had been my career and my passion, but by 2016, I was backing away from full-time professional investing and contemplating retirement. I had been an early advisor to Facebook founder Mark Zuckerberg—Zuck, to many colleagues and friends—and an early investor in Facebook. I had been a true believer for a decade. Even at this writing, I still own shares in Facebook. In terms of my own narrow self-interest, I had no reason to bite Facebook’s hand. It would never have occurred to me to be an anti-Facebook activist. I was more like Jimmy Stewart in Hitchcock’s Rear Window. He is minding his own business, checking out the view from his living room, when he sees what looks like a crime in progress, and then he has to ask himself what he should do. In my case, I had spent a career trying to draw smart conclusions from incomplete information, and one day early in 2016 I started to see things happening on Facebook that did not look right. I started pulling on that thread and uncovered a catastrophe. In the beginning, I assumed that Facebook was a victim and I just wanted to warn my friends. What I learned in the months that followed shocked and disappointed me. I learned that my trust in Facebook had been misplaced.

This book is the story of why I became convinced, in spite of myself, that even though Facebook provided a compelling experience for most of its users, it was terrible for America and needed to change or be changed, and what I have tried to do about it. My hope is that the narrative of my own conversion experience will help others understand the threat. Along the way, I will share what I know about the technology that enables internet platforms like Facebook to manipulate attention. I will explain how bad actors exploit the design of Facebook and other platforms to harm and even kill innocent people. How democracy has been undermined because of design choices and business decisions by internet platforms that deny responsibility for the consequences of their actions. How the culture of these companies causes employees to be indifferent to the negative side effects of their success. At this writing, there is nothing to prevent more of the same.

This is a story about trust. Technology platforms, including Facebook and Google, are the beneficiaries of trust and goodwill accumulated over fifty years by earlier generations of technology companies. They have taken advantage of our trust, using sophisticated techniques to prey on the weakest aspects of human psychology, to gather and exploit private data, and to craft business models that do not protect users from harm. Users must now learn to be skeptical about products they love, to change their online behavior, insist that platforms accept responsibility for the impact of their choices, and push policy makers to regulate the platforms to protect the public interest.

This is a story about privilege. It reveals how hypersuccessful people can be so focused on their own goals that they forget that others also have rights and privileges. How it is possible for otherwise brilliant people to lose sight of the fact that their users are entitled to self-determination. How success can breed overconfidence to the point of resistance to constructive feedback from friends, much less criticism. How some of the hardest working, most productive people on earth can be so blind to the consequences of their actions that they are willing to put democracy at risk to protect their privilege.

This is also a story about power. It describes how even the best of ideas, in the hands of people with good intentions, can still go terribly wrong. Imagine a stew of unregulated capitalism, addictive technology, and authoritarian values, combined with Silicon Valley’s relentlessness and hubris, unleashed on billions of unsuspecting users. I think the day will come, sooner than I could have imagined just two years ago, when the world will recognize that the value users receive from the Facebook-dominated social media/attention economy revolution masked an unmitigated disaster for our democracy, for public health, for personal privacy, and for the economy. It did not have to be that way. It will take a concerted effort to fix it.

When historians finish with this corner of history, I suspect that they will cut Facebook some slack about the poor choices that Zuck, Sheryl Sandberg, and their team made as the company grew. I do. Making mistakes is part of life, and growing a startup to global scale is immensely challenging. Where I fault Facebook—and where I believe history will, as well—is for the company’s response to criticism and evidence. They had an opportunity to be the hero in their own story by taking responsibility for their choices and the catastrophic outcomes those choices produced. Instead, Zuck and Sheryl chose another path.

This story is still unfolding. I have written this book now to serve as a warning. My goals are to make readers aware of a crisis, help them understand how and why it happened, and suggest a path forward. If I achieve only one thing, I hope it will be to make the reader appreciate that he or she has a role to play in the solution. I hope every reader will embrace the opportunity.

It is possible that the worst damage from Facebook and the other internet platforms is behind us, but that is not where the smart money will place its bet. The most likely case is that the technology and business model of Facebook and others will continue to undermine democracy, public health, privacy, and innovation until a countervailing power, in the form of government intervention or user protest, forces change.

—

TEN DAYS BEFORE the November 2016 election, I had reached out formally to Mark Zuckerberg and Facebook chief operating officer Sheryl Sandberg, two people I considered friends, to share my fear that bad actors were exploiting Facebook’s architecture and business model to inflict harm on innocent people, and that the company was not living up to its potential as a force for good in society. In a two-page memo, I had cited a number of instances of harm, none actually committed by Facebook employees but all enabled by the company’s algorithms, advertising model, automation, culture, and value system. I also cited examples of harm to employees and users that resulted from the company’s culture and priorities. I have included the memo in the appendix.

Zuck created Facebook to bring the world together. What I did not know when I met him but would eventually discover was that his idealism was unbuffered by realism or empathy. He seems to have assumed that everyone would view and use Facebook the way he did, not imagining how easily the platform could be exploited to cause harm. He did not believe in data privacy and did everything he could to maximize disclosure and sharing. He operated the company as if every problem could be solved with more or better code. He embraced invasive surveillance, careless sharing of private data, and behavior modification in pursuit of unprecedented scale and influence. Surveillance, the sharing of user data, and behavioral modification are the foundation of Facebook’s success. Users are fuel for Facebook’s growth and, in some cases, the victims of it.

When I reached out to Zuck and Sheryl, all I had was a hypothesis that bad actors were using Facebook to cause harm. I suspected that the examples I saw reflected systemic flaws in the platform’s design and the company’s culture. I did not emphasize the threat to the presidential election, because at that time I could not imagine that the exploitation of Facebook would affect the outcome, and I did not want the company to dismiss my concerns if Hillary Clinton won, as was widely anticipated. I warned that Facebook needed to fix the flaws or risk its brand and the trust of users. While it had not inflicted harm directly, Facebook was being used as a weapon, and users had a right to expect the company to protect them.

The memo was a draft of an op-ed that I had written at the invitation of the technology blog Recode. My concerns had been building throughout 2016 and reached a peak with the news that the Russians were attempting to interfere in the presidential election. I was increasingly freaked out by what I had seen, and the tone of the op-ed reflected that. My wife, Ann, wisely encouraged me to send the op-ed to Zuck and Sheryl first, before publication. I had been one of Zuck’s many advisors in Facebook’s early days, and I played a role in Sheryl’s joining the company as chief operating officer. I had not been involved with the company since 2009, but I remained a huge fan. My small contribution to the success of one of the greatest companies ever to come out of Silicon Valley was one of the true highlights of my thirty-four-year career. Ann pointed out that communicating through an op-ed might cause the wrong kind of press reaction, making it harder for Facebook to accept my concerns. My goal was to fix the problems at Facebook, not embarrass anyone. I did not imagine that Zuck and Sheryl had done anything wrong intentionally. It seemed more like a case of unintended consequences of well-intended strategies. Other than a handful of email exchanges, I had not spoken to Zuck in seven years, but I had interacted with Sheryl from time to time. At one point, I had provided them with significant value, so it was not crazy to imagine that they would take my concerns seriously. My goal was to persuade Zuck and Sheryl to investigate and take appropriate action. The publication of the op-ed could wait a few days.

Zuck and Sheryl each responded to my email within a matter of hours. Their replies were polite but not encouraging. They suggested that the problems I cited were anomalies that the company had already addressed, but they offered to connect me with a senior executive to hear me out. The man they chose was Dan Rose, a member of their inner circle with whom I was friendly. I spoke with Dan at least twice before the election. Each time, he listened patiently and repeated what Zuck and Sheryl had said, with one important addition: he asserted that Facebook was technically a platform, not a media company, which meant it was not responsible for the actions of third parties. He said it like that should have been enough to settle the matter.

Dan Rose is a very smart man, but he does not make policy at Facebook. That is Zuck’s role. Dan’s role is to carry out Zuck’s orders. It would have been better to speak with Zuck, but that was not an option, so I took what I could get. Quite understandably, Facebook did not want me to go public with my concerns, and I thought that by keeping the conversation private, I was far more likely to persuade them to investigate the issues that concerned me. When I spoke to Dan the day after the election, it was obvious to me that he was not truly open to my perspective; he seemed to be treating the issue as a public relations problem. His job was to calm me down and make my concerns go away. He did not succeed at that, but he could claim one victory: I never published the op-ed. Ever the optimist, I hoped that if I persisted with private conversations, Facebook would eventually take the issue seriously.

I continued to call and email Dan, hoping to persuade Facebook to launch an internal investigation. At the time, Facebook had 1.7 billion active users. Facebook’s success depended on user trust. If users decided that the company was responsible for the damage caused by third parties, no legal safe harbor would protect it from brand damage. The company was risking everything. I suggested that Facebook had a window of opportunity. It could follow the example of Johnson & Johnson when someone put poison in a few bottles of Tylenol on retail shelves in Chicago in 1982. J&J immediately withdrew every bottle of Tylenol from every retail location and did not reintroduce the product until it had perfected tamperproof packaging. The company absorbed a short-term hit to earnings but was rewarded with a huge increase in consumer trust. J&J had not put the poison in those bottles. It might have chosen to dismiss the problem as the work of a madman. Instead, it accepted responsibility for protecting its customers and took the safest possible course of action. I thought Facebook could convert a potential disaster into a victory by doing the same thing.

One problem I faced was that at this point I did not have data for making my case. What I had was a spidey sense, honed during a long career as a professional investor in technology.

I had first become seriously concerned about Facebook in February 2016, in the run-up to the first US presidential primary. As a political junkie, I was spending a few hours a day reading the news and also spending a fair amount of time on Facebook. I noticed a surge on Facebook of disturbing images, shared by friends, that originated on Facebook Groups ostensibly associated with the Bernie Sanders campaign. The images were deeply misogynistic depictions of Hillary Clinton. It was impossible for me to imagine that Bernie’s campaign would allow them. More disturbing, the images were spreading virally. Lots of my friends were sharing them. And there were new images every day.

I knew a great deal about how messages spread on Facebook. For one thing, I have a second career as a musician in a band called Moonalice, and I had long been managing the band’s Facebook page, which enjoyed high engagement with fans. The rapid spread of images from these Sanders-associated pages did not appear to be organic. How did the pages find my friends? How did my friends find the pages? Groups on Facebook do not emerge full grown overnight. I hypothesized that somebody had to be spending money on advertising to get the people I knew to join the Facebook Groups that were spreading the images. Who would do that? I had no answer. The flood of inappropriate images continued, and it gnawed at me.

More troubling phenomena caught my attention. In March 2016, for example, I saw a news report about a group that exploited a programming tool on Facebook to gather data on users expressing an interest in Black Lives Matter, data that they then sold to police departments, which struck me as evil. Facebook banned the group, but not until after irreparable harm had been done. Here again, a bad actor had used Facebook tools to harm innocent victims.

In June 2016, the United Kingdom voted to exit the European Union. The outcome of the Brexit vote came as a total shock. Polling had suggested that “Remain” would triumph over “Leave” by about four points, but precisely the opposite happened. No one could explain the huge swing. A possible explanation occurred to me. What if Leave had benefited from Facebook’s architecture? The Remain campaign was expected to win because the UK had a sweet deal with the European Union: it enjoyed all the benefits of membership, while retaining its own currency. London was Europe’s undisputed financial hub, and UK citizens could trade and travel freely across the open borders of the continent. Remain’s “stay the course” message was based on smart economics but lacked emotion. Leave based its campaign on two intensely emotional appeals. It appealed to ethnic nationalism by blaming immigrants for the country’s problems, both real and imaginary. It also promised that Brexit would generate huge savings that would be used to improve the National Health Service, an idea that allowed voters to put an altruistic shine on an otherwise xenophobic proposal.

The stunning outcome of Brexit triggered a hypothesis: in an election context, Facebook may confer advantages to campaign messages based on fear or anger over those based on neutral or positive emotions. It does this because Facebook’s advertising business model depends on engagement, which can best be triggered through appeals to our most basic emotions. What I did not know at the time is that while joy also works, which is why puppy and cat videos and photos of babies are so popular, not everyone reacts the same way to happy content. Some people get jealous, for example. “Lizard brain” emotions such as fear and anger produce a more uniform reaction and are more viral in a mass audience. When users are riled up, they consume and share more content. Dispassionate users have relatively little value to Facebook, which does everything in its power to activate the lizard brain. Facebook has used surveillance to build giant profiles on every user and provides each user with a customized Truman Show, similar to the Jim Carrey film about a person who lives his entire life as the star of his own television show. It starts out giving users “what they want,” but the algorithms are trained to nudge user attention in directions that Facebook wants. The algorithms choose posts calculated to press emotional buttons because scaring users or pissing them off increases time on site. When users pay attention, Facebook calls it engagement, but the goal is behavior modification that makes advertising more valuable. I wish I had understood this in 2016. At this writing, Facebook is the fourth most valuable company in America, despite being only fifteen years old, and its value stems from its mastery of surveillance and behavioral modification.

When new technology first comes into our lives, it surprises and astonishes us, like a magic trick. We give it a special place, treating it like the product equivalent of a new baby. The most successful tech products gradually integrate themselves into our lives. Before long, we forget what life was like before them. Most of us have that relationship today with smartphones and internet platforms like Facebook and Google. Their benefits are so obvious we can’t imagine foregoing them. Not so obvious are the ways that technology products change us. The process has repeated itself in every generation since the telephone, including radio, television, and personal computers. On the plus side, technology has opened up the world, providing access to knowledge that was inaccessible in prior generations. It has enabled us to create and do remarkable things. But all that value has a cost. Beginning with television, technology has changed the way we engage with society, substituting passive consumption of content and ideas for civic engagement, digital communication for conversation. Subtly and persistently, it has contributed to our conversion from citizens to consumers. Being a citizen is an active state; being a consumer is passive. A transformation that crept along for fifty years accelerated dramatically with the introduction of internet platforms. We were prepared to enjoy the benefits but unprepared for the dark side. Unfortunately, the same can be said for the Silicon Valley leaders whose innovations made the transformation possible.

If you are a fan of democracy, as I am, this should scare you. Facebook has become a powerful source of news in most democratic countries. To a remarkable degree it has made itself the public square in which countries share ideas, form opinions, and debate issues outside the voting booth. But Facebook is more than just a forum. It is a profit-maximizing business controlled by one person. It is a massive artificial intelligence that influences every aspect of user activity, whether political or otherwise. Even the smallest decisions at Facebook reverberate through the public square the company has created with implications for every person it touches. The fact that users are not conscious of Facebook’s influence magnifies the effect. If Facebook favors inflammatory campaigns, democracy suffers.

August 2016 brought a new wave of stunning revelations. Press reports confirmed that Russians had been behind the hacks of servers at the Democratic National Committee (DNC) and Democratic Congressional Campaign Committee (DCCC). Emails stolen in the DNC hack were distributed by WikiLeaks, causing significant damage to the Clinton campaign. The chairman of the DCCC pleaded with Republicans not to use the stolen data in congressional campaigns. I wondered if it were possible that Russians had played a role in the Facebook issues that had been troubling me earlier.

Just before I wrote the op-ed, ProPublica revealed that Facebook’s advertising tools enabled property owners to discriminate based on race, in violation of the Fair Housing Act. The Department of Housing and Urban Development opened an investigation that was later closed, but reopened in April 2018. Here again, Facebook’s architecture and business model enabled bad actors to harm innocent people.

Like Jimmy Stewart in the movie, I did not have enough data or insight to understand everything I had seen, so I sought to learn more. As I did so, in the days and weeks after the election, Dan Rose exhibited incredible patience with me. He encouraged me to send more examples of harm, which I did. Nothing changed. Dan never budged. In February 2017, more than three months after the election, I finally concluded that I would not succeed in convincing Dan and his colleagues; I needed a different strategy. Facebook remained a clear and present danger to democracy. The very same tools that made Facebook a compelling platform for advertisers could also be exploited to inflict harm. Facebook was getting more powerful by the day. Its artificial intelligence engine learned more about every user. Its algorithms got better at pressing users’ emotional buttons. Its tools for advertisers improved constantly. In the wrong hands, Facebook was an ever-more-powerful weapon. And the next US election—the 2018 midterms—was fast approaching.

Yet no one in power seemed to recognize the threat. The early months of 2017 revealed extensive relationships between officials of the Trump campaign and people associated with the Russian government. Details emerged about a June 2016 meeting in Trump Tower between inner-circle members of the campaign and Russians suspected of intelligence affiliations. Congress spun up Intelligence Committee investigations that focused on that meeting.

But still there was no official concern about the role that social media platforms, especially Facebook, had played in the 2016 election. Every day that passed without an investigation increased the likelihood that the interference would continue. If someone did not act quickly, our democratic processes could be overwhelmed by outside forces; the 2018 midterm election would likely be subject to interference, possibly greater than we had seen in 2016. Our Constitution anticipated many problems, but not the possibility that a foreign country could interfere in our elections without consequences. I could not sit back and watch. I needed some help, and I needed a plan, not necessarily in that order.

1

The Strangest Meeting Ever

New technology is not good or evil in and of itself. It’s all about how people choose to use it. —DAVID WONG

I should probably tell the story of how I intersected with Facebook in the first place. In the middle of 2006, Facebook’s chief privacy officer, Chris Kelly, sent me an email stating that his boss was facing an existential crisis and required advice from an unbiased person. Would I be willing to meet with Mark Zuckerberg?

Facebook was two years old, Zuck was twenty-two, and I was fifty. The platform was limited to college students, graduates with an alumni email address, and high school students. News Feed, the heart of Facebook’s user experience, was not yet available. The company had only nine million dollars in revenue in the prior year. But Facebook had huge potential—that was already obvious—and I leapt at the opportunity to meet its founder.

Zuck showed up at my Elevation Partners office on Sand Hill Road in Menlo Park, California, dressed casually, with a messenger bag over his shoulder. U2 singer Bono and I had formed Elevation in 2004, along with former Apple CFO Fred Anderson, former Electronic Arts president John Riccitiello, and two career investors, Bret Pearlman and Marc Bodnick. We had configured one of our conference rooms as a living room, complete with a large arcade video game system, and that is where Zuck and I met. We closed the door and sat down on comfy chairs about three feet apart. No one else was in the room.

Since this was our first meeting, I wanted to say something before Zuck told me about the existential crisis.

“If it has not already happened, Mark, either Microsoft or Yahoo is going to offer one billion dollars for Facebook. Your parents, your board of directors, your management team, and your employees are going to tell you to take the offer. They will tell you that with your share of the proceeds—six hundred and fifty million dollars—you will be able to change the world. Your lead venture investor will promise to back your next company so that you can do it again.

“It’s your company, but I don’t think you should sell. A big company will screw up Facebook. I believe you are building the most important company since Google and that before long you will be bigger than Google is today. You have two huge advantages over previous social media platforms: you insist on real identity and give consumers control over their privacy settings.

“In the long run, I believe Facebook will be far more valuable to parents and grandparents than to college students and recent grads. People who don’t have much time will love Facebook, especially when families have the opportunity to share photos of kids and grandkids.

“Your board of directors, management team, and employees signed up for your vision. If you still believe in your vision, you need to keep Facebook independent. Everyone will eventually be glad you did.”

This little speech took about two minutes to deliver. What followed was the longest silence I have ever endured in a one-on-one meeting. It probably lasted four or five minutes, but it seemed like forever. Zuck was lost in thought, pantomiming a range of Thinker poses. I have never seen anything like it before or since. It was painful. I felt my fingers involuntarily digging into the upholstered arms of my chair, knuckles white, tension rising to a boiling point. At the three-minute mark, I was ready to scream. Zuck paid me no mind. I imagined thought bubbles over his head, with reams of text rolling past. How long would he go on like this? He was obviously trying to decide if he could trust me. How long would it take? How long could I sit there?

Eventually, Zuck relaxed and looked at me. He said, “You won’t believe this.”

I replied, “Try me.”

“One of the two companies you mentioned wants to buy Facebook for one billion dollars. Pretty much everyone has reacted the way you predicted. They think I should take the deal. How did you know?”

“I didn’t know. But after twenty-four years, I know how Silicon Valley works. I know your lead venture investor. I know Yahoo and Microsoft. This is how things go around here.”

I continued, “Do you want to sell the company?”

He replied, “I don’t want to disappoint everyone.”

“I understand, but that is not the issue. Everyone signed up to follow your vision for Facebook. If you believe in your vision, you need to keep Facebook independent. Yahoo and Microsoft will wreck it. They won’t mean to, but that is what will happen. What do you want to do?”

“I want to stay independent.”

I asked Zuck to explain Facebook’s shareholder voting rules. It turned out he had a “golden vote,” which meant that the company would always do whatever he decided. It took only a couple of minutes to figure that out. The entire meeting took no more than half an hour.

Zuck left my office and soon thereafter told Yahoo that Facebook was not for sale. There would be other offers for Facebook, including a second offer from Yahoo, and he would turn them down, too.

So began a mentorship that lasted three years. In a success story with at least a thousand fathers, I played a tiny role, but I contributed on two occasions that mattered to Facebook’s early success: the Yahoo deal and the hiring of Sheryl. Zuck had other mentors, but he called on me when he thought I could help, which happened often enough that for a few years I was a regular visitor to Facebook’s headquarters. Ours was a purely business relationship. Zuck was so amazingly talented at such a young age, and he leveraged me effectively. It began when Facebook was a little startup with big dreams and boundless energy. Zuck had an idealistic vision of connecting people and bringing them together. The vision inspired me, but the magic was Zuck himself. Obviously brilliant, Zuck possessed a range of characteristics that distinguished him from the typical Silicon Valley entrepreneur: a desire to learn, a willingness to listen, and, above all, a quiet confidence. Many tech founders swagger through life, but the best ones—including the founders of Google and Amazon—are reserved, thoughtful, serious. To me, Facebook seemed like the Next Big Thing that would make the world better through technology. I could see a clear path to one hundred million users, which would have been a giant success. It never occurred to me that success would lead to anything but happiness.

The only skin in the game for me at that time was emotional. I had been a Silicon Valley insider for more than twenty years. My fingerprints were on dozens of great companies, and I hoped that one day Facebook would be another. For me, it was a no-brainer. I did not realize then that the technology of Silicon Valley had evolved into uncharted territory, that I should no longer take for granted that it would always make the world a better place. I am pretty certain that Zuck was in the same boat; I had no doubt then of Zuck’s idealism.

Silicon Valley had had its share of bad people, but the limits of the technology itself had generally prevented widespread damage. Facebook came along at a time when it was possible for the first time to create tech businesses so influential that no country would be immune to their influence. No one I knew ever considered that success could have a downside. From its earliest days, Facebook was a company of people with good intentions. In the years I knew them best, the Facebook team focused on attracting the largest possible audience, not on monetization. Persuasive technology and manipulation never came up. It was all babies and puppies and sharing with friends.

I am not certain when Facebook first applied persuasive technology to its design, but I can imagine that the decision was not controversial. Advertisers and media companies had been using similar techniques for decades. Despite complaints about television from educators and psychologists, few people objected strenuously to the persuasive techniques employed by networks and advertisers. Policy makers and the public viewed them as legitimate business tools. On PCs, those tools were no more harmful than on television. Then came smartphones, which changed everything. User count and usage exploded, as did the impact of persuasive technologies, enabling widespread addiction. That is when Facebook ran afoul of the law of unintended consequences. Zuck and his team did not anticipate that the design choices that made Facebook so compelling for users would also enable a wide range of undesirable behaviors. When those behaviors became obvious after the 2016 presidential election, Facebook first denied their existence, then responsibility for them. Perhaps it was a reflexive corporate reaction. In any case, Zuck, Sheryl, the team at Facebook, and the board of directors missed an opportunity to build a new trust with users and policy makers. Those of us who had advised Zuck and profited from Facebook’s success also bear some responsibility for what later transpired. We suffered from a failure of imagination. The notion that massive success by a tech startup could undermine society and democracy did not occur to me or, so far as I know, to anyone in our community. Now the whole world is paying for it.

In the second year of our relationship, Zuck gave Elevation an opportunity to invest. I pitched the idea to my partners, emphasizing my hope that Facebook would become a company in Google’s class. The challenge was that Zuck’s offer would have us invest in Facebook indirectly, through a complicated, virtual security. Three of our partners were uncomfortable with the structure of the investment for Elevation, but they encouraged the rest of us to make personal investments. So Bono, Marc Bodnick, and I invested. Two years later, an opportunity arose for Elevation to buy stock in Facebook, and my partners jumped on it.

—

WHEN CHRIS KELLY CONTACTED ME, he knew me only by reputation. I had been investing in technology since the summer of 1982. Let me share a little bit of my own history for context, to explain where my mind was when I first entered Zuck’s orbit.

I grew up in Albany, New York, the second youngest in a large and loving family. My parents had six children of their own and adopted three of my first cousins after their parents had a health crisis. One of my sisters died suddenly at two and a half while I was in the womb, an event that had a profound impact on my mother. At age two, I developed a very serious digestive disorder, and doctors told my parents I could not eat grains of any kind. I eventually grew out of it, but until I was ten, I could not eat a cookie, cake, or piece of bread without a terrible reaction. It required self-discipline, which turned out to be great preparation for the life I chose.

My parents were very active in politics and civil rights. The people they taught me to look up to were Franklin Roosevelt and Jackie Robinson. They put me to work on my first political campaign at age four, handing out leaflets for JFK. My father was the president of the Urban League in our home town, which was a big deal in the mid-sixties, when President Johnson pushed the Civil Rights Act and Voting Rights Act through Congress. My mother took me to a civil rights meeting around the time I turned nine so that I could meet my hero, Jackie Robinson.

The year that I turned ten, my parents sent me to summer camp. During the final week, I had a terrible fall during a scavenger hunt. The camp people put me in the infirmary, but I was unable to keep down any food or water for three days, after which I had a raging fever. They took me to a nearby community hospital, where a former military surgeon performed an emergency operation that saved my life. My intestine had been totally blocked by a blood clot. It took six months to recover, costing me half of fourth grade. This turned out to have a profound impact on me. Surviving a near-death experience gave me courage. The recovery reinforced my ability to be happy outside the mainstream. Both characteristics proved valuable in the investment business.

My father worked incredibly hard to support our large family, and he did so well. We lived an upper-middle-class life, but my parents had to watch every penny. My older siblings went off to college when I was in elementary school, so finances were tight some of those years. Being the second youngest in a huge family, I was most comfortable observing the big kids. Health issues reinforced my quiet, observant nature. My mother used me as her personal Find My iPhone whenever she mislaid her glasses, keys, or anything. For some reason, I always knew where everything was.

I was not an ambitious child. Team sports did not play much of a role in my life. It was the sixties, so I immersed myself in the anti-war and civil rights movements from about age twelve. I took piano lessons and sang in a church choir, but my passion for music did not begin until I took up the guitar in my late teens. My parents encouraged me but never pushed. They were role models who prioritized education and good citizenship, but they did not interfere. They expected my siblings and me to make good choices. Through my teenage years, I approached everything but politics with caution, which could easily be confused with reluctance. If you had met me then, you might well have concluded that I would never get around to doing anything.

My high school years were challenging in a different way. I was a good student, but not a great one. I liked school, but my interests were totally different from my classmates’. Instead of sports, I devoted my free time to politics. The Vietnam War remained the biggest issue in the country, and one of my older brothers had already been drafted into the army. It seemed possible that I would reach draft age before the war ended. As I saw it, the rational thing to do was to work to end the war. I volunteered for the McGovern for President campaign in October 1971 and was in the campaign office in either New Hampshire or upstate New York nearly every day from October 1971, the beginning of my tenth-grade year, through the general election thirteen months later. That was the period when I fell in love with the hippie music of San Francisco: the Grateful Dead, Jefferson Airplane, Quicksilver Messenger Service, Big Brother and the Holding Company, and Santana.

I did not like my school, so once the McGovern campaign ended, I applied to School Year Abroad in Rennes, France, for my senior year. It was an amazing experience. Not only did I become fluent in French, I went to school with a group of people who were more like me than any set of classmates before them. The experience transformed me. I applied to Yale University and, to my astonishment, got in.

After my freshman year at Yale, I was awarded an internship with my local congressman, who offered me a permanent job as his legislative assistant a few weeks later. The promotion came with an increase in pay and all the benefits of a full-time job. I said no—I thought the congressman was crazy to promote me at nineteen—but I really liked him and returned for two more summers.

A year later, in the summer of 1976, I took a year off to go to San Francisco with my girlfriend. In my dreams, I was going to the city of the Summer of Love. By the time I got there, though, it was the city of Dirty Harry, more noir than flower power. Almost immediately, my father was diagnosed with inoperable prostate cancer. Trained as a lawyer, my father had started a brokerage firm that grew to a dozen offices. It was an undersized company in an industry that was undergoing massive change. He died in the fall of 1977, at a particularly difficult time for his business, leaving my mother with a house and little else. There was no money for me to return to college. I was on my own, with no college degree. I had my guitar, though, and practiced for many hours every day.

When I first arrived in San Francisco, I had four hundred dollars in my pocket. My dream of being a reporter in the mold of Woodward and Bernstein lasted for about half a day. Three phone calls were all it took to discover that there were no reporter jobs available for a college dropout like me, but every paper needed people in advertising sales. I was way too introverted for traditional sales, but that did not stop me. I discovered a biweekly French-language newspaper where I would be the entire advertising department, which meant not only selling ads but also collecting receivables from advertisers. When you only get paid based on what you collect, you learn to judge the people you sell to. If the ads didn’t work, they wouldn’t pay. I discovered that by focusing on multi-issue advertising commitments from big accounts, such as car dealerships, airlines, and the phone company, I could leverage my time and earn a lot more money per issue. I had no social life, but I started to build savings. In the two and a half years I was in San Francisco, I earned enough money to go back to Yale, which cost no more than 10 percent of what it costs today.

Every weekday morning in San Francisco I watched a locally produced stock market show hosted by Stuart Varney, who went on to a long career in broadcasting at CNN and Fox Business Network. After watching the show for six months and reading Barron’s and stacks of annual reports, I finally summoned the courage to buy one hundred shares of Beech Aircraft. It went up 30 percent in the first week. I was hooked. I discovered that investing was a game, like Monopoly, but with real money. The battle of wits appealed to me. I never imagined then that investing would be my career. In the fall of 1978, I reapplied to Yale. They accepted me again, just weeks before two heartbreaking events chased me from San Francisco: the mass suicide of hundreds of San Franciscans at Jonestown and the murder of San Francisco’s mayor and supervisor Harvey Milk by another member of the city’s board of supervisors.

Celebrating my first Christmas at home since 1975, I received a gift that would change my life. My older brother George, ten years my senior, gave me a Texas Instruments Speak & Spell. Introduced just months earlier, the Speak & Spell combined a keyboard, a one-line alphanumeric display, a voice processor, and some memory to teach elementary school children to pronounce and spell words. But to my brother, it was the future of computing. “This means that in a few years, it will be possible to create a handheld device that holds all your personal information,” he said.

He told me this in 1978. The Apple II had been introduced only a year earlier. The IBM PC was nearly three years in the future. The PalmPilot was more than eighteen years away. But my brother saw the future, and I took it to heart. I went back to college as a history major but was determined to take enough electrical engineering courses that I could design the first personal organizer. I soon discovered that electrical engineering requires calculus, and I had never taken calculus. I persuaded the professor to let me take the entry-level course anyway. He said if I did everything right except the math, he would give me a B (“for bravery”). I accepted. He tutored me every week. I took a second, easier engineering survey course, in which I learned concepts related to acoustics and mechanical engineering. I got catalogues and manuals and tried to design an oversized proof of concept. I could not make it work.

A real highlight of my second swing through Yale was playing in a band called Guff. Three guys in my dorm had started the band, but they needed a guitar player. Guff wrote its own songs and occupied a musical space somewhere near the intersection of the Grateful Dead, Frank Zappa, and punk rock. We played a ton of gigs, but college ended before the band was sufficiently established to justify making a career of it.

The band got paid a little money, but I needed to earn tuition-scale money. Selling ads paid far better than most student jobs, so I persuaded the Yale Law School Film Society to let me create a magazine-style program for their film series. I created a program for both semesters of senior year and earned almost enough money to pay for a year of graduate school.

But before that, in the fall of my senior year, I enrolled in Introduction to Music Theory, a brutal two-semester course for music majors. I was convinced that a basic knowledge of music theory would enable me to write better songs for my band. They randomly assigned me to one of a dozen sections, each with fifteen students, all taught by graduate students. The first class session was the best hour of classroom time I had ever experienced, so I told my roommate to switch from his section to mine. Apparently many others did the same thing, as forty people showed up the second day. That class was my favorite at Yale. The grad student who taught the class, Ann Kosakowski, did not teach the second semester, but early in the new semester, I ran into her as she exited the gymnasium, across the street from my dorm. She was disappointed because she had narrowly lost a squash match in the fifth game to the chair of the music department, so I volunteered to play her the next day. We played squash three days in a row, and I did not win a single point. Not one. But it didn’t matter. I had never played squash and did not care about the score. Ann was amazing. I wanted to get to know her. I invited her on a date to see the Jerry Garcia Band right after Valentine’s Day. A PhD candidate in music theory, Ann asked, “What instrument does Mr. Garcia play?” thinking perhaps it might be the cello. Ann and I are about to celebrate the thirty-ninth anniversary of that first date.

Ann and I graduated together, she a very young PhD, me an old undergraduate. She received a coveted tenure-track position at Swarthmore College, outside of Philadelphia. I could not find a job in Philadelphia, so I enrolled at the Tuck School of Business at Dartmouth, in Hanover, New Hampshire. So began a twenty-one-year interstate commute.

My first job after business school was at T. Rowe Price, in Baltimore, Maryland. It was a lot closer to Philadelphia than Hanover, but still too far to commute every day. That’s when I got hit by two game-changing pieces of good luck: my start date and my coverage group. My career began on the first day of the bull market of 1982, and they asked me to analyze technology stocks. In those days, there were no tech-only funds. T. Rowe Price was the leader in the emerging growth category of mutual funds, which meant they focused on technology more than anyone. I might not be able to make the first personal organizer, I reasoned, but I would be able to invest in it when it came along.

In investing, they say that timing is everything. By assigning me to cover tech on the first day of an epic bull market, T. Rowe Price basically put me in a position where I had a tailwind for my entire career. I can’t be certain that every good thing in my career resulted from that starting condition, but I can’t rule it out either. It was a bull market, so most stocks were going up. In the early days, I just had to produce reports that gave the portfolio managers confidence in my judgment. I did not have a standard pedigree for an analyst, so I decided to see if I could adapt the job to leverage my strengths.

I became an analyst by training, a nerd who gets paid to understand the technology industry. When my career started, most analysts focused primarily on financial statements, but I changed the formula. I have been successful due to an ability to understand products, financial statements, and trends, as well as to judge people. I think of it as real-time anthropology, the study of how humans and technology evolve and interact. I spend most of my time trying to understand the present so I can imagine what might happen in the future. From any position on the chessboard, there are only a limited number of moves. If you understand that in advance and study the possibilities, you will be better prepared to make good choices each time something happens. Despite what people tell you, the technology world does not actually change that much. It follows relatively predictable patterns. Major waves of technology last at least a decade, so the important thing is to recognize when an old cycle is ending and when a new one is starting. As my partner John Powell likes to say, sometimes you can see which body is tied to the railroad tracks before you can see who is driving the train.

The personal computer business started to take off in 1985, and I noticed two things: everyone was my age, and they convened at least monthly in a different city for a conference or trade show. I persuaded my boss to let me join the caravan. Almost immediately I had a stroke of good luck. I was at a conference in Florida when I noticed two guys unloading guitars and amps from the back of a Ford Taurus. Since all guests at the hotel were part of the conference, I asked if there was a jam session I could join. There was. It turns out that the leaders of the PC industry didn’t go out to bars. They rented instruments and played music. When I got to my first jam session, I discovered I had an indispensable skill. Thanks to many years of gigs in bands and bars, I knew a couple hundred songs from beginning to end. No one else knew more than a handful. This really mattered because the other players included the CEO of a major software company, the head of R&D from Apple, and several other industry big shots. Microsoft cofounder Paul Allen played with us from time to time, but only on songs written by Jimi Hendrix. He could shred. Suddenly, I was part of the industry’s social fabric. It is hard to imagine this happening in any other industry, but I was carving my own path.

My next key innovation related to earnings models. Traditional analysts used spreadsheets to forecast earnings, but spreadsheets tend to smooth everything. In tech, where success is binary, hot products always beat the forecast, and products that are not hot always fall short. I didn’t need to worry about earnings models. I just needed to figure out which products were going to be hot. Forecasting products was not easy, but I did not need to be perfect. As with the two guys being chased by a bear, I only needed to do it better than the other guy.

I got my first chance to manage a portfolio in late 1985. I was asked to run the technology sector of one of the firm’s flagship funds; tech represented about 40 percent of the fund. It was the largest tech portfolio in the country at the time, so it was a big promotion and an amazing opportunity. I had been watching portfolio managers for three years, but that did not really prepare me. Portfolio management is a game played with real money. Everyone makes mistakes. What differentiates great portfolio managers is their ability to recognize mistakes early and correct them. Portfolio managers learn by trial and error, with lots of errors. The key is to have more money invested in your good ideas than your bad ones.

T. Rowe launched a pure-play Science & Technology Fund, managed by two of my peers, on September 30, 1987. Nineteen days later, the stock market crashed. Every mutual fund got crushed, and Science & Tech was down 31 percent after only a month in business. While the number was terrible, it was actually better than competitors because the portfolio managers had invested only half their capital when the market collapsed. In the middle of 1988, with the viability of the fund in doubt, the firm reassigned the two managers and asked me to take over. I agreed to do so on one condition: I would run the fund my way. I told my bosses that I intended to be aggressive.

Another piece of amazing luck hit me when T. Rowe Price decided to create a growth-stage venture fund. I was already paying attention to private companies, because in those days, the competition in tech came from startups, not established companies. Over the next few years, I led three key growth-stage venture investments: Electronic Arts, Sybase, and Radius. The lead venture investor in all three companies was Kleiner Perkins Caufield & Byers, one of the leading venture capital firms in Silicon Valley. All three went public relatively quickly, making me popular both at T. Rowe Price and Kleiner Perkins. My primary contact at Kleiner Perkins was a young venture capitalist named John Doerr, whose biggest successes to that point had been Sun Microsystems, Compaq Computer, and Lotus Development. Later, John would be the lead investor in Netscape, Amazon, and Google.

My strategy with the Science & Technology Fund was to focus entirely on emerging companies in the personal computer, semiconductor, and database software industries. I ignored all the established companies, a decision that gave the fund a gigantic advantage. From its launch through the middle of 1991, a period that included the 1987 crash and a second mini-crash in the summer of 1990, the fund achieved a 17 percent per annum return, against 9 percent for the S&P 500 and 6 percent for the technology index. That was when I left T. Rowe Price with John Powell to launch Integral Capital Partners, the first institutional fund to combine public market investments with growth-stage venture capital. We created the fund in partnership with Kleiner Perkins—with John Doerr as our venture capitalist—and Morgan Stanley. Our investors were the people who know us best, the founders and executives of the leading tech companies of that era.

Integral had a charmed run. Being inside the offices of Kleiner Perkins during the nineties meant we were at ground zero for the internet revolution. I was there the day that Marc Andreessen made his presentation for the company that became Netscape, when Jeff Bezos did the same for Amazon, and when Larry Page and Sergey Brin pitched Google. I did not imagine then how big the internet would become, but it did not take long to grasp its transformational nature. The internet would democratize access to information, with benefits to all. Idealism ruled. In 1997, Martha Stewart came in with her home-decorating business, which, thanks to an investment by Kleiner Perkins, soon went public as an internet stock, which seemed insane to me. I was convinced that a mania had begun for dot-coms, embodied in the Pets.com sock puppet and the slapping of a little “e” on the front of a company’s name or a “.com” at the end. I knew that when the bubble burst, there would be a crash that would kill Integral if we did not do something radical.

I took my concerns to our other partner, Morgan Stanley, and they gave me some money to figure out the Next Big Thing in tech investing, a fund that could survive a bear market. It took two years, but Integral launched Silver Lake Partners, the first private equity fund focused on technology. Our investors shared our concerns and committed one billion dollars to the new fund.

Silver Lake planned to invest in mature technology companies. Once a tech company matured in those days, it became vulnerable to competition from startups. Mature companies tend to focus on the needs of their existing customers, which often blinds them to new business opportunities or new technologies. In addition, as growth slows, so too does the opportunity for employees to benefit from stock options, which startups exploit to recruit the best and brightest from established companies. My vision for Silver Lake was to reenergize mature companies by recapitalizing them to enable investment in new opportunities, while also replicating the stock compensation opportunities of a startup. The first Silver Lake fund had extraordinary results, thanks to three investments: Seagate Technology, Datek, and Gartner Group.

During the Silver Lake years, I got a call from the business manager of the Grateful Dead, asking for help. The band’s leader, Jerry Garcia, had died a few years before, leaving the band with no tour to support a staff of roughly sixty people. Luckily, one of the band’s roadies had created a website and sold merchandise directly to fans. The site had become a huge success, and by the time I showed up, it was generating almost as much profit as the band had made in its touring days. Unfortunately, the technology was out of date, but there was an opportunity to upgrade the site, federate it to other bands, and prosper as never before. One of the bands that showed an interest was U2. They found me through a friend of Bono’s at the Department of the Treasury, a woman named Sheryl Sandberg. I met Bono and the Edge at Morgan Stanley’s offices in Los Angeles on the morning after the band had won a Grammy for the song “Beautiful Day.” I could not have named a U2 song, but I was blown away by the intelligence and business sophistication of the two Irishmen. They invited me to Dublin to meet their management. I made two trips during the spring of 2001.

On my way home from that second trip, I suffered a stroke. I didn’t realize it at the time, and I tried to soldier on. Shortly thereafter, after some more disturbing symptoms, I found myself at the Mayo Clinic, where I learned that I had in fact suffered two ischemic strokes, in addition to something called a transient ischemic attack in my brain stem. It was a miracle I had survived the strokes and suffered no permanent impairment.

The diagnosis came as a huge shock. I had a reasonably good diet, a vigorous exercise regime, and a good metabolism, yet I had had two strokes. It turned out that I had a birth defect in my heart, a “patent foramen ovale,” basically the mother of all heart murmurs. I had two choices: I could take large doses of blood thinner and live a quiet life, or I could have open-heart surgery and eliminate the risk forever. I chose surgery.

I had successful surgery in early July 2001, but my recovery was very slow. It took me nearly a year to recover fully. During that time, Apple shipped the first iPod. I thought it was a sign of good things to come and reached out to Steve Jobs to see if he would be interested in recapitalizing Apple. At the time, Apple’s share price was about twelve dollars per share, which, thanks to stock splits, is equivalent to a bit more than one dollar per share today. The company had more than twelve dollars in cash per share, which meant investors were attributing zero value to Apple’s business. Most of the management options had been issued at forty dollars per share, so they were effectively worthless. If Silver Lake did a recapitalization, we could reset the options and align interests between management and shareholders. Apple had lost most of its market share in PCs, but thanks to the iPod and iMac computers, Apple had an opportunity to reinvent itself in the consumer market. The risk/reward of investing struck me as especially favorable. We had several conversations before Steve told me he had a better idea. He wanted me to buy up to 18 percent of Apple shares in the public market and take a board seat.

After a detailed analysis, I proposed an investment to my partners in the early fall of 2002, but they rejected it out of hand. The decision would cost Silver Lake’s investors the opportunity to earn more than one hundred billion dollars in profits.

In early 2003, Bono called up with an opportunity. He wanted to buy Universal Music Group, the world’s largest music label. It was a complicated transaction and took many months of analysis. A team of us did the work and presented it to my other three partners in Silver Lake in September. They agreed to do the deal with Bono, but they stipulated one condition: I would not be part of the deal team. They explained their intention for Silver Lake to go forward as a trio, rather than as a quartet. There had been signals along the way, but I had missed them. I had partnered with deal guys—people who use power when they have it to gain advantages where they can get them—and had not protected myself.

I have never believed in staying where I’m not wanted, so I quit. If I had been motivated by money, I would have hung in there, as there was no way they could force me out. I had conceived the fund, incubated it, brought in the first billion dollars of assets, and played a decisive role on the three most successful investments. But I’m not wired to fight over money. I just quit and walked out. I happened to be in New York and called Bono. He asked me to come to his apartment. When I got there, he said, “Screw them. We’ll start our own fund.” Elevation Partners was born.

In the long term, my departure from Silver Lake worked out for everyone. The second Silver Lake fund got off to a rocky start, as my cofounders struggled with stock picking, but they figured it out and built the firm into an institution that has delivered good investment returns to its investors.

2

Silicon Valley Before Facebook

I think technology really increased human ability. But technology cannot produce compassion. —DALAI LAMA

The technology industry that gave birth to Facebook in 2004 bore little resemblance to the one that had existed only half a dozen years earlier. Before Facebook, startups populated by people just out of college were uncommon, and few succeeded. For the fifty years before 2000, Silicon Valley operated in a world of tight engineering constraints. Engineers never had enough processing power, memory, storage, or bandwidth to do what customers wanted, so they had to make trade-offs. Engineering and software programming in that era rewarded skill and experience. The best engineers and programmers were artists. Just as Facebook came along, however, processing power, memory, storage, and bandwidth went from being engineering limits to turbochargers of growth. The technology industry changed dramatically in less than a decade, but in ways few people recognized. What happened with Facebook and the other internet platforms could not have happened in prior generations of technology. The path the tech industry took from its founding to that change helps to explain both Facebook’s success and how it could do so much damage before the world woke up.

The history of Silicon Valley can be summed in two “laws.” Moore’s Law, coined by a cofounder of Intel, stated that the number of transistors on an integrated circuit doubles every year. It was later revised to a more useful formulation: the performance of an integrated circuit doubles every eighteen to twenty-four months. Metcalfe’s Law, named for a founder of 3Com, said that the value of any network would increase as the square of the number of nodes. Bigger networks are geometrically more valuable than small ones. Moore’s Law and Metcalfe’s Law reinforced each other. As the price of computers fell, the benefits of connecting them rose. It took fifty years, but we eventually connected every computer. The result was the internet we know today, a global network that connects billions of devices and made Facebook and all other internet platforms possible.

Beginning in the fifties, the technology industry went through several eras. During the Cold War, the most important customer was the government. Mainframe computers, giant machines that were housed in special air-conditioned rooms, supervised by a priesthood of technicians in white lab coats, enabled unprecedented automation of computation. The technicians communicated with mainframes via punch cards connected by the most primitive of networks. In comparison to today’s technology, mainframes could not do much, but they automated large-scale data processing, replacing human calculators and bookkeepers with machines. Any customer who wanted to use a computer in that era had to accept a product designed to meet the needs of government, which invested billions to solve complex problems like moon trajectories for NASA and missile targeting for the Department of Defense. IBM was the dominant player in the mainframe era and made all the components for the machines it sold, as well as most of the software. That business model was called vertical integration. The era of government lasted about thirty years. Data networks as we think of them today did not yet exist. Even so, brilliant people imagined a world where small computers optimized for productivity would be connected on powerful networks. In the sixties, J. C. R. Licklider conceived the network that would become the internet, and he persuaded the government to finance its development. At the same time, Douglas Engelbart invented the field of human-computer interaction, which led to him to create the first computer mouse and to conceive the first graphical interface. It would take nearly two decades before Moore’s Law and Metcalfe’s Law could deliver enough performance to enable their vision of personal computing and an additional decade before the internet took off.

Beginning in the seventies, the focus of the tech industry began to shift toward the needs of business. The era began with a concept called time sharing, which enabled many users to share the use of a single computer, reducing the cost to everyone. Time sharing gave rise to minicomputers, which were smaller than mainframes but still staggeringly expensive by today’s standards. Data networking began but was very slow and generally revolved around a single minicomputer. Punch cards gave way to terminals, keyboards attached to the primitive network, eliminating the need for a priesthood of technicians in white lab coats. Digital Equipment, Data General, Prime, and Wang led in minicomputers, which were useful for accounting and business applications but were far too complicated and costly for personal use. Although they were a big step forward relative to mainframes, even minicomputers barely scratched the surface of customer needs. Like IBM, the minicomputer vendors were vertically integrated, making most of the components for their products. Some minicomputers—Wang word processors, for example—addressed productivity applications that would be replaced by PCs. Other applications survived longer, but in the end, the minicomputer business would be subsumed by personal computer technology, if not by PCs themselves. Mainframes have survived to the present day, thanks in large part to giant, custom applications like accounting systems, which were created for the government and corporations and are cheaper to maintain on old systems than to re-create on new ones. (Massive server farms based on PC technology now attract any new application that needs mainframe-class processing; it is a much cheaper solution because you can use commodity hardware instead of proprietary mainframes.)

ARPANET, the predecessor to today’s internet, began as a Department of Defense research project in 1969 under the leadership of Bob Taylor, a computer scientist who continued to influence the design of systems and networks until the late nineties. Douglas Engelbart’s lab was one of the first nodes on ARPANET. The goal was to create a nationwide network to protect the country’s command and control infrastructure in the event of a nuclear attack.

The first application of computer technology to the consumer market came in 1972, when Al Alcorn created the game Pong as a training exercise for his boss at Atari, Nolan Bushnell. Bushnell’s impact on Silicon Valley went far beyond the games produced by Atari. He introduced the hippie culture to tech. White shirts with pocket protectors gave way to jeans and T-shirts. Nine to five went away in favor of the crazy, but flexible hours that prevail even today.

In the late seventies, microprocessors made by Motorola, Intel, and others were relatively cheap and had enough performance to allow Altair, Apple, and others to make the first personal computers. PCs like the Apple II took advantage of the growing supply of inexpensive components, produced by a wide range of independent vendors, to deliver products that captured the imagination first of hobbyists, then of consumers and some businesses. In 1979, Dan Bricklin and Bob Frankston introduced VisiCalc, the first spreadsheet for personal computers. It is hard to overstate the significance of VisiCalc. It was an engineering marvel. A work of art. Spreadsheets on Apple IIs transformed the productivity of bankers, accountants, and financial analysts.

Unlike the vertical integration of mainframes and minicomputers, which limited product improvement to the rate of change of the slowest evolving part in the system, the horizontal integration of PCs allowed innovation at the pace of the most rapidly improving parts in the system. Because there were multiple, competing vendors for each component, systems could evolve far more rapidly than equivalent products subject to vertical integration. The downside was that PCs assembled this way lacked the tight integration of mainframes and minicomputers. This created a downstream cost in terms of training and maintenance, but that was not reflected in the purchase price and did not trouble customers. Even IBM took notice.

When IBM decided to enter the PC market, it abandoned vertical integration and partnered with a range of third-party vendors, including Microsoft for the operating system and Intel for the microprocessor. The first IBM PC shipped in 1981, signaling a fundamental change in the tech industry that only became obvious a couple of years later, when Microsoft’s and Intel’s other customers started to compete with IBM. Eventually, Compaq, Hewlett-Packard, Dell, and others left IBM in the dust. In the long run, though, most of the profits in the PC industry went to Microsoft and Intel, whose control of the brains and heart of the device and willingness to cooperate forced the rest of the industry into a commodity business.

ARPANET had evolved to become a backbone for regional networks of universities and the military. PCs continued the trend of smaller, cheaper computers, but it took nearly a decade after the introduction of the Apple II before technology emerged to leverage the potential of clusters of PCs. Local area networks (LANs) got their start in the late eighties as a way to share expensive laser printers. Once installed, LANs attracted developers, leading to new applications, such as electronic mail. Business productivity and engineering applications created incentives to interconnect LANs within buildings and then tie them all together over proprietary wide area networks (WANs) and then the internet. The benefits of connectivity overwhelmed the frustration of incredibly slow networks, setting the stage for steady improvement. It also created a virtuous cycle, as PC technology could be used to design and build better components, increasing the performance of new PCs that could be used to design and build even better components.

Consumers who wanted a PC in the eighties and early nineties had to buy one created to meet the needs of business. For consumers, PCs were relatively expensive and hard to use, but millions bought and learned to operate them. They put up with character-mode interfaces until Macintosh and then Windows finally delivered graphical interfaces that did not, well, totally suck. In the early nineties, consumer-centric PCs optimized for video games came to market.

The virtuous cycle of Moore’s Law for computers and Metcalfe’s Law for networks reached a new level in the late eighties, but the open internet did not take off right away. It required enhancements. The English researcher Tim Berners-Lee delivered the goods when he invented the World Wide Web in 1989 and the first web browser in 1991, but even those innovations were not enough to push the internet into the mainstream. That happened when a computer science student by the name of Marc Andreessen created the Mosaic browser in 1993. Within a year, startups like Yahoo and Amazon had come along, followed in 1995 by eBay, and the web that we now know had come to life.

By the mid-nineties, the wireless network evolved to a point that enabled widespread adoption of cell phones and alphanumeric pagers. The big applications were phone calls and email, then text messaging. The consumer era had begun. The business era had lasted nearly twenty years—from 1975 to 1995—but no business complained when it ended. Technology aimed at consumers was cheaper and somewhat easier to use, exactly what businesses preferred. It also rewarded a dimension that had not mattered to business: style. It took a few years for any vendor to get the formula right.

The World Wide Web in the mid-nineties was a beautiful thing. Idealism and utopian dreams pervaded the industry. The prevailing view was that the internet and World Wide Web would make the world more democratic, more fair, and more free. One of the web’s best features was an architecture that inherently delivered net neutrality: every site was equal. In that first generation, everything on the web revolved around pages, every one of which had the same privileges and opportunities. Unfortunately, the pioneers of the internet made omissions that would later haunt us all. The one that mattered most was the choice not to require real identity. They never imagined that anonymity would lead to problems as the web grew.

Time would expose the naïveté of the utopian view of the internet, but at the time, most participants bought into that dream. Journalist Jenna Wortham described it this way: “The web’s earliest architects and pioneers fought for their vision of freedom on the Internet at a time when it was still small forums for conversation and text-based gaming. They thought the web could be adequately governed by its users without their need to empower anyone to police it.” They ignored early signs of trouble, such as toxic interchanges on message boards and in comments sections, which they interpreted as growing pains, because the potential for good appeared to be unlimited. No company had to pay the cost of creating the internet, which in theory enabled anyone to have a website. But most people needed tools for building websites, applications servers and the like. Into the breach stepped the “open source” community, a distributed network of programmers who collaborated on projects that created the infrastructure of the internet. Andreessen came out of that community. Open source had great advantages, most notably that its products delivered excellent functionality, evolved rapidly, and were free. Unfortunately, there was one serious problem with the web and open source products: the tools were not convenient or easy to use. The volunteers of the open source community had one motivation: to build the open web. Their focus was on performance and functionality, not convenience or ease of use. That worked well for the infrastructure at the heart of the internet, but not so much for consumer-facing applications.

The World Wide Web took off in 1994, driven by the Mosaic/Netscape browser and sites like Amazon, Yahoo, and eBay. Businesses embraced the web, recognizing its potential as a better way to communicate with other businesses and consumers. This change made the World Wide Web geometrically more valuable, just as Metcalfe’s Law predicted. The web dominated culture in the late nineties, enabling a stock market bubble and ensuring near-universal adoption. The dot-com crash that began in early 2000 left deep scars, but the web continued to grow. In this second phase of the web, Google emerged as the most important player, organizing and displaying what appeared to be all the world’s information. Apple broke the code on tech style—their products were a personal statement—and rode the consumer wave to a second life. Products like the iMac and iPod, and later the iPhone and iPad, restored Apple to its former glory and then some. At this writing, Apple is the most valuable company in the world. (Fortunately, Apple is also the industry leader in protecting user privacy, but I will get to that later.)

In the early years of the new millennium, a game changing model challenged the page-centric architecture of the World Wide Web. Called Web 2.0, the new architecture revolved around people. The pioneers of Web 2.0 included people like Mark Pincus, who later founded Zynga; Reid Hoffman, the founder of LinkedIn; and Sean Parker, who had co-founded the music file sharing company Napster. After Napster, Parker launched a startup called Plaxo, which put address books in the cloud. It grew by spamming every name in every address book to generate new users, an idea that would be copied widely by social media platforms that launched thereafter. In the same period, Google had a brilliant insight: it saw a way to take control of a huge slice of the open internet. No one owned open source tools, so there was no financial incentive to make them attractive for consumers. They were designed by engineers, for engineers, which could be frustrating to non-engineers.

Google saw an opportunity to exploit the frustration of consumers and some business users. Google made a list of the most important things people did on the web, including searches, browsing, and email. In those days, most users were forced to employ a mix of open source and proprietary tools from a range of vendors. Most of the products did not work together particularly well, creating a friction Google could exploit. Beginning with Gmail in 2004, Google created or acquired compelling products in maps, photos, videos, and productivity applications. Everything was free, so there were no barriers to customer adoption. Everything worked together. Every app gathered data that Google could exploit. Customers loved the Google apps. Collectively, the Google family of apps replaced a huge portion of the open World Wide Web. It was as though Google had unilaterally put a fence around half of a public park and then started commercializing it.

The steady march of technology in the half century prior to 2000 produced so much value—and so many delightful surprises—that the industry and customers began to take positive outcomes for granted. Technology optimism was not equivalent to the law of gravity, but engineers, entrepreneurs, and investors believed that everything they did made the world a better place. Most participants bought into some form of the internet utopia. What we did not realize at the time was that the limits imposed by not having enough processing power, memory, storage, and network bandwidth had acted as a governor, limiting the damage from mistakes to a relatively small number of customers. Because the industry had done so much good in the past, we all believed that everything it would create in the future would also be good. It was not a crazy assumption, but it was a lazy one that would breed hubris.

When Zuck launched Facebook in early 2004, the tech industry had begun to emerge from the downturn caused by the dot-com meltdown. Web 2.0 was in its early stages, with no clear winners. For Silicon Valley, it was a time of transformation, with major change taking place in four arenas: startups, philosophy, economics, and culture. Collectively, these changes triggered unprecedented growth and wealth creation. Once the gravy train started, no one wanted to get off. When fortunes can be made overnight, few people pause to ask questions or consider side effects.

The first big Silicon Valley change related to the economics of startups. Hurdles that had long plagued new companies evaporated. Engineers could build world-class products quickly, thanks to the trove of complementary software components, like the Apache server and the Mozilla browser, from the open source community. With open source stacks as a foundation, engineers could focus all their effort on the valuable functionality of their app, rather than building infrastructure from the ground up. This saved time and money. In parallel, a new concept emerged—the cloud—and the industry embraced the notion of centralization of shared resources. The cloud is like Uber for data—customers don’t need to own their own data center or storage if a service provides it seamlessly from the cloud. Today’s leader in cloud services, Amazon Web Services (AWS), leveraged Amazon.com’s retail business to create a massive cloud infrastructure that it offered on a turnkey basis to startups and corporate customers. By enabling companies to outsource their hardware and network infrastructure, paying a monthly fee instead of the purchase price of an entire system, services like AWS lowered the cost of creating new businesses and shortened the time to market. Startups could mix and match free open source applications to create their software infrastructure. Updates were made once, in the cloud, and then downloaded by users, eliminating what had previously been a very costly and time-consuming process of upgrading individual PCs and servers. This freed startups to focus on their real value added, the application that sat on top of the stack. Netflix, Box, Dropbox, Slack, and many other businesses were built on this model.

Thus began the “lean startup” model. Without the huge expense and operational burden of creating a full tech infrastructure, new companies did not have to aim for perfection when they launched a new product, which had been Silicon Valley’s primary model to that point. For a fraction of the cost, they could create a minimum viable product (MVP), launch it, and see what happened. The lean startup model could work anywhere, but it worked best with cloud software, which could be updated as often as necessary. The first major industry created with the new model was social media, the Web 2.0 startups that were building networks of people rather than pages. Every day after launch, founders would study the data and tweak the product in response to customer feedback. In the lean startup philosophy, the product is never finished. It can always be improved. No matter how rapidly a startup grew, AWS could handle the load, as it demonstrated in supporting the phenomenal growth of Netflix. What in earlier generations would have required an army of experienced engineers could now be accomplished by relatively inexperienced engineers with an email to AWS. Infrastructure that used to require a huge capital investment could now be leased on a monthly basis. If the product did not take off, the cost of failure was negligible, particularly in comparison to the years before 2000. If the product found a market, the founders had alternatives. They could raise venture capital on favorable terms, hire a bigger team, improve the product, and spend to acquire more users. Or they could do what the founders of Instagram and WhatsApp would eventually do: sell out for billions with only a handful of employees.

Facebook’s motto—“Move fast and break things”—embodies the lean startup philosophy. Forget strategy. Pull together a few friends, make a product you like, and try it in the market. Make mistakes, fix them, repeat. For venture investors, the lean startup model was a godsend. It allowed venture capitalists to identify losers and kill them before they burned through much cash. Winners were so valuable that a fund needed only one to provide a great return.

When hardware and networks act as limiters, software must be elegant. Engineers sacrifice frills to maximize performance. The no-frills design of Google’s search bar made a huge difference in the early days, providing a competitive advantage relative to Excite, Altavista, and Yahoo. A decade earlier, Microsoft’s early versions of Windows failed in part because hardware in that era could not handle the processing demands imposed by the design. By 2004, every PC had processing power to spare. Wired networks could handle video. Facebook’s design outperformed MySpace in almost every dimension, providing a relative advantage, but the company did not face the fundamental challenges that had prevailed even a decade earlier. Engineers had enough processing power, storage, and network bandwidth to change the world, at least on PCs. Programming still rewarded genius and creativity, but an entrepreneur like Zuck did not need a team of experienced engineers with systems expertise to execute a business plan. For a founder in his early twenties, this was a lucky break. Zuck could build a team of people his own age and mold them. Unlike Google, Facebook was reluctant to hire people with experience. Inexperience went from being a barrier to being an advantage, as it kept labor costs low and made it possible for a young man in his twenties to be an effective CEO. The people in Zuck’s inner circle bought into his vision without reservation, and they conveyed that vision to the rank-and-file engineers. On its own terms, Facebook’s human resources strategy worked exceptionally well. The company exceeded its goals year after year, creating massive wealth for its shareholders, but especially for Zuck. The success of Facebook’s strategy had a profound impact on the human resources culture of Silicon Valley startups.

In the early days of Silicon Valley, software engineers generally came from the computer science and electrical engineering programs at MIT, Caltech, and Carnegie Mellon. By the late seventies, Berkeley and Stanford had joined the top tier. They were followed in the mid-nineties by the University of Illinois at Urbana-Champaign, the alma mater of Marc Andreessen, and other universities with strong computer science programs. After 2000, programmers were coming from just about every university in America, including Harvard.

When faced with a surplus for the first time, engineers had new and exciting options. The wave of startups launched after 2003 could have applied surplus processing, memory, storage, and bandwidth to improve users’ well-being and happiness, for example. A few people tried, which is what led to the creation of the Siri personal assistant, among other things. The most successful entrepreneurs took a different path. They recognized that the penetration of broadband might enable them to build global consumer technology brands very quickly, so they opted for maximum scale. To grow as fast as possible, they did everything they could to eliminate friction like purchase prices, criticism, and regulation. Products were free, criticism and privacy norms ignored. Faced with the choice between asking permission or begging forgiveness, entrepreneurs embraced the latter. For some startups, challenging authority was central to their culture. To maximize both engagement and revenues, Web 2.0 startups focused their technology on the weakest elements of human psychology. They set out to create habits, evolved habits into addictions, and laid the groundwork for giant fortunes.

The second important change was philosophical. American business philosophy was becoming more and more proudly libertarian, nowhere more so than in Silicon Valley. The United States had beaten the Depression and won World War II through collective action. As a country, we subordinated the individual to the collective good, and it worked really well. When the Second World War ended, the US economy prospered by rebuilding the rest of the world. Among the many peacetime benefits was the emergence of a prosperous middle class. Tax rates were high, but few people complained. Collective action enabled the country to build the best public education system in the world, as well as the interstate highway system, and to send men to the moon. The average American enjoyed an exceptionally high standard of living.

Then came the 1973 oil crisis, when the Organization of Petroleum Exporting Countries initiated a boycott of countries that supported Israel in the Yom Kippur War. The oil embargo exposed a flaw in the US economy: it was built on cheap oil. The country had lived beyond its means for most of the sixties, borrowing aggressively to pay for the war in Vietnam and the Great Society social programs, which made it vulnerable. When rising oil prices triggered inflation and economic stagnation, the country transitioned into a new philosophical regime.

The winner was libertarianism, which prioritized the individual over the collective good. It might be framed as “you are responsible only for yourself.” As the opposite of collectivism, libertarianism is a philosophy that can trace its roots to the frontier years of the American West. In the modern context, it is closely tied to the belief that markets are always the best way to allocate resources. Under libertarianism, no one needs to feel guilty about ambition or greed. Disruption can be a strategy, not just a consequence. You can imagine how attractive a philosophy that absolves practitioners of responsibility for the impact of their actions on others would be to entrepreneurs and investors in Silicon Valley. They embraced it. You could be a hacker, a rebel against authority, and people would reward you for it. Unstated was the leverage the philosophy conferred on those who started with advantages. The well-born and lucky could attribute their success to hard work and talent, while blaming the less advantaged for not working hard enough or being untalented. Many libertarian entrepreneurs brag about the “meritocracy” inside their companies. Meritocracy sounds like a great thing, but in practice there are serious issues with Silicon Valley’s version of it. If contributions to corporate success define merit when a company is small and has a homogeneous employee base, then meritocracy will encourage the hiring of people with similar backgrounds and experience. If the company is not careful, this will lead to a homogeneous workforce as the company grows. For internet platforms, this means an employee base consisting overwhelmingly of white and Asian males in their twenties and thirties. This can have an impact on product design. For example, Google’s facial-recognition software had problems recognizing people of color, possibly reflecting a lack of diversity in the development team. Homogeneity narrows the range of acceptable ideas and, in the case of Facebook, may have contributed to a work environment that emphasizes conformity. The extraordinary lack of diversity in Silicon Valley may reflect the pervasive embrace of libertarian philosophy. Zuck’s early investor and mentor Peter Thiel is an outspoken advocate for libertarian values.

The third big change was economic, and it was a natural extension of libertarian philosophy. Neoliberalism stipulated that markets should replace government as the rule setter for economic activity. President Ronald Reagan framed neoliberalism with his assertion that “government is not the solution to our problem; it is the problem.” Beginning in 1981, the Reagan administration began removing regulations on business. He restored confidence, which unleashed a big increase in investment and economic activity. By 1982, Wall Street bought into the idea, and stocks began to rise. Reagan called it Morning in America. The problems—stagnant wages, income inequality, and a decline in startup activity outside of tech—did not emerge until the late nineties.

Deregulation generally favored incumbents at the expense of startups. New company formation, which had peaked in 1977, has been in decline ever since. The exception was Silicon Valley, where large companies struggled to keep up with rapidly evolving technologies, creating opportunities for startups. The startup economy in the early eighties was tiny but vibrant. It grew with the PC industry, exploded in the nineties, and peaked in 2000 at $120 billion, before declining by 87 percent over two years. The lean startup model collapsed the cost of startups, such that the number of new companies rebounded very quickly. According to the National Venture Capital Association, venture funding recovered to seventy-nine billion dollars in 2015 on 10,463 deals, more than twice the number funded in 2008. The market power of Facebook, Google, Amazon, and Apple has altered the behavior of investors and entrepreneurs, forcing startups to sell out early to one of the giants or crowd into smaller and less attractive opportunities.

Under Reagan, the country also revised its view of corporate power. The Founding Fathers associated monopoly with monarchy and took steps to ensure that economic power would be widely distributed. There were ebbs and flows as the country adjusted to the industrial revolution, mechanization, technology, world wars, and globalization, but until 1981, the prevailing view was that there should be limits to the concentration of economic power and wealth. The Reagan Revolution embraced the notion that the concentration of economic power was not a problem so long as it did not lead to higher prices for consumers. Again, Silicon Valley profited from laissez-faire economics.

Technology markets are not monopolies by nature. That said, every generation has had dominant players: IBM in mainframes, Digital Equipment in minicomputers, Microsoft and Intel in PCs, Cisco in data networking, Oracle in enterprise software, and Google on the internet. The argument against monopolies in technology is that major innovations almost always come from new players. If you stifle the rise of new companies, innovation may suffer.

Before the internet, the dominant tech companies sold foundational technologies for the architecture of their period. With the exception of Digital Equipment, all of the tech market leaders of the past still exist today, though none could prevent their markets from maturing, peaking, and losing ground to subsequent generations. In two cases, IBM and Microsoft, the business practices that led to success eventually caught the eye of antitrust regulators, resulting in regulatory actions that restored competitive balance. Without the IBM antitrust case, there likely would have been no Microsoft. Without the Microsoft case, it is hard to imagine Google succeeding as it did. Beginning with Google, the most successful technology companies sat on top of stacks created by others, which allowed them to move faster than any market leaders before them. Google, Facebook, and others also broke the mold by adopting advertising business models, which meant their products were free to use, eliminating another form of friction and protecting them from antitrust regulation. They rode the wave of wired broadband adoption and then 4G mobile to achieve global scale in what seemed like the blink of an eye. Their products enjoyed network effects, which occur when the value of a product increases as you add users to the network. Network effects were supposed to benefit users. In the cases of Facebook and Google, that was true for a time, but eventually the value increase shifted decisively to the benefit of owners of the network, creating insurmountable barriers to entry. Facebook and Google, as well as Amazon, quickly amassed economic power on a scale not seen since the days of Standard Oil one hundred years earlier. In an essay on Medium, the venture capitalist James Currier pointed out that the key to success in the internet platform business is network effects and Facebook enjoyed more of them than any other company in history. He said, “To date, we’ve actually identified that Facebook has built no less than six of the thirteen known network effects to create defensibility and value, like a castle with six concentric layers of walls. Facebook’s walls grow higher all the time, and on top of them Facebook has fortified itself with all three of the other known defensibilities in the internet age: brand, scale, and embedding.”

By 2004, the United States was more than a generation into an era dominated by a hands-off, laissez-faire approach to regulation, a time period long enough that hardly anyone in Silicon Valley knew there had once been a different way of doing things. This is one reason why few people in tech today are calling for regulation of Facebook, Google, and Amazon, antitrust or otherwise.

One other factor made the environment of 2004 different from earlier times in Silicon Valley: angel investors. Venture capitalists had served as the primary gatekeepers of the startup economy since the late seventies, but they spent a few years retrenching after the dot-com bubble burst. Into the void stepped angel investors—individuals, mostly former entrepreneurs and executives—who guided startups during their earliest stages. Angel investors were perfectly matched to the lean startup model, gaining leverage from relatively small investments. One angel, Ron Conway, built a huge brand, but the team that had started PayPal proved to have much greater impact. Peter Thiel, Elon Musk, Reid Hoffman, Max Levchin, Jeremy Stoppleman, and their colleagues were collectively known as the PayPal Mafia, and their impact transformed Silicon Valley. Not only did they launch Tesla, Space-X, LinkedIn, and Yelp, they provided early funding to Facebook and many other successful players. More important than the money, though, were the vision, value system, and connections of the PayPal Mafia, which came to dominate the social media generation. Validation by the PayPal Mafia was decisive for many startups during the early days of social media. Their management techniques enabled startups to grow at rates never before experienced in Silicon Valley. The value system of the PayPal Mafia helped their investments create massive wealth, but may have contributed to the blindness of internet platforms to harms that resulted from their success. In short, we can trace both the good and the bad of social media to the influence of the PayPal Mafia.

—

THANKS TO LUCKY TIMING, Facebook benefitted not only from lower barriers for startups and changes in philosophy and economics but also from a new social environment. Silicon Valley had prospered in the suburbs south of San Francisco, mostly between Palo Alto and San Jose. Engineering nerds did not have a problem with life in the sleepy suburbs because many had families with children, and the ones who did not have kids did not expect to have the option of living in the city. Beginning with the dot-com bubble of the late nineties, however, the startup culture began to attract kids fresh out of school, who were not so happy with suburban life as their predecessors. In a world where experience had declining economic value, the new generation favored San Francisco as a place to live. The transition was bumpy, as most of the San Francisco–based dot-coms went up in flames in 2000, but after the start of the new millennium, the tech population in San Francisco grew steadily. While Facebook originally based itself in Palo Alto—the heart of Silicon Valley, not far from Google, Hewlett-Packard, and Apple—a meaningful percentage of its employees chose to live in the big city. Had Facebook come along during the era of scarcity, when experienced engineers ruled the Valley, it would have had a profoundly different culture. Faced with the engineering constraints of earlier eras, however, the Facebook platform would not have worked well enough to succeed. Facebook came along at the perfect time.

San Francisco is hip, with diverse neighborhoods, decent public transportation, access to recreation, and lots of nightlife. It attracted a different kind of person than Sunnyvale or Mountain View, including two related types previously unseen in Silicon Valley: hipsters and bros. Hipsters had burst onto the public consciousness as if from a base in Brooklyn, New York, heavy on guys with beards, plaid shirts, and earrings. They seemed to be descendants of San Francisco’s bohemian past, a modern take on the Beats. The bros were different, though perhaps more in terms of style than substance. Ambitious, aggressive, and exceptionally self-confident, they embodied libertarian values. Symptoms included a lack of empathy or concern for consequences to others. The hipster and bro cultures were decidedly male. There were women in tech, too, more than in past generations of Silicon Valley, but the culture continued to be dominated by men who failed to appreciate the obvious benefits of treating women as peers. Too many in Silicon Valley missed the lesson that treating others as equals is what good people do. For them, I make a simple economic case: women are 51 percent of the US population; they account for 85 percent of consumer purchases; they control 60 percent of all personal wealth. They know what they want better than men do, yet in Silicon Valley, which invests billions in consumer-facing startups, men hold most of the leadership positions. Women who succeed often do so by beating the boys at their own game, something that Silicon Valley women do with ever greater frequency. Bloomberg journalist Emily Chang described this culture brilliantly in her book, Brotopia.

With the biggest influx of young people since the Summer of Love, the tech migration after 2000 had a visible impact on the city, precipitating a backlash that began quietly but grew steadily. The new kids boosted the economy with tea shops and co-working spaces that sprung up like mushrooms after a summer rain in the forest. But they seemed not to appreciate that their lifestyle might disturb the quiet equilibrium that had preceded their arrival. With a range of new services catering to their needs, delivered by startups of their peers, the hipsters and bros eventually provoked a reaction. Tangible manifestations of their presence, like the luxury buses that took them to jobs at Google, Facebook, Apple, and other companies down in Silicon Valley, drew protests from peeved locals. An explosion of Uber and Lyft vehicles jammed the city’s streets, dramatically increasing commute times. Insensitive blog posts, inappropriate business behavior, and higher housing costs ensured that locals would neither forgive nor forget.

—

ZUCK ENJOYED THE KIND OF privileged childhood one would expect for a white male whose parents were medical professionals living in a beautiful suburb. As a student at Harvard, he had the idea for Facebook. Thanks to great focus and enthusiasm, Zuck would almost certainly have found success in Silicon Valley in any era, but he was particularly suited to his times. Plus, as previously noted, he had an advantage not available to earlier generations of entrepreneurs: he could build a team of people his age—many of whom had never before had a full-time job—and mold them. This allowed Facebook to accomplish things that had never been done before.

For Zuck and the senior management of Facebook, the goal of connecting the world was self-evidently admirable. The philosophy of “move fast and break things” allowed for lots of mistakes, and Facebook embraced the process, made adjustments, and continued forward. The company maintained a laser focus on Zuck’s priorities, never considering the possibility that there might be flaws in this approach, even when the evidence of such flaws became overwhelming. From all appearances, Zuck and his executive team did not anticipate that people would use Facebook differently than Zuck had envisioned, that putting more than two billion people on the same network would lead to tribalism, that Facebook Groups would amplify that tribalism, that bad actors would take advantage to harm innocent people. They failed to imagine unintended consequences from an advertising business based on behavior modification. They ignored critics. They missed the opportunity to take responsibility when the reputational cost would have been low. When called to task, they protected their business model and prerogatives, making only small changes to their business practices. This trajectory is worth understanding in greater depth.

3

Move Fast and Break Things

Try not to become a man of success, but rather try to become a man of value. —ALBERT EINSTEIN

During Mark Zuckerberg’s sophomore year at Harvard, he created a program called Facemash that allowed users to compare photos of two students and choose which was “hotter.” The photos were taken from the online directories of nine Harvard dormitories. According to an article in Fast Company magazine, the application had twenty-two thousand photo views in the first four hours and spread rapidly on campus before being shut down within a week by the authorities. Harvard threatened to expel Zuckerberg for security, copyright, and privacy violations. The charges were later dropped. The incident caught the attention of three Harvard seniors, Cameron Winklevoss, Tyler Winklevoss, and Divya Narendra, who invited Zuck to consult on their social network project, HarvardConnection.com.

In an interview with the campus newspaper, Zuck complained that the university would be slow to implement a universal student directory and that he could do it much faster. He started in January 2004 and launched TheFacebook.com on February 4. Six days later, the trio of seniors accused Zuck of pretending to help on their project and then stealing their ideas for TheFacebook. (The Winklevoss twins and Narendra ultimately filed suit and settled in 2008 for 1.2 million shares of Facebook stock.) Within a month, more than half of the Harvard student body had registered on Zuck’s site. Three of Zuck’s friends joined the team, and a month later they launched TheFacebook at Columbia, Stanford, and Yale. It spread rapidly to other college campuses. By June, the company relocated from Cambridge, Massachusetts, to Palo Alto, California, brought in Napster cofounder Sean Parker as president, and took its first venture capital from Peter Thiel.

TheFacebook delivered exactly what its name described: each page provided a photo with personal details and contact information. There was no News Feed and no frills, but the color scheme and fonts would be recognizable to any present-day user. While many features were missing, the thing that stands out is the effectiveness of the first user interface. There were no mistakes that would have to be undone.

The following year, Zuck and team paid two hundred thousand dollars to buy the “facebook.com” domain and changed the company’s name. Accel Partners, one of the leading Silicon Valley venture funds, invested $12.7 million, and the company expanded access to high school students and employees of some technology firms. The functionality of the original Facebook was the same as TheFacebook, but the user interface evolved. Some of the changes were subtle, such as the multitone blue color scheme, but others, such as the display of thumbnail photos of friends, remain central to the current look. Again, Facebook made improvements that would endure. Sometimes users complained about new features and products—this generally occurred when Zuck and his team pushed users too hard to disclose and share more information—but Facebook recovered quickly each time. The company never looked back.

Facebook was not the first social network. SixDegrees.com started in 1997 and Makeoutclub in 1999, but neither really got off the ground. Friendster, which started in 2002, was the first to reach one million users. Friendster was the model for Facebook. It got off to a fantastic start, attracted investors and users, but then fell victim to performance problems that crippled the business. Friendster got slower and slower, until users gave up and left the platform. Started in 2003, MySpace figured out how to scale better than Friendster, but it, too, eventually had issues. Allowing users to customize pages made the system slow, but in the end, it was the ability of users to remain anonymous that probably did the most damage to MySpace. Anonymity encouraged the posting of pornography, the elimination of which drained MySpace’s resources, and enabled adults to pose as children, which led to massive problems.

The genius of Zuck and his original team was in reconceptualizing the problem. They recognized that success depended on building a network that could scale without friction. Sean Parker described the solution this way in Adam Fisher’s Valley of Genius: “The ‘social graph’ is a math concept from graph theory, but it was a way of trying to explain to people who were kind of academic and mathematically inclined that what we were building was not a product so much as it was a network composed of nodes with a lot of information flowing between those nodes. That’s graph theory. Therefore we’re building a social graph. It was never meant to be talked about publicly.” Perhaps not, but it was brilliant. The notion that a small team in their early twenties with little or no work experience figured it out on the first try is remarkable. The founders also had the great insight that real identity would simplify the social graph, reducing each user to a single address. These two ideas would not only help Facebook overcome the performance problems that sank Friendster and MySpace, they would remain core to the company’s success as it grew past two billion users.

When I first met Zuck in 2006, I was very familiar with Friendster and MySpace and had a clear sense that Facebook’s design, its insistence on real identity, and user control of privacy would enable the company to succeed where others had failed. Later on, Facebook would relax its policies on identity and privacy to enable faster growth. Facebook’s terms of service still require real identity, but enforcement is lax, consistent with the company’s commitment to minimize friction, and happens only when other users complain. By the end of the decade, user privacy would become a pawn to be traded to accelerate growth.

In 2006, it was not obvious how big the social networking market would be, but I was already convinced that Facebook had an approach that might both define the category and make it economically successful. Facebook was a hit with college students, but I thought the bigger opportunity would be with adults, whose busy schedules were tailor-made for the platform. To me, that suggested a market opportunity of at least one hundred million users or more in English-speaking countries. In those days, one hundred million users would have justified a valuation of at least ten billion dollars, or ten times the number Yahoo had offered. It never occurred to me then that Facebook would fly past two billion monthly users, though I do remember the first time Zuck told me his target was a billion users. It happened some time in 2009, when Facebook was racing from two hundred to three hundred million users. I thought it was a mistake to maximize user count. The top 20 percent of users would deliver most of the value. I worried that the pursuit of one billion users would force Zuck to do business in places or on terms that should make him uncomfortable. As it turned out, there were no visible compromises when Facebook passed a billion monthly users in September 2012. The compromises were very well hidden.

The company had plenty of capital when I first met Zuck, so there was no immediate opportunity for me to invest, but as I’ve said, the notion of helping the twenty-two-year-old founder of a game-changing startup deal with an existential crisis really appealed to me. As a longtime technology investor, I received many requests for free help, and I loved doing it. Good advice can be the first step in a lasting relationship and had ultimately led to many of my best investments. The strategy required patience—and a willingness to help lots of companies that might not work out—but it made my work life fresh and fun.

My first impression of Zuck was that he was a classic Silicon Valley nerd. In my book, being a nerd is a good thing, especially for a technology entrepreneur. Nerds are my people. I didn’t know much about Zuck as a person and knew nothing about the episode that nearly led to his expulsion from Harvard until much later. What I saw before me was a particularly intense twenty-two-year-old who took all the time he needed to think before he acted. As painful as that five minutes of silence was for me, it signaled caution, which I took as a positive. The long silence also signaled weak social skills, but that would not have been unusual in a technology founder. But in that first meeting, I was able to help Zuck resolve a serious problem. Not only did he leave my office with the answer he needed, he had a framework for justifying it to the people in his life who wanted their share of one billion dollars. At the time, Zuck was very appreciative. A few days later, he invited me to his office, which was in the heart of Palo Alto, just down the street from the Stanford University campus. The interior walls were covered with graffiti. Professional graffiti. In Zuck’s conference room, we talked about the importance of having a cohesive management team where everyone shared the same goals. Those conversations continued several times a month for three years. Thanks to the Yahoo offer, Zuck understood that he could no longer count on everyone on his team. Some executives had pushed hard to sell the company. Zuck asked for my perspective on team building, which I was able to provide in the course of our conversations. A year later, he upgraded several positions, most notably his chief operating officer and his chief financial officer.

Toward the end of 2006, Zuck learned that a magazine for Harvard alumni was planning a story about the Winklevoss brothers and again turned to me for help. I introduced him to a crisis-management public relations firm and helped him minimize the fallout from the story.

I trust my instincts about people. My instincts are far from perfect, but they have been good enough to enable a long career. Intensity of the kind I saw in Zuck is a huge positive in an entrepreneur. Another critical issue for me is a person’s value system. In my interactions with him, Zuck was consistently mature and responsible. He seemed remarkably grown-up for his age. He was idealistic, convinced that Facebook could bring people together. He was comfortable working with women, which is not common among Silicon Valley entrepreneurs. My meetings with Zuck almost always occurred in his office, generally just the two of us, so I had an incomplete picture of the man, but he was always straight with me. I liked Zuck. I liked his team. I was a fan of Facebook.

This is a roundabout way of saying that my relationship with Zuck was all business. I was one of the people he would call on when confronted with new or challenging issues. Mentoring is fun for me, and Zuck could not have been a better mentee. We talked about stuff that was important to Zuck, where I had useful experience. More often than not, he acted on my counsel.

Zuck had other mentors, several of whom played a much larger role than I did. He spoke to me about Peter Thiel, who was an early investor and board member. I don’t know how often Zuck spoke with Thiel, but I know he took Peter’s advice very seriously. Philosophically, Thiel and I are polar opposites, and I respected Zuck for being able to work with both of us. Washington Post CEO Don Graham had started advising Zuck at least a year before me. As one of the best-connected people in our nation’s capital, Don would have been a tremendous asset to Zuck as Facebook grew to global scale. Marc Andreessen, the Netscape founder turned venture capitalist, played a very important role in Zuck’s orbit, as he was a hard-core technologist who had once been a very young entrepreneur. Presumably, Zuck also leaned on Jim Breyer, the partner from Accel who made the first institutional investment in Facebook, but Zuck did not talk about Breyer the way he did about Thiel.

In researching this book for key moments in the history of Facebook, one that stands out occurred months before I got involved. In the fall of 2005, Facebook gave users the ability to upload photographs. They did it with a new wrinkle—tagging the people in the photo—that helped to define Facebook’s approach to engagement. Tagging proved to be a technology with persuasive power, as users felt obligated to react or reciprocate when informed they had been tagged. A few months after my first meeting with Zuck, Facebook made two huge changes: it launched News Feed, and it opened itself up to anyone over the age of thirteen with a valid email address. News Feed is the heart of the Facebook user experience, and it is hard today to imagine that the site did well for a couple of years without it. Then, in January 2007, Facebook introduced a mobile web product to leverage the widespread adoption of smartphones. The desktop interface also made a big leap.

In the summer of 2007, Zuck called to offer me an opportunity to invest. He actually offered me a choice: invest or join the board. Given my profession and our relationship, the choice was easy. I did not need to be on the board to advise Zuck. The investment itself was complicated. One of Facebook’s early employees needed to sell a piece of his stake, but under the company’s equity-incentive plan there was no easy way to do this. We worked with Facebook to create a structure that balanced both our needs and those of the seller. When the deal was done, there was no way to sell our shares until after an initial public offering. Bono, Marc, and I were committed for the long haul.

Later that year, Microsoft bought 1.6 percent of Facebook for $240 million, a transaction that valued the company at $15 billion. The transaction was tied to a deal where Microsoft would sell advertising for Facebook. Microsoft paid a huge premium to the price we paid, reflecting its status as a software giant with no ability to compete in social. Facebook understood that it had leverage over Microsoft and priced the shares accordingly. As investors, we knew the Microsoft valuation did not reflect the actual worth of Facebook. It was a “strategic investment” designed to give Microsoft a leg up over Google and other giants.

Soon thereafter, Facebook launched Beacon, a system that gathered data about user activity on external websites to improve Facebook ad targeting and to enable users to share news about their purchases. When a Facebook user interacted with a Beacon partner website, the data would be sent to Facebook and reflected in the user’s News Feed. Beacon was designed to make Facebook advertising much more valuable, and Facebook hoped that users would be happy to share their interests and purchase activities with friends. Unfortunately, Facebook did not give users any warning and did not give them any ability to control Beacon. Their activities on the web would appear in their Facebook feed even when the user was not on Facebook. Imagine having “Just looked at sex toys on Amazon.com” show up in your feed. Users thought Beacon was creepy. Most users did not know what Facebook was doing with Beacon. When they found out, they were not happy. Zuck’s cavalier attitude toward user privacy, evident from the first day of Facemash back at Harvard, had blown up in his face. MoveOn organized a protest campaign, arguing that Facebook should not publish user activity off the site without explicit permission. Users filed class action lawsuits. Beacon was withdrawn less than a year after launch.

In the fall of 2007, Zuck told me he wanted to hire someone to build Facebook’s monetization. I asked if he was willing to bring in a strong number two, someone who could be a chief operating officer or president. He said yes. I did not say anything, but a name sprang to mind immediately: Sheryl Sandberg. Sheryl had been chief of staff to Secretary of the Treasury Larry Summers during Bill Clinton’s second term. In that job, she had partnered with Bono on the singer’s successful campaign to spur the world’s leading economies to forgive billions in debt owed by countries in the developing world. Together, Bono and Sheryl helped many emerging countries to reenergize their economies, which turned out to be a good deal for everyone involved. Sheryl introduced Bono to me, which eventually led the two of us to collaborate on Elevation Partners. Sheryl came to Silicon Valley in early 2001 and hung out in my office for a few weeks. We talked to Sheryl about joining Integral, but my partner John Powell had a better idea. John and I were both convinced that Sheryl would be hugely successful in Silicon Valley, but John pointed out that there were much bigger opportunities than Integral. He thought the right place for Sheryl was Google and shared that view with John Doerr, who was a member of Google’s board of directors. Sheryl took a job at Google to help build AdWords, the product that links ads to search results.

AdWords is arguably the most successful advertising product in history, and Sheryl was one of the people who made that happen. Based on what I knew about Sheryl, her success came as no surprise. One day in 2007, Sheryl came by to tell me she had been offered a leadership position at The Washington Post. She asked me what I thought. I suggested that she consider Facebook instead. Thanks to Watergate and the Pentagon Papers, the Post was iconic, but being a newspaper, it did not have a workable plan to avoid business model damage from the internet. Facebook seemed like a much better match for Sheryl than the Post, and she seemed like the best possible partner for Zuck and Facebook. Sheryl told me she had once met Zuck at a party, but did not know him and worried that they might not be a good fit. I encouraged Sheryl to get to know Zuck and see where things went. After my first conversation with Sheryl, I called Zuck and told him I thought Sheryl would be the best person to build Facebook’s advertising business. Zuck worried that advertising on Facebook would not look like Google’s AdWords—which was true—but I countered that building AdWords might be the best preparation for creating a scalable advertising model on Facebook. It took several separate conversations with Zuck and Sheryl to get them to meet, but once they got together, they immediately found common ground. Sheryl joined the company in March 2008. Looking at a March 2008 Wall Street Journal article on Sheryl’s hire and Zuck’s other efforts to stabilize the company by accepting help from more experienced peers, I’m reminded that Facebook’s current status as a multibillion-dollar company seemed far from inevitable in those days. The article highlighted the company’s image problems and mentioned Zuck complaining to me about the difficulties of being a CEO. Still, growth accelerated.

The underlying technology of the disastrous Beacon project resurfaced in late 2008 as Facebook Connect, a product that allowed users to sign into third-party sites with their Facebook credentials. News of hacks and identity theft had created pressure for stronger passwords, which users struggled to manage. The value of Connect was that it enabled people to memorize a single, strong Facebook password for access to thousands of sites. Users loved Connect for its convenience, but it is not obvious that they understood that it enabled Facebook to track them in many places around the web. With the benefit of hindsight, we can see the costs that accompanied the convenience of Connect. I tried Connect on a few news sites, but soon abandoned it when I realized what it meant for privacy.

The data that Facebook collected through Connect led to huge improvements in targeting and would ultimately magnify catastrophes like the Russian interference in the 2016 election. Other users must have noticed that Facebook knew surprising things about them, but may have told themselves the convenience of Connect justified the loss of privacy. With Connect, Facebook addressed a real need. Maintaining secure credentials is inconvenient, but the world would have been better off had users adopted a solution that did not exploit their private data. Convenience, it turns out, was the sweetener that led users to swallow a lot of poison.

Facebook’s user count reached one hundred million in the third quarter of 2008. This was astonishing for a company that was only four and half years old, but Facebook was just getting started. Only seven months later, the user count hit two hundred million, aided by the launch of the Like button. The Like button soon defined the Facebook experience. “Getting Likes” became a social phenomenon. It gave users an incentive to spend more time on the site and joined photo tagging as a trigger for addiction to Facebook. To make its advertising valuable, Facebook needs to gain and hold user attention, which it does with behavior modification techniques that promote addiction, according to a growing body of evidence. Behavior modification and addiction would play a giant role in the Facebook story, but were not visible during my time as a mentor to Zuck and would remain unknown to me until 2017.

It turns out everyone wants to be liked, and the Like button provided a yardstick of social validation and social reciprocity—packaged as a variable reward—that transformed social networking. It seemed that every Facebook user wanted to know how many Likes they received for each post, and that tempted many users to return to the platform several times a day. Facebook amplified the signal with notifications, teasing users constantly. The Like button helped boost the user count to 305 million by the end of September 2009. Like buttons spread like wildfire to sites across the web, and along with Connect enabled Facebook to track its users wherever they browsed.

The acquisition of FriendFeed in August 2009 gave Facebook an application for aggregating feeds from a wide range of apps and blogs. It also provided technology and a team that would protect Facebook’s flank from the new kid on the block, Twitter. Over the following year, Facebook acquisitions would enable photo sharing and the importing of contacts. Such acquisitions made Facebook more valuable to users, but that was nothing compared to the value they created for Facebook’s advertising. On every metric, Facebook prospered. Revenue grew rapidly. Facebook’s secret sauce was its ability to imitate and improve upon the ideas of others, and then scale them. The company demonstrated an exceptional aptitude for managing hypergrowth, a skill that is as rare as it is valuable. In September 2009, the company announced that it had turned cash flow positive. This is not the same as turning profitable, but it was actually a more important milestone. It meant that Facebook generated enough revenue to cover all its cash expenses. It would not need more venture capital to survive. The company was only five and a half years old.

With Sheryl on board as chief operating officer in charge of delivering revenues, Facebook quickly developed its infrastructure to enable rapid growth. This simplified Zuck’s life so he could focus on strategic issues. Facebook had transitioned from startup to serious business. This coming-of-age had implications for me, too. Effectively, Zuck had graduated. With Sheryl as his partner, I did not think Zuck would need mentoring from me any longer. My domain expertise in mobile made me valuable as a strategy advisor, but even that would be a temporary gig. Like most successful entrepreneurs and executives, Zuck is brilliant (and ruthless) about upgrading his closest advisors as he goes along. In the earliest days of Facebook, Sean Parker played an essential role as president, but his skills stopped matching the company’s needs, so Zuck moved on from him. He also dropped the chief operating officer who followed Parker and replaced him with Sheryl. The process is Darwinian in every sense. It is natural and necessary. I have encountered it so many times that I can usually anticipate the right moment to step back. I never give it a moment’s thought.

Knowing that we had accomplished everything we could have hoped for at the time I began mentoring him, I sent Zuck a message saying that my job was done. He was appreciative and said we would always be friends. At this point, I stopped being an insider, but I remained a true believer in Facebook. While failures like Beacon had foreshadowed problems to come, all I could see was the potential of Facebook as a force for good. The Arab Spring was still a year away, but the analyst in me could see how Facebook might be used by grassroots campaigns. What I did not grasp was that Zuck’s ambition had no limit. I did not appreciate that his focus on code as the solution to every problem would blind him to the human cost of Facebook’s outsized success. And I never imagined that Zuck would craft a culture in which criticism and disagreement apparently had no place.

The following year, 2010, was big for Facebook in surprising ways. By July, Facebook had five hundred million users, half of whom visited the site every day. Average daily usage was thirty-four minutes. Users who joined Facebook to stay in touch with family soon found new functions to enjoy. They spent more time on the site, shared more posts, and saw more ads.

October saw the release of The Social Network, a feature film about the early days of Facebook. The film was a critical and commercial success, winning three Academy Awards and four Golden Globes. The plot focused on Zuck’s relationship with the Winklevoss twins and the lawsuit that resulted from it. The portrayal of Zuck was unflattering. Zuck complained that the film did not accurately tell the story, but hardly anyone besides him seemed to care. I chose not to watch the film, preferring the Zuck I knew to a version crafted in Hollywood.

Just before the end of 2010, Facebook improved its user interface again, edging closer to the look and feel we know today. The company finished 2010 with 608 million monthly users. The rate of user growth remained exceptionally high, and minutes of use per user per day continued to rise. Early in 2011, Facebook received an investment of five hundred million dollars for 1 percent of the company, pushing the valuation up to fifty billion dollars. Unlike the Microsoft deal, this transaction reflected a financial investor’s assessment of Facebook’s value. At this point, even Microsoft was making money on its investment. Facebook was not only the most exciting company since Google, it showed every indication that it would become one of the greatest tech companies of all time. New investors were clamoring to buy shares. By June 2011, DoubleClick announced that Facebook was the most visited site on the web, with more than one trillion visits. Nielsen disagreed, saying Facebook still trailed Google, but it appeared to be only a matter of time before the two companies would agree that Facebook was #1.

In March 2011, I saw a presentation that introduced the first seed of doubt into my rosy view of Facebook. The occasion was the annual TED Conference in Long Beach, the global launch pad for TED Talks. The eighteen-minute Talks are thematically organized over four days, providing brain candy to millions far beyond the conference. That year, the highlight for me was a nine-minute talk by Eli Pariser, the board president of MoveOn.org. Eli had an insight that his Facebook and Google feeds had stopped being neutral. Even though his Facebook friend list included a balance of liberals and conservatives, his tendency to click more often on liberal links had led the algorithms to prioritize such content, eventually crowding out conservative content entirely. He worked with friends to demonstrate that the change was universal on both Facebook and Google. The platforms were pretending to be neutral, but they were filtering content in ways that were invisible to users. Having argued that the open web offered an improvement on the biases of traditional content editors, the platforms were surreptitiously implementing algorithmic filters that lacked the value system of human editors. Algorithms would not act in a socially responsible way on their own. Users would think they were seeing a balance of content when in fact they were trapped in what Eli called a “filter bubble” created and enforced by algorithms. He hypothesized that giving algorithms gatekeeping power without also requiring civic responsibility would lead to unexpected, negative consequences. Other publishers were jumping on board the personalization bandwagon. There might be no way for users to escape from filter bubbles.

Eli’s conclusion? If platforms are going to be gatekeepers, they need to program a sense of civic responsibility into their algorithms. They need to be transparent about the rules that determine what gets through the filter. And they need to give users control of their bubble.

I was gobsmacked. It was one of the most insightful talks I had ever heard. Its import was obvious. When Eli finished, I jumped out of my seat and made a beeline to the stage door so that I could introduce myself. If you view the talk on TED.com today, you will immediately appreciate its importance. At the time I did not see a way for me to act on Eli’s insight at Facebook. I no longer had regular contact with Zuck, much less inside information. I was not up to speed on the engineering priorities that had created filter bubbles or about plans for monetizing them. But Eli’s talk percolated in my mind. There was no good way to spin filter bubbles. All I could do was hope that Zuck and Sheryl would have the sense not to use them in ways that would harm users. (You can listen to Eli Pariser’s “Beware Online ‘Filter Bubbles’” talk for yourself on TED.com.)

Meanwhile, Facebook marched on. Google introduced its own social network, Google+, in June 2011, with considerable fanfare. By the time Google+ came to market, Google had become a gatekeeper between content vendors and users, forcing content vendors who wanted to reach their own audience to accept Google’s business terms. Facebook took a different path to a similar place. Where most of Google’s products delivered a single function that gained power from being bundled, Facebook had created an integrated platform, what is known in the industry as a walled garden, that delivered many forms of value. Some of the functions on the platform had so much value that Facebook spun them off as stand-alone products. One example: Messenger.

Thanks to its near monopoly of search and the AdWords advertising platform that monetized it, Google knew more about purchase intentions than any other company on earth. A user looking to buy a hammer would begin with a search on Google, getting a set of results along with three AdWords ads from vendors looking to sell hammers. The search took milliseconds. The user bought a hammer, the advertiser sold one, and Google got paid for the ad. Everyone got what they wanted. But Google was not satisfied. It did not know the consumer’s identity. Google realized that its data set of purchase intent would have greater value if it could be tied to customer identity. I call this McNamee’s 7th Law: data sets become geometrically more valuable when you combine them. That is where Gmail changed the game. Users got value in the form of a good email system, but Google received something far more valuable. By tying purchase intent to identity, Google laid the foundation for new business opportunities. It then created Google Maps, enabling it to tie location to purchase intent and identity. The integrated data set rivaled Amazon’s, but without warehouses and inventory it generated much greater profits for Google. Best of all, combined data sets often reveal insights and business opportunities that could not have been imagined previously. The new products were free to use, but each one contributed data that transformed the value of Google’s advertising products. Facebook did something analogous with each function it added to the platform. Photo tagging expanded the social graph. News Feed enriched it further. The Like button delivered data on emotional triggers. Connect tracked users as they went around the web. The value is not really in the photos and links posted by users. The real value resides in metadata—data about data—which is what we call the data that describes where the user was when he or she posted, what they were doing, with whom they were doing it, alternatives they considered, and more. Broadcast media like television, radio, and newspapers lack the real-time interactivity necessary to create valuable metadata. Thanks to metadata, Facebook and Google create a picture of the user that can be monetized more effectively than traditional media. When collected on the scale of Google and Facebook, metadata has unimaginable value. When people say, “In advertising businesses, users are not the customer; they are the product,” this is what they are talking about. But in the process, Facebook in particular changed the nature of advertising. Traditional advertising seeks to persuade, but in a one-size-fits-most kind of way. The metadata that Facebook and others collected enabled them to find unexpected patterns, such as “four men who collect baseball cards, like novels by Charles Dickens, and check Facebook after midnight bought a certain model of Toyota,” creating an opportunity to package male night owls who collect baseball cards and like Dickens for car ads. Facebook allows advertisers to identify each user’s biases and appeal to them individually. Insights gathered this way changed the nature of ad targeting. More important, though, all that data goes into Facebook’s (or Google’s) artificial intelligence and can be used by advertisers to exploit the emotions of users in ways that increase the likelihood that they purchase a specific model of car or vote in a certain way. As the technology futurist Jaron Lanier has noted, advertising on social media platforms has evolved into a form of manipulation.

Google+ was Google’s fourth foray into social networking. Why did Google try so many times? Why did it keep failing? By 2011, it must have been obvious to Google that Facebook had the key to a new and especially valuable online advertising business. Unlike traditional media or even search, social networking provided signals about each user’s emotional state and triggers. Relative to the monochrome of search, social network advertising offered Technicolor, the equivalent of Oz vs. Kansas in The Wizard of Oz. If you are trying to sell a commodity product like a hammer, search advertising is fine, but for branded products like perfume or cars or clothing, social networking’s data on emotions has huge incremental value. Google wanted a piece of that action. Google+ might have added a new dimension to Google’s advertising business, but Facebook had a prohibitive lead when Google+ came to market, and the product’s flaws prevented it from gaining much traction with people outside of Google. All it offered was interesting features, and Facebook imitated the good parts quickly.

Facebook took no chances with Google+. The company went to battle stations and devoted every resource to stopping Google on the beach of social networking. The company cranked up its development efforts, dramatically increasing the size limits for posts, partnering with Skype, introducing the Messenger texting product, and adding a slew of new tools for creating applications on the platform. As 2012 began, Facebook was poised for a breakout year. The company had a new advertising product—Open Graph—that leveraged its Social Graph, the tool to capture everything it knew from both inside Facebook and around the web. Initially, Facebook gave advertisers access only to data captured inside the platform. Facebook also enabled advertisements in the News Feed for the first time. News Feed ads really leveraged Facebook’s user experience. Ads blended in with posts from friends, which meant more people saw them, but there was also a downside: it was very hard to get an ad to stand out the way it would on radio or TV or in print.

The big news early in 2012 came when Facebook filed for an initial public offering (IPO) and then acquired Instagram for one billion dollars. The Facebook IPO, which took place on May 17, raised sixteen billion dollars, making it the third largest in US history. The total valuation of $104 billion was the highest ever for a newly public company. Facebook had revenues of nearly four billion dollars and net income of one billion dollars in the year prior to the IPO and found itself in the Fortune 500 list of companies from day one.

As impressive as all those numbers are, the IPO itself was something of a train wreck. Trading glitches occurred during the first day, preventing some trades from going through, and the stock struggled to stay above the IPO price. The deal set a record for trading volume on the first day after an IPO: 460 million shares.

The months leading up to the IPO saw weakness in Facebook’s advertising sales that triggered reductions in the company’s revenue forecast. When a company is preparing for an IPO, forecast reductions can be disastrous, as public investors have no incentive to buy into uncertainty. In Facebook’s case, investors’ extreme enthusiasm for the company—based primarily on user growth and Facebook’s increasing impact on society—meant the IPO could survive the reduction in forecast, but Zuck’s dream of a record-setting offering might be at risk. As described by former Facebook advertising targeting manager Antonio García Martínez in his book Chaos Monkeys, “The narratives the company had woven about the new magic of social-media marketing were in deep reruns with advertisers, many of whom were beginning to openly question the fortunes they had spent on Facebook thus far, often with little to show for it.” For all its success with users, Facebook had not yet created an advertising product that provided the targeting necessary to provide appropriate results for advertisers. Martínez went on to say, “A colossal yearlong bet the company had made on a product called Open Graph, and its accompanying monetization spin-off, Sponsored Stories, had been an absolute failure in the market.” Advertisers had paid a lot of money to Facebook, believing the company’s promises about ad results, but did not get the value they felt they deserved. For Facebook, this was a moment of truth. By pushing the IPO valuation to record levels, Facebook set itself up for a rocky start as a public company.

The newly public stock sold off almost immediately and went into free fall after Yahoo Finance reported that the investment banks that had underwritten the IPO had reduced their earnings forecasts just before the offering. In the heat of the deal, had those forecast changes been effectively communicated to buyers of the stock? The situation was sufficiently disturbing that regulatory authorities initiated a review. Lawsuits followed, alleging a range of violations with respect to the trading glitches and the actions of one underwriter. A subsequent set of lawsuits named the underwriters, Zuck and Facebook’s board, and Nasdaq. The Wall Street Journal characterized the IPO as a “fiasco.”

For Facebook’s business, though, the IPO was an undisputed blessing. The company received a staggering amount of free publicity before the deal, essentially all of it good. That turbocharged user growth, news of which enabled Facebook to survive the IPO issues with relatively little damage. Investors trusted that a company with such impressive user growth would eventually figure out monetization. Once again, Facebook pushed the envelope, stumbled, and got away with it. Then they did something really aggressive.

The data from inside Facebook alone did not deliver enough value for advertisers. Thanks to Connect and the ubiquitous Like and Share buttons, Facebook had gathered staggering amounts of data about user behavior from around the web. The company had chosen not to use the off-site data for commercial purposes, a self-imposed rule that it decided to discard when the business slowed down. No one knew yet how valuable the external data would be, but they decided to find out. As Martínez describes it, Zuck and Sheryl began cautiously, fearful of alienating users.

Thanks to the IPO, Facebook enjoyed a tsunami of user growth. Within a few months, user growth restored investor confidence. It also overwhelmed the complaints from advertisers, who had to go where their customers were, even if the ad vehicles on Facebook were disappointing. The pressure to integrate user data from activities away from Facebook into the ad products lessened a bit, but the fundamental issues with targeting and the value of ads remained. As a result, the decision to integrate user data from outside Facebook would not be reversed.

In early October 2012, the company announced it had surpassed one billion monthly users, with 600 million mobile users, 219 billion photo uploads, and 140 billion friend connections. Despite the mess of the IPO—and not being privy to the issues with ads—I took great pride in Facebook’s success. The stock turned out to be a game changer for Elevation. Even though my partners had turned down our first opportunity to invest, Elevation subsequently made a large investment at a relatively low price, ensuring on its own that the fund would be a winner.

Only eight and a half years from Zuck’s dorm room, Facebook had become a powerful economic engine. Thanks to the philosophy of “move fast and break things,” no one at Facebook was satisfied with a record-setting IPO. They began hacking away at the problem of monetizing users. There were several challenges. As Martínez wrote in Chaos Monkeys, the advertising team around the time of the IPO was, for the most part, young people who had no previous work experience in advertising or even media. They learned everything by trial and error. For every innovation, there were many mistakes, some of which would have been obvious to a more experienced team. The team may have been young, but they were smart, highly motivated, and persistent. Their leadership, with Sheryl Sandberg at the top, created a successful sales culture. They took a long view and learned from every mistake. They focused on metrics.

In the early days, Facebook did its best to create effective advertising products and tools from profile data, users’ friend relationships, and user actions on the site. My band, Moonalice, was an early advertiser, with a budget of less than ten thousand dollars a year. Our first ads, a few years before the IPO, were tiny rectangles on the side of the page, with a few words of text and maybe a link. The goal was to introduce Moonalice to new fans. We promoted a song called “It’s 4:20 Somewhere” this way. We ran an ad for several years—typically spending ten or twenty dollars a day—and people downloaded the song 4.6 million times, a number cited by the Rock & Roll Hall of Fame as a record from any band’s own website. A little Facebook ad running every day for three years made it possible. But when the only option was a tiny rectangle, Facebook ads were ineffective for many advertisers and products. The same format that worked so well for downloading a song was worthless for promoting a conference. I have no idea why it worked for one thing and not the other. It did not matter much, because in those days, Facebook allowed plenty of free distribution, which they called “organic reach.” Back then, for a fan page likes ours, Facebook would let a really compelling post reach about 15 percent of our fans for free. The value of organic reach on Facebook compelled us and millions of others to shift the focus of our communications from a website to Facebook. We trained our fans to interact with us on Facebook and to use our website as a content archive. Many others did the same, helping to cement Facebook’s position as the social hub of the web. Embracing Facebook worked really well for Moonalice, and our page eventually gathered more than 420,000 followers.

Not surprisingly, there was a catch. Every year or so, Facebook would adjust the algorithm to reduce organic reach. The company made its money from advertising, and having convinced millions of organizations to set up shop on the platform, Facebook held all the cards. The biggest beneficiaries of organic reach had no choice but to buy ads to maintain their overall reach. They had invested too much time and had established too much brand equity on Facebook to abandon the platform. Organic reach declined in fits and starts until it finally bottomed at about 1 percent or less. Fortunately, Facebook would periodically introduce a new product—the Facebook Live video service, for example—and give those new products greater organic reach to persuade people like us to use them. We signed up for Facebook Live on the first day it was available and streamed a concert that same day. The reach was fantastic. Facebook Live and Moonalice were made for each other. I streamed one set of the very first concert by Dead & Company, a spin-off from the Grateful Dead, and so many people watched it that the band saw a surge in ticket sales for other dates on the tour. As a result, one of the band’s managers invited me to stream their next show from the stage.

At the time of the IPO, targeting options for Facebook ads were limited to demographic information from activity on the site, things like age, sex, and location, as well as interests and relationships. The introduction of Open Graph and News Feed ads in 2012 set the stage for much better targeting, which improved rapidly when Facebook integrated “off-site” data into the suite available to advertisers. If Moonalice wanted to promote a concert, we would target demographic data—say, people over twenty-one in the city where our gig was—and then filter that audience with interests, like “concerts,” “Beatles,” and “hippie.” We would spend perhaps one hundred dollars to promote a show on Facebook. We would get a few thousand “impressions,” which in theory meant users who saw the ad. The nature of News Feed is such that users race past a lot of posts. To capture attention, we switched from promoting Events—which is what Facebook called our concerts—to creating posts that included a rich graphic element, such as a poster. In doing so, we ran afoul of the 20 percent rule. As it was explained to me by a senior Facebook executive, Zuck had decided that too much text made ads boring, so he set an arbitrary limit of 20 percent text. Our posters are works of art, but many of them violated the 20 percent rule because rock posters sometimes integrate lots of text into the art. Facebook would reject those ads, so I learned to superimpose a little bit of text onto attention-grabbing photos to create compelling images that would comply with Facebook’s rules.

Moonalice is not a sophisticated advertiser, but we were not alone in that regard. Facebook enabled millions of organizations with small budgets to reach audiences for a fraction of the cost of print, radio, or TV advertisements. But Facebook recognized that the really big money would come from attracting the advertisers who had historically spent giant budgets on traditional media. Such advertisers had completely different expectations. They expected to reach large, targeted audiences at a reasonable cost with complete transparency, which is to say they wanted proof that their messages reached their intended audiences. At the time of the IPO, Facebook could not meet those expectations consistently. In 2013, Facebook began experimenting with data from user activity outside Facebook. They created tools for advertisers to exploit that data. The tools enabled Facebook advertisers the ability to target audiences whose emotions were being triggered in predictable ways.

Facebook’s culture matched its advertising challenge perfectly. A company that prided itself on its software hacking roots perfected a new model to monetize its success. Growth hacking applies the intensely focused, iterative model of software hacking to the problem of increasing user count, time on site, and revenue. It works only when a company has a successful product and a form of monetization that can benefit from tinkering, but for the right kind of company, growth hacking can be transformational. Obsessive focus on metrics is a central feature of growth hacking, so it really matters that you pick the correct metrics.

From late 2012 to 2017, Facebook perfected growth hacking. The company experimented constantly with algorithms, new data types, and small changes in design, measuring everything. Every action a user took gave Facebook a better understanding of that user—and of that user’s friends—enabling the company to make tiny improvements in the “user experience” every day, which is to say they got better at manipulating the attention of users. The goal of growth hacking is to generate more revenue and profits, and at Facebook those metrics blocked out all other considerations. In the world of growth hacking, users are a metric, not people. It is unlikely that civic responsibility ever came up in Facebook’s internal conversations about growth hacking. Once the company started applying user data from outside the platform, there was no turning back. The data from outside Facebook transformed targeting inside Facebook. Additional data improved it more, giving Facebook an incentive to gather data anywhere it could be gathered. The algorithms looked for and found unexpected correlations in the data that could be monetized effectively. Before long, Facebook’s surveillance capabilities rivaled those of an intelligence agency.

To deliver better targeting, Facebook introduced new tools for advertisers. Relative to the 2016 election, the two most important may have been Custom Audiences and Lookalike Audiences. As described in Facebook’s Advertiser Help Center, a Custom Audience is “a type of audience you can create made up of your existing customers. You can target ads to the audience you’ve created on Facebook, Instagram, and Audience Network,” the last of which is “a network of publisher-owned apps and sites where you can show your ads” outside the Facebook platform. Introduced in 2013, Custom Audiences had two very important forms of value to advertisers: first, advertisers could build an ad campaign around known customers, and second, a Custom Audience could be used to create a Lookalike Audience, which finds other Facebook users who share characteristics with the Custom Audience. Lookalike scales without limit, so advertisers have the option to find every user on Facebook with a given set of characteristics. You could start with as few as one hundred people, but the larger the Custom Audience, the better the Lookalike will be. Facebook recommends using a Custom Audience between one thousand and fifty thousand.

Thanks to growth hacking, Facebook made continuous improvements in its advertising tools, as well as growing its audience, increasing time on site, and gathering astonishing amounts of data. Progress against these metrics translated into explosive revenue growth. From one billion users at year-end 2012, Facebook grew to 1.2 billion in 2013, 1.4 billion in 2014, 1.6 billion in 2015, nearly 1.9 billion in 2016, and 2.1 billion in 2017. From just more than $5 billion in sales in the IPO year of 2012, Facebook grew to $7.8 billion in 2013, $12.5 billion in 2014, $17.9 billion in 2015, $27.6 billion in 2016, and $40.7 billion in 2017. There were issues along the way. Advertisers complained about the lack of transparency relative to advertising, and Facebook has been sued for inflating some metrics, including ad views and video views. But Facebook had become a juggernaut. The customers that advertisers needed to reach were on Facebook. This gave Facebook enormous leverage. When advertisers complained, Facebook could get away with apologies and marginal fixes. With its customary laser focus on a handful of metrics, Facebook did not devote any energy to questioning its decisions. If there was any soul searching about the morality of intense surveillance and the manipulation of user attention, or about protecting users against unintended consequences, I have been able to find no evidence of it. If Zuck and the Facebook team noticed that usage of Facebook differed materially from their ideal, they showed no concern. If anyone noticed the increasingly extreme behavior inside some Facebook Groups, no one took action. The Russians exploited this to sow dissention among Americans and Western Europeans, beginning in 2014. When The Guardian newspaper in the UK broke the story in December 2015 that Cambridge Analytica had misappropriated profiles from at least fifty million Facebook users, it precipitated an intense but brief scandal. Facebook apologized and made Cambridge Analytica sign a piece of paper, certifying that it had destroyed the data set, but then quickly returned to business as usual. While always careful to protect itself from legal liability, Facebook seemed oblivious to signs of trouble. The benefits of growth—in terms of revenue, profits, and influence—were obvious, the problems easy to ignore. At Facebook, everyone remained focused on their metrics.

As 2016 began, Facebook was on a huge roll. Aside from a few PR headaches, the company had not skipped a beat since its IPO. Almost everything that mattered had changed since my days as a mentor to Zuck, and I knew only what had been publicly disclosed or what I had seen with my own eyes. Like its users, Facebook showed the public only the good news, which is why I was so surprised by what I saw during 2016. Bad actors using Facebook’s tools to harm innocent people did not compute for me, but I saw the evidence and could not let it go. It was only when I reengaged with Zuck and Sheryl just before the election that I began to appreciate that my view of Facebook was inaccurate. It took me longer than I would have liked to understand the problem. More than four years of relentless success at Facebook had bred overconfidence. The company was in a filter bubble of its own. Every day, there were more users, spending more time on the site, generating more revenue and earnings, which pushed the stock to new highs. The Midas Effect may have set in, causing Zuck and his team to believe that everything they did was right, always for the best, and uncontestably good for humanity. Humility went out the window. Facebook subordinated everything to growth. Eventually that would create problems it could not resolve with an apology and a promise to do better.

4

The Children of Fogg

It’s not because anyone is evil or has bad intentions. It’s because the game is getting attention at all costs. —TRISTAN HARRIS

On April 9, 2017, onetime Google design ethicist Tristan Harris appeared on 60 Minutes with Anderson Cooper to discuss the techniques that internet platforms like Facebook, Twitter, YouTube, Instagram, and Snapchat use to prey on the emotions of their users. He talked about the battle for attention among media, how smartphones transformed that battle, and how internet platforms profit from that transformation at the expense of their users. The platforms prey on weaknesses in human psychology, using ideas from propaganda, public relations, and slot machines to create habits, then addiction. Tristan called it “brain hacking.”

By the time I saw Tristan’s interview, I had spent three months unsuccessfully trying to persuade Facebook that its business model and algorithms were a threat to users and also to its own brand. I realized I couldn’t do it alone—I needed someone who could help me understand what I had observed over the course of 2016. Tristan’s vision explained so much of what I had seen. His focus was on public health, but I saw immediately the implications for elections and economics.

I got Tristan’s contact information and called him the next day. He told me that he had been trying to get engineers at technology companies like Google to understand brain hacking for more than three years. We decided to join forces. Our goal was to make the world aware of the dark side of social media. Our focus would be on Tristan’s public health framework, but we would look for opportunities to address political issues, such as elections, and economic issues like innovation and entrepreneurship. Our mission might be quixotic, but we were determined to give it a try.

Tristan was born in 1984, the year of the Macintosh. He grew up as the only child of a single mother in Santa Rosa, California, an hour or so north of the Golden Gate Bridge and San Francisco. When Tristan got his first computer at age five, he fell in love. As a child, Tristan showed particular interest in magic, going to a special camp where his unusual skills led to mentoring by several professional magicians. As performed by magicians, magic tricks exploit the evolutionary foundations of human attention. Just as all humans smile more or less the same way, we also respond to certain visual stimuli in predictable ways. Magicians know a lot about how attention works, and they structure their tricks to take advantage. That’s how a magician’s coin appears to fly from one hand to the other and then disappears. Or how a magician can make a coin disappear and then reappear from a child’s ear. When a magician tells you to “pick a card, any card,” they do so after a series of steps designed to cause you to pick a very specific card. All these tricks work on nearly every human because they play on our most basic wiring. We cannot help but be astonished because our attention has been manipulated in an unexpected manner. Language, culture, and even education level do not matter to a magician. The vast majority of humans react the same way.

For young Tristan, magic gave way to computers in the transition from elementary to middle school. Computers enabled Tristan to build stuff, which seemed like magic. He embraced programming languages the way some boys embrace baseball stats, making games and applications of increasing sophistication. It was the late nineties, and Apple was just emerging from a slump that had lasted more than a decade. Tristan fell in love with his Mac and with Apple, dreaming of working there one day. It didn’t take long, thanks to the admissions department at Stanford.

Stanford University is the academic hub of Silicon Valley. Located less than two hours south of Tristan’s home in Santa Rosa, Stanford has given birth to many of the most successful technology companies in history, including Google. When Tristan arrived at Stanford in the fall of 2002, he focused on computer science. Less than a month into his freshman year, he followed through on his dream and applied for a summer internship at Apple, which he got, working mostly on design projects. Some of the code and the user interfaces he created over the course of three summer jobs remain in Apple products today.

After graduation, Tristan enrolled in the graduate computer science master’s program at Stanford. In his first term, he took a class in persuasive technology with Professor B. J. Fogg, whose textbook, Persuasive Technology, is the standard in the field. Professors at other universities teach the subject, but being at Stanford gave Fogg outsized influence in Silicon Valley. His insight was that computing devices allow programmers to combine psychology and persuasion concepts from the early twentieth century, like propaganda, with techniques from slot machines, like variable rewards, and tie them to the human social need for approval and validation in ways that few users can resist. Like a magician doing a card trick, the computer designer can create the illusion of user control when it is the system that guides every action. Fogg’s textbook lays out a formula for persuasion that clever programmers can exploit more effectively on each new generation of technology to hijack users’ minds. Prior to smartphones like the iPhone and Android, the danger was limited. After the transition to smartphones, users did not stand a chance. Fogg did not help. As described in his textbook, Fogg taught ethics by having students “work in small teams to develop a conceptual design for an ethically questionable persuasive technology—the more unethical the better.” He thought this was the best way to get students to think about the consequences of their work.

Disclosure that the techniques he taught may have contributed to undermining democracy and public health have led to criticism of Professor Fogg himself. After reading Fogg’s textbook and a Medium post he wrote, I developed a sense that he is a technology optimist who embraced Silicon Valley’s value system, never imagining that his insights might lead to material harm. I eventually had an opportunity to speak to Fogg. He is a thoughtful and friendly man who feels he is being unfairly blamed for the consequences of persuasive technology on internet platforms. He told me that he made several attempts to call attention to the dangers of persuasive technology, but that Silicon Valley paid no attention.

In companies like Facebook and Google, Fogg’s disciples often work in what is called the Growth group, the growth hackers charged with increasing the number of users, time on site, and engagement with ads. They have been very successful. When we humans interact with internet platforms, we think we are looking at cat videos and posts from friends in a simple news feed. What few people know is that behind the news feed is a large and advanced artificial intelligence. When we check a news feed, we are playing multidimensional chess against massive artificial intelligences that have nearly perfect information about us. The goal of the AI is to figure out which content will keep each of us highly engaged and monetizable. Success leads the AI to show us more content like whatever engaged us in the past. For the 1.47 billion users who check Facebook every day, reinforcement of beliefs, every day for a year or two, will have an effect. Not on every user in every case, but on enough users in enough situations to be both effective for advertising and harmful to democracy.

The artificial intelligences of companies like Facebook (and Google) now include behavioral prediction engines that anticipate our thoughts and emotions, based on patterns found in the reservoir of data they have accumulated about users. Years of Likes, posts, shares, comments, and Groups have taught Facebook’s AI how to monopolize our attention. Thanks to all this data, Facebook can offer advertisers exceptionally high-quality targeting. The challenge has been to create ad products that extract maximum value from that targeting.

The battle for attention requires constant innovation. As the industry learned with banner ads in the early days of the internet, users adapt to predictable ad layouts, skipping over them without registering any of the content. When it comes to online ads, there’s a tradeoff. On the one hand, it is a lot easier to make sure the right person is seeing your ad. On the other hand, it is a lot harder to make sure that person is paying attention to the ad. For the tech platforms, the solution to the latter problem is to maximize the time users spend on the platform. If they devote only a small percentage of their attention to the ads they see, then the key is to monopolize as much of their attention as possible. So Facebook (and other platforms) add new content formats and products in the hope of stimulating more engagement. In the beginning, text was enough. Then photos took over. Then mobile. Video is the new frontier. In addition to new formats, Facebook also introduces new products, such as Messenger and, soon, dating. To maximize profits, internet platforms, including Facebook, hide the ball on the effectiveness of ads.

Platforms provide less-than-industry-standard visibility to advertisers, preventing traditional audit practices. The effectiveness of advertising has always been notoriously difficult to assess—hence the aphorism “I know half my ad spending is wasted; I just don’t know which half”—and platform ads work well enough that advertisers generally spend more every year. Search ads on Google offer the clearest payback; brand ads on other platforms are much harder to measure. What matters, though, is that advertisers need to put their message in front of prospective customers, no matter where they may be. As users gravitate from traditional media to the internet, the ad dollars follow them. Until they come up with an ad format that is truly compelling, platforms will do whatever they can to maximize daily users and time on site. So long as the user is on the site, the platform will get paid for ads.

—

INTERNET PLATFORMS HAVE EMBRACED B. J. Fogg’s approach to persuasive technology, applying it in every way imaginable on their sites. Autoplay and endless feeds eliminate cues to stop. Unpredictable, variable rewards stimulate behavioral addiction. Tagging, Like buttons, and notifications trigger social validation loops. As users, we do not stand a chance. Humans have evolved a common set of responses to certain stimuli—“flight or fight” would be an example—that can be exploited by technology. When confronted with visual stimuli, such as vivid colors—red is a trigger color—or a vibration against the skin near our pocket that signals a possible enticing reward, the body responds in predictable ways: a faster heartbeat and the release of a neurotransmitter, dopamine. In human biology, a faster heartbeat and the release of dopamine are meant to be momentary responses that increase the odds of survival in a life-or-death situation. Too much of that kind of stimulus is a bad thing for any human, but the effects are particularly dangerous in children and adolescents. The first wave of consequences includes lower sleep quality, an increase in stress, anxiety, depression, an inability to concentrate, irritability, and insomnia. That is just the beginning. Many of us develop nomophobia, which is the fear of being separated from one’s phone. We are conditioned to check our phones constantly, craving ever more stimulation from our platforms of choice. Many of us develop problems relating to and interacting with other people. Kids get hooked on games, texting, Instagram, and Snapchat that change the nature of human experience. Cyberbullying becomes easy over texting and social media because when technology mediates human relationships, the social cues and feedback loops that would normally cause a bully to experience shunning or disgust by their peers are not present. Adults get locked into filter bubbles, which Wikipedia defines as “a state of intellectual isolation that can result from personalized searches when a website algorithm selectively guesses what information a user would like to see based on information about the user, such as location, past click-behavior and search history.” Filter bubbles promote engagement, which makes them central to the business models of Facebook and Google. But filter bubbles are not unique to internet platforms. They can also be found on any journalistic medium that reinforces the preexisting beliefs of its audience, while suppressing any stories that might contradict them. Partisan TV channels like Fox News and MSNBC maintain powerful filter bubbles, but they cannot match the impact of Facebook and Google because television is a one-way, broadcast medium. It does not allow for personalization, interactivity, sharing, or groups.

In the context of Facebook, filter bubbles have several elements. In the endless pursuit of engagement, Facebook’s AI and algorithms feed each of us a steady diet of content similar to what has engaged us most in the past. Usually that is content we “like.” Every click, share, and comment helps Facebook refine its AI just a little bit. With 2.2 billion people clicking, sharing, and commenting every month—1.47 billion every day—Facebook’s AI knows more about users than they can imagine. All that data in one place would be a target for bad actors, even if it were well-protected. But Facebook’s business model is to give the opportunity to exploit that data to just about anyone who is willing to pay for the privilege.

Tristan makes the case that platforms compete in a race to the bottom of the brain stem—where the AIs present content that appeals to the low-level emotions of the lizard brain, things like immediate rewards, outrage, and fear. Short videos perform better than longer ones. Animated GIFs work better than static photos. Sensational headlines work better than calm descriptions of events. As Tristan says, the space of true things is fixed, while the space of falsehoods can expand freely in any direction—false outcompetes true. From an evolutionary perspective, that is a huge advantage. People say they prefer puppy photos and facts—and that may be true for many—but inflammatory posts work better at reaching huge audiences within Facebook and other platforms.

Getting a user outraged, anxious, or afraid is a powerful way to increase engagement. Anxious and fearful users check the site more frequently. Outraged users share more content to let other people know what they should also be outraged about. Best of all from Facebook’s perspective, outraged or fearful users in an emotionally hijacked state become more reactive to further emotionally charged content. It is easy to imagine how inflammatory content would accelerate the heart rate and trigger dopamine hits. Facebook knows so much about each user that they can often tune News Feed to promote emotional responses. They cannot do this all the time to every user, but they do it far more than users realize. And they do it subtly, in very small increments. On a platform like Facebook, where most users check the site every day, small daily nudges over long periods of time can eventually produce big changes. In 2014, Facebook published a study called “Experimental Evidence of Massive-Scale Emotional Contagion Through Social Networks,” where they manipulated the balance of positive and negative messages in the News Feeds of nearly seven hundred thousand users to measure the influence of social networks on mood. In its internal report, Facebook claimed the experiment provided evidence that emotions can spread over its platform. Without getting prior informed consent or providing any warning, Facebook made people sad just to see if it could be done. Confronted with a tsunami of criticism, Sheryl Sandberg said this: “This was part of ongoing research companies do to test different products, and that was what it was; it was poorly communicated. And for that communication we apologize. We never meant to upset you.” She did not apologize for running a giant psychological experiment on users. She claimed that experiments like this are normal “for companies.” And she concluded by apologizing only for Facebook’s poor communication. If Sheryl’s comments are any indication, running experiments on users without prior consent is a standard practice at Facebook.

It turns out that connecting 2.2 billion people on a single network does not naturally produce happiness for all. It puts pressure on users, first to present a desirable image, then to command attention in the form of Likes or shares from others. In such an environment, the loudest voices dominate, which can be intimidating. As a result, we follow the human instinct to organize ourselves into clusters or tribes. This starts with people who share our beliefs, most often family, friends, and Facebook Groups to which we belong. Facebook’s News Feed enables every user to surround him- or herself with like-minded people. While Facebook notionally allows us to extend our friend network to include a highly diverse community, in practice, many users stop following people with whom they disagree. When someone provokes us, it feels good to cut them off, so lots of people do that. The result is that friends lists become more homogeneous over time, an effect that Facebook amplifies with its approach to curating News Feed. When content is coming from like-minded family, friends, or Groups, we tend to relax our vigilance, which is one of the reasons why disinformation spreads so effectively on Facebook.

Giving users what they want sounds like a great idea, but it has at least one unfortunate by-product: filter bubbles. There is a high correlation between the presence of filter bubbles and polarization. To be clear, I am not suggesting that filter bubbles create polarization, but I believe they have a negative impact on public discourse and politics because filter bubbles isolate the people stuck in them. Filter bubbles exist outside Facebook and Google, but gains in attention for Facebook and Google are increasing the influence of their filter bubbles relative to others.

Everyone on Facebook has friends and family, but many are also members of Groups. Facebook allows Groups on just about anything, including hobbies, entertainment, teams, communities, churches, and celebrities. There are many Groups devoted to politics, across the full spectrum. Facebook loves Groups because they enable easy targeting by advertisers. Bad actors like them for the same reason. Research by Cass Sunstein, who was the administrator of the White House Office of Information and Regulatory Affairs for the first Obama administration, indicates that when like-minded people discuss issues, their views tend to get more extreme over time.

Groups of politically engaged users who share a common set of beliefs reinforce each other, provoking shared outrage at perceived enemies, which, as I previously noted, makes them vulnerable to manipulation. Jonathon Morgan of Data for Democracy has observed that as few as 1 to 2 percent of a group can steer the conversation if they are well-coordinated. That means a human troll with a small army of digital bots—software robots—can control a large, emotionally engaged Group, which is what the Russians did when they persuaded Groups on opposite sides of the same issue—like pro-Muslim groups and anti-Muslim groups—to simultaneously host Facebook events in the same place at the same time, hoping for a confrontation.

Facebook wants us to believe that it is merely a platform on which others act and that it is not responsible for what those third parties do. Both assertions warrant debate. In reality, Facebook created and operates a complex system built around a value system that increasingly conflicts with the values of the users it is supposed to serve. Where Facebook asserts that users control their experience by picking the friends and sources that populate their News Feed, in reality an artificial intelligence, algorithms, and menus created by Facebook engineers control every aspect of that experience. With nearly as many monthly users as there are notional Christians in the world, and nearly as many daily users as there are notional Muslims, Facebook cannot pretend its business model and design choices do not have a profound effect. Facebook’s notion that a platform with more than two billion users can and should police itself also seems both naïve and self-serving, especially given the now plentiful evidence to the contrary. Even if it were “just a platform,” Facebook has a responsibility for protecting users from harm. Deflection of responsibility has serious consequences.

—

THE COMPETITION FOR ATTENTION across the media and technology spectrum rewards the worst social behavior. Extreme views attract more attention, so platforms recommend them. News Feeds with filter bubbles do better at holding attention than News Feeds that don’t have them. If the worst thing that happened with filter bubbles was that they reinforced preexisting beliefs, they would be no worse than many other things in society. Unfortunately, people in a filter bubble become increasingly tribal, isolated, and extreme. They seek out people and ideas that make them comfortable.

Social media has enabled personal views that had previously been kept in check by social pressure—white nationalism is an example—to find an outlet. Before the platforms arrived, extreme views were often moderated because it was hard for adherents to find one another. Expressing extreme views in the real world can lead to social stigma, which also keeps them in check. By enabling anonymity and/or private Groups, the platforms removed the stigma, enabling like-minded people, including extremists, to find one another, communicate, and, eventually, to lose the fear of social stigma.

On the internet, even the most socially unacceptable ideas can find an outlet. As a proponent of free speech, I believe every person is entitled to speak his or her mind. Unfortunately, anonymity, the ability to form Groups in private, and the hands-off attitude of platforms have altered the normal balance of free speech, often giving an advantage to extreme voices over reasonable ones. In the absence of limits imposed by the platform, hate speech, for example, can become contagious. The fact that there are no viable alternatives to Facebook and Google in their respective markets places a special burden on those platforms with respect to content moderation. They have an obligation to address the unique free-speech challenges posed by their scale and monopoly position. It is a hard problem to solve, made harder by continuing efforts to deflect responsibility. The platforms have also muddied the waters by frequently using free-speech arguments as a defense against attacks on their business practices.

Whether by design or by accident, platforms empower extreme views in a variety of ways. The ease with which like-minded extremists can find one another creates the illusion of legitimacy. Protected from real-world stigma, communication among extreme voices over internet platforms generally evolves to more dangerous language. Normalization lowers a barrier for the curious; algorithmic reinforcement leads some users to increasingly extreme positions. Recommendation engines can and do exploit that. For example, former YouTube algorithm engineer Guillaume Chaslot created a program to take snapshots of what YouTube would recommend to users. He learned that when a user watches a regular 9/11 news video, YouTube will then recommend 9/11 conspiracies; if a teenage girl watches a video on food dietary habits, YouTube will recommend videos that promote anorexia-related behaviors. It is not for nothing that the industry jokes about YouTube’s “three degrees of Alex Jones,” referring to the notion that no matter where you start, YouTube’s algorithms will often surface a Jones conspiracy theory video within three recommendations. In an op-ed in Wired, my colleague Renée DiResta quoted YouTube chief product officer Neal Mohan as saying that 70 percent of the views on his platform are from recommendations. In the absence of a commitment to civic responsibility, the recommendation engine will be programmed to do the things that generate the most profit. Conspiracy theories cause users to spend more time on the site.

Once a person identifies with an extreme position on an internet platform, he or she will be subject to both filter bubbles and human nature. A steady flow of ideas that confirm beliefs will lead many users to make choices that exclude other ideas both online and off. As I learned from Clint Watts, a national security consultant for the FBI, the self-imposed blocking of ideas is called a preference bubble. Filter bubbles are imposed by others, while a preference bubble is a choice. By definition, a preference bubble takes users to a bad place, and they may not even be conscious of the change.

Preference bubbles can be all-encompassing, especially if a platform like Facebook or Google amplifies them with a steady diet of reinforcing content. Like filter bubbles, preference bubbles increase time on site, which is a driver of revenue. In a preference bubble, users create an alternative reality, built around values shared with a tribe, which can focus on politics, religion, or something else. They stop interacting with people with whom they disagree, reinforcing the power of the bubble. They go to war against any threat to their bubble, which for some users means going to war against democracy and legal norms. They disregard expertise in favor of voices from their tribe. They refuse to accept uncomfortable facts, even ones that are incontrovertible. This is how a large minority of Americans abandoned newspapers in favor of talk radio and websites that peddle conspiracy theories. Filter bubbles and preference bubbles undermine democracy by eliminating the last vestiges of common ground among a huge percentage of Americans. The tribe is all that matters, and anything that advances the tribe is legitimate. You see this effect today among people whose embrace of Donald Trump has required them to abandon beliefs they held deeply only a few years earlier. Once again, this is a problem that internet platforms did not invent. Existing fissures in society created a business opportunity that platforms exploited. They created a feedback loop that reinforces and amplifies ideas with a speed and at a scale that are unprecedented.

In his book, Messing with the Enemy, Clint Watts makes the case that in a preference bubble, facts and expertise can be the core of a hostile system, an enemy that must be defeated. As Watts wrote, “Whoever gets the most likes is in charge; whoever gets the most shares is an expert. Preference bubbles, once they’ve destroyed the core, seek to use their preference to create a core more to their liking, specially selecting information, sources, and experts that support their preferred alternative reality rather than the real, physical world.” The shared values that form the foundation of our democracy proved to be powerless against the preference bubbles that have evolved over the past decade. Facebook does not create preference bubbles, but it is the ideal incubator for them. The algorithms ensure that users who like one piece of disinformation will be fed more disinformation. Fed enough disinformation, users will eventually wind up first in a filter bubble and then in a preference bubble. If you are a bad actor and you want to manipulate people in a preference bubble, all you have to do is infiltrate the tribe, deploy the appropriate dog whistles, and you are good to go. That is what the Russians did in 2016 and what many are doing now.

—

THE SAD TRUTH IS that Facebook and the other platforms are real-time systems with powerful tools optimized for behavior modification. As users, we sometimes adopt an idea suggested by the platform or by other users on the platform as our own. For example, if I am active in a Facebook Group associated with a conspiracy theory and then stop using the platform for a time, Facebook will do something surprising when I return. It may suggest other conspiracy theory Groups to join because they share members with the first conspiracy Group. And because conspiracy theory Groups are highly engaging, they are very likely to encourage reengagement with the platform. If you join the Group, the choice appears to be yours, but the reality is that Facebook planted the seed. It does so not because conspiracy theories are good for you but because conspiracy theories are good for them.

Research suggests that people who accept one conspiracy theory have a high likelihood of accepting a second one. The same is true of inflammatory disinformation. None of this was known to me when I joined forces with Tristan. In combination with the events I had observed in 2016, Tristan’s insights jolted me, forcing me to accept the fact that Facebook, YouTube, and Twitter had created systems that modify user behavior. They should have realized that global scale would have an impact on the way people used their products and would raise the stakes for society. They should have anticipated violations of their terms of service and taken steps to prevent them. Once made aware of the interference, they should have cooperated with investigators. I could no longer pretend that Facebook was a victim. I cannot overstate my disappointment. The situation was much worse than I realized.

The people at Facebook live in their own preference bubble. Convinced of the nobility of their mission, Zuck and his employees reject criticism. They respond to every problem with the same approach that created the problem in the first place: more AI, more code, more short-term fixes. They do not do this because they are bad people. They do this because success has warped their perception of reality. To them, connecting 2.2 billion people is so obviously a good thing, and continued growth so important, that they cannot imagine that the problems that have resulted could be in any way linked to their designs or business decisions. It would never occur to them to listen to critics—how many billion people have the critics connected?—much less to reconsider the way they do business. As a result, when confronted with evidence that disinformation and fake news spread over Facebook influenced the Brexit referendum in the United Kingdom and a presidential election in the United States, Facebook took steps that spoke volumes about the company’s world view. They demoted publishers in favor of family, friends, and Groups on the theory that information from those sources would be more trustworthy. The problem is that family, friends, and Groups are the foundational elements of filter and preference bubbles. Whether by design or by accident, they share the very disinformation and fake news that Facebook would like to suppress.

—

AS TRISTAN DESCRIBES IT, and Fogg teaches it, there are ten tools that platforms use to manipulate the choices of their users. Some of these tools relate to the interface design of each platform: menus, news feeds, and notifications. Platforms like Facebook would have you believe that the user is always in control, but as I have said before, user control is an illusion. Maintaining that illusion is central to every platform’s success, but with Facebook, it is especially disingenuous. Menu choices limit user actions to things that serve Facebook’s interests. In addition, Facebook’s design teams exploit what are known as “dark patterns” in order to produce desired outcomes. Wikipedia defines a dark pattern as “a user interface that has been carefully crafted to trick users into doing things.” The company tests every pixel to ensure it produces the desired response. Which shade of red best leads people to check their notifications? For how many milliseconds should notifications bubbles appear in the bottom left before fading away, to most effectively keep users on site? Based on what measures of closeness should we recommend new friends for you to “add”?

When you have more than two billion users, you can test every possible configuration. The cost is small. It is no accident that Facebook’s terms of service and privacy settings, like those for most internet platforms, are hard to find and nearly impossible to understand. Facebook places a button on the landing page to give users access to the terms of service, but few people click on it. The button is positioned so that hardly anyone even sees it. Those who do see the button have been trained since the early days of the internet to believe that terms of service are long and incomprehensible, so they don’t press it either. Facebook’s terms of service have one goal and one goal only: to protect the company from legal liability. By using the platform, we give Facebook permission to do just about anything it wants.

Another tool from the Fogg tool kit is the “bottomless bowl.” News Feeds on Facebook and other platforms are endless. In movies and television, scrolling credits signal to the audience that it is time to move on, providing what Tristan would call a “stopping cue.” Platforms with endless news feeds and autoplay remove that signal, ensuring that users maximize their time on site for every visit. Endless news feeds work on dating apps. They work on photo sites like Instagram. And they work on Facebook. YouTube, Netflix, and Facebook use autoplay on their videos because it works, too. Next thing you know, millions of people are sleep deprived from binging on videos, checking Instagram, or browsing Facebook.

Notifications are another way that platforms exploit the weakest elements of human psychology. Notifications exploit an old sales technique, called the “foot in the door” strategy, that lures the prospect with an action that appears to be low cost but sets in motion a process that leads to bigger costs. Who wouldn’t want to know they have just received an email, text, friend request, or Like? As humans, we are not good at forecasting the true cost of engaging with a foot-in-the-door strategy. Worse yet, we behave as though notifications are personal to us, completely missing that they are automatically generated, often by an algorithm tied to an artificial intelligence that has concluded that the notification is just the thing to provoke an action that will serve the platform’s economic interests. That is not even the worst thing about notifications. I will get to that in a moment.

The persuasive technology tricks espoused by Fogg include several related to social psychology: a need for approval, a desire for reciprocity, and a fear of missing out. Everyone wants to feel approved of by others. We want our posts to be liked. We want people to respond to our texts, emails, tags, and shares. The need for social approval is what made Facebook’s Like button so powerful. By controlling how often a user experiences social approval, as evaluated by others, Facebook can get that user to do things that generate billions of dollars in economic value. This makes sense because the currency of Facebook is attention. Users manicure their image in the hope of impressing others, but they soon discover that the best way to get attention is through emotion and conflict. Want attention online? Say something outrageous. This phenomenon first emerged decades ago in online forums such as The WELL, which often devolved into mean-spirited confrontation and has reappeared in every generation of tech platform since then.

Social approval has a twin: social reciprocity. When we do something for someone else, we expect them to respond in kind. Likewise, when a person does something for us, we feel obligated to reciprocate. When someone “follows” us on Instagram, we feel obligated to “follow” them in return. When we see an “Invitation to Connect” on LinkedIn from a friend, we may feel guilty if we do not reciprocate the gesture and accept it. It feels organic, but it is not. Millions of users reciprocate one another’s Likes and friend requests all day long, not aware that platforms orchestrate all of this behavior upstream, like a puppet master. As I noted in chapter 3, one of the most manipulative reciprocity tricks played by Facebook relates to photo tagging. When users post a photo, Facebook offers an opportunity to tag friends—the message “[Friend] has tagged you in a photo” is an appealing form of validation—which initiates a cycle of reciprocity, with notifications to users who have been tagged and an invitation to tag other people in the photo. Tagging was a game changer for Facebook because photos are one of the main reasons users visit Facebook daily in the first place. Each tagged photo brings with it a huge trove of data and metadata about location, activity, and friends, all of which can be used to target ads more effectively. Thanks to photo tagging, users have built a giant database of photos for Facebook, complete with all the information necessary to monetize it effectively. Other platforms play this game, too, but not at Facebook’s scale. For example, Snapchat offers Streaks, a feature that tracks the number of consecutive days a user has traded messages with each person in his or her contacts list. As they build and the number of them grows, Streaks take on a life of their own. For the teens who dominate Snapchat’s user base, Streaks can soon come to embody the essence of a relationship, substituting a Streak number for the elements of true friendship.

Another emotional trigger is fear of missing out (FOMO), which drives users to check their smartphone every free moment, as well as at times when they have no business doing so, such as while driving. FOMO makes notifications enticing. Have you ever tried to deactivate your Facebook account? As the software developer and blogger Matt Refghi discovered, Facebook will present a confirmation screen that shows the faces of several of your closest friends with text underneath: “[Friend] will miss you.” For teens on Instagram or Snapchat, FOMO and the need for social approval combine to magnify the already stressful social lives of teenagers. Teenagers are particularly vulnerable to social pressure, and internet platforms add complexity to that equation that we are only beginning to understand.

The business choices of internet platforms compound the harm of persuasive technologies. Platforms work very hard to grow their user count but operate with little regard for users as individuals. The customer service department is reserved for advertisers. Users are the product, at best, so there is no one for them to call. The level of automation in the platforms is so great that when things go wrong operationally—an account gets hacked or locked, or the platform mistakenly blocks the user—the user generally must jump through hoops to rectify the problem. When a platform changes its terms of service, there is generally no obvious disclosure. Usage of the platform translates into acceptance of the terms of service. In short, users have no say in the relationship. In the event of a disagreement, their only option is to discontinue use of the service and lose access to an entire network of communication, which may include social opportunities and work opportunities. For services as ubiquitous as Facebook and Google, that is not a reasonable choice, which is why the platforms require it. They know that human psychology—the desire to protect an investment of time and content—and network effects will keep users on board, no matter how poorly the platforms treat them. As a condition of the terms of service, legal disagreements are subject to arbitration rather than litigation, which favors the platform. And for Facebook, at least, there truly is no alternative. No other platform can reproduce the functionality, much less the scale, of Facebook. The company has monopoly power.

—

NONE OF US WANTS to admit to any addiction. We like to think of ourselves as being in control. As a lifelong technology optimist and an early adopter of new products, I was at far-greater-than-average risk of tech addiction. For example, I got an iPhone on the first day they were available and have bought into each subsequent generation on day one. I am a compulsive checker of my phone, despite having turned off notifications and gotten rid of several apps. I did not understand my behavioral addiction until I joined forces with Tristan in April 2017. Until then, I thought I bore sole responsibility for the problem. I assumed that only people with my heat-seeking love for technology could fall victim to unhelpful tech behaviors. Tristan opened my eyes to the reality that technology companies had devoted some of their best minds to exploiting the weaknesses in human psychology. They did so on purpose. To make money. And when they had made themselves ridiculously wealthy, they kept doing it because it never occurred to them to do anything else. When called to account for this, tech companies blame pressure from shareholders. Given that the founders of both Facebook and Google have total control of their companies, that excuse falls short.

Few of us can resist the lure of persuasive technology. All we can do is minimize the stimulus, or avoid it altogether by not using devices. Each element of persuasive technology is a way to fool the user. Tristan knew many of the concepts from magic, but it was in Fogg’s class that he came to appreciate that when ported to a computer or smartphone, those concepts gave software the power to monopolize attention. He began to understand that “engagement” was just a play for users’ attention . . . and time. Pushed hard enough, these tricks can strip users of agency.

—

THE PROBLEMS WITH INTERNET platforms on smartphones extend far beyond addiction. They also pollute the public square by empowering negative voices at the expense of positive ones. From its earliest days, the internet’s culture advocated free speech and anonymity without constraint. At small scale, such freedom of speech was liberating, but the architects of the World Wide Web failed to anticipate that many users would not respect the culture and norms of the early internet. At global scale, the dynamics have changed to the detriment of civil discourse. Bullies and bad actors take advantage. The platforms have made little effort to protect users from harassment, presumably due to some combination of libertarian values and a reluctance to enforce restrictions that might reduce engagement and economic value. They have not created internal systems to limit the damage from bad actors. They have not built in circuit breakers to limit the spread of hate speech. What they do instead is ban hate speech and harassment in their terms of service, covering their legal liability, and then apologize when innocent users suffer harm. Twitter, Facebook, and Instagram all have a bully problem, each reflecting the unique architecture and culture of the platform. The interplay of platforms also favors bad actors. They can incubate pranks, conspiracy theories, and disinformation in fringe sites like 4chan, 8chan, and Reddit, which are home to some of the most extreme voices on the internet, jump to Twitter to engage the press, and then, if successful, migrate to Facebook for maximum impact. The slavish tracking of Twitter by journalists, in combination with their willingness to report on things that trend there, has made news organizations complicit in the degradation of civil discourse.

—

IN AN ESSAY in the MIT Technology Review, UNC professor Zeynep Tufekci explained why the impact of internet platforms on public discourse is so damaging and hard to fix. “The problem is that when we encounter opposing views in the age and context of social media, it’s not like reading them in a newspaper while sitting alone. It’s like hearing them from the opposing team while sitting with our fellow fans in a football stadium. Online, we’re connected with our communities, and we seek approval from our like-minded peers. We bond with our team by yelling at the fans of the other one. In sociology terms, we strengthen our feeling of ‘in-group’ belonging by increasing our distance from and tension with the ‘out-group’—us versus them. Our cognitive universe isn’t an echo chamber, but our social one is. This is why the various projects for fact-checking claims in the news, while valuable, don’t convince people. Belonging is stronger than facts.”

Facebook’s scale presents unique challenges for democracy. Zuck’s vision of connecting the world and bringing it together may be laudable in intent, but the company’s execution leaves much to be desired. Prohibiting hate speech in the terms of service provides little sanctuary for users. “Community standards” vary from country to country, most often favoring the powerful over the powerless. The company needs to learn how to identify emotional contagion and contain it before there is significant harm. It should also face an uncomfortable truth: if it wants to be viewed as a socially responsible company, it may have to abandon its current policy of openness to all voices, no matter how damaging. Being socially responsible may also require the company to compromise its growth targets.

Now that we know that Facebook has a huge influence on our democracy, what are we going to do about it? For all intents and purposes, we have allowed these people to have a profound influence on the course for our country and the world with no input from the outside.

—

THERE ARE SO MANY obvious benefits to social networks that we find it hard to accept that the platforms have poisoned political discourse in democracies around the world. The first thing to understand is that the problem is not social networking per se, but a set of choices made by entrepreneurs to monetize it. To make their advertising business model work, internet platforms like Facebook and YouTube have inverted the traditional relationship of technology to humans. Instead of technology being a tool in service to humanity, it is humans who are in service to technology.

Tristan took Fogg’s class a few months after my first meeting with Zuck. The challenge for would-be entrepreneurs at that time was Google, already a dominant company worth more than one hundred billion dollars. Google derived almost all its profit from advertising on its search engine. When users searched for products, Google helpfully served up an ad relevant to that search. Google focused maniacally on shrinking the amount of time necessary to find what the user desired, with keyword-based ads in the sidebar. In short, Google’s advertising model did not depend on maximizing attention. At least, not then. (That would change a few years later, when the company began to monetize YouTube.)

There was no way to compete with Google in search, so aspiring entrepreneurs in the first decade of the new millennium looked for opportunities outside Google’s areas of dominance. The idea of Web 2.0, where the focus shifted from pages to people, was gaining traction, and “social” emerged as a buzzword. LinkedIn launched its social network for business in 2003, the year before Zuck launched Facebook. In the early days, attracting new users dominated the strategy of both companies, pushing all other factors, including attention, temporarily to the sideline. LinkedIn and Facebook quickly emerged as winners, but neither was so dominant as to preclude new niche players.

As noted in chapter 2, the technology entrepreneurs who gave birth to social media enjoyed the benefits of perfect timing. They did not face the constraints on processing power, memory, storage and bandwidth that had defined the first fifty years of Silicon Valley. Simultaneously, there was an unprecedented surplus in venture capital funding. As we’ve seen, it had never been less costly to launch a startup, and the consumer-facing opportunities enabled by software stacks, cloud computing, and pervasive 4G wireless were larger than the industry had ever seen. Entrepreneurs could hire cheaper, less experienced engineers and mold them into organizations that pursued target metrics single-mindedly. At a time when technology could do practically anything, entrepreneurs chose to exploit weaknesses in human psychology. We’re just beginning to understand the implications of that.

Freed from traditional engineering constraints, entrepreneurs worked to eliminate friction of other kinds, starting with the retail price. Consumers are often willing to try a free product that they would never touch if they had to pay first. Every social product was free to use, though some offered users in-app purchases to generate revenue. Everyone else monetized with advertising. Other forms of friction, such as regulation and criticism, could be overcome with a combination of promises, apologies, and a refusal to permit outsiders to monitor compliance. Eliminating friction enabled the platforms to compete for attention. They competed against other products. They competed against other leisure and work activities. And as Netflix CEO Reed Hastings memorably observed, they competed against sleep.

In the early years of social media, the default internet platform—a web browser on a personal computer—was physically awkward, requiring a desk and somewhere to sit. On both desktops and notebooks, the battle for attention favored web-native applications over older media, such as news, television, books, and film. With rapid adaptation as the engineering philosophy of the moment, web-native apps exploited every opportunity to increase their share of attention. One of the most important vectors for innovation was personalization, with the goal of delivering a unique experience for every user, where traditional media offered the same content to everyone. Stuck with inflexible product designs and an inability to innovate rapidly, traditional media could not keep pace.

When the iPhone shipped in 2007, it looked like no mobile phone before it—a thin, flat rectangle with rounded corners. The iPhone featured a virtual keyboard, generally thought at that time to be an unserious approach that would not catch on in the business market, where BlackBerry ruled with physical keyboards. The iPhone’s main functions were phone, email, music, and web. Users went crazy. So compelling was the experience of using an iPhone that it altered the relationship between device and human. In the 3G era, Wi-Fi enabled smartphones to deliver compelling web media experiences every waking moment of the day. Opportunities for persuasion grew geometrically, especially when Apple opened the App Store for iPhone applications on July 10, 2008. Facebook, Twitter, and other social platforms took advantage of the App Store to accelerate their migration to mobile. Within a few years, mobile would dominate the social media industry.

Competing for attention does not sound like a bad thing. Media companies have done it since the launch of the New York Sun in 1833, at the very least. Parents have long complained about kids watching too much television, listening to music night and day, or spending too much time playing video games. Why should we be concerned now? If you create a timeline of concerns about kids and media, it might start with comic books, television, and rock ’n’ roll music in the fifties. Since then, technology has evolved from slow and artificial to real-time and hyperrealistic. Products today use every psychological trick to gain and hold user attention, and kids are particularly vulnerable. Not surprisingly, medical diagnoses related to kids’ use of technology have exploded. Internet platforms, video games, and texting present different kinds of problems, but all three are much more immersive than analogous products twenty years ago. People of all ages spend a huge portion of their waking hours on technology platforms. In his book Glow Kids, Nicholas Kardaras cited a 2010 study by the Kaiser Family Foundation that said children between the ages of eight and eighteen spend nine and a half hours a day on screens and phones. Seven and a half of those hours are spent on television, computers, and game consoles, with an additional ninety minutes for texting and thirty minutes otherwise on the phone.

Overconsumption of media is not a new problem, but social apps on smartphones have taken the consequences to new levels. The convenience and compelling experience of smartphones enabled app developers—certainly those trained by B. J. Fogg—to create products that mimic the addiction-causing attributes of slot machines and video games. Apps created by Fogg’s students were particularly adept at monopolizing user attention. Nearly all of Fogg’s students embraced that mission. Tristan Harris did not.

Tristan left Stanford’s master’s program in computer science to launch a startup called Apture after he completed the term in Fogg’s class. His idea for Apture was to enhance text-based news with relevant multimedia, specifically video that explained concepts in the news story to which it was tied. My friend Steve Vassallo, a venture capitalist who had mentored Tristan in a program at Stanford, asked me to take a meeting with Apture’s founders in the spring of 2007. After introducing Tristan to the team at Forbes, I lost touch. During that time, Apture found customers but never took off. Google acquired the company in late 2011. The deal was what Silicon Valley calls an “acqui-hire,” where the acquiring company pays enough to cover the debts and possibly a return of capital to investors in exchange for a complete team of engineers. All the Apture team got out of the deal were jobs at Google, but the acquisition set Tristan on a new course, one that would bring us back together in 2017.

Shortly after arriving at Google, Tristan had an epiphany: a battle for user attention would not be good for users. Tristan created a slide deck to share his concerns, and the deck went viral inside Google. The company made no commitment to implementing the ideas, but it rewarded Tristan with an opportunity to design his own job. He picked New York City and created a new position: design ethicist. From that moment, Tristan became an evangelist for humane design principles. In Tristan’s mind, the design of technology products should prioritize the users’ well-being. For any given product, there are design choices that can either be humane or not. Monochrome smartphone displays are more humane than brightly colored displays, as they trigger less dopamine. A humane design would reduce the number of notifications and package them in ways that are respectful of human attention. There is a lot that could be done to improve today’s smartphones and internet platforms with humane design principles, and some vendors have begun to take steps. Humane design focuses on reducing the addictive power of technology, which is really important but is not a complete answer, even for Tristan. It is part of a larger philosophical approach, human-driven technology, which advocates returning technology to the role of being a tool to serve user needs rather than one that exploits users and makes them less capable. With its focus on user interface issues, humane design is a subset of human-driven technology, which also incorporates things like privacy, data security, and applications functionality. We used to take human-driven technology for granted. It was the philosophical foundation for Steve Jobs’s description of computers as a “bicycle for the mind,” a tool that creates value through exercise as well as fun. Jobs thought computers should make humans more capable, not displace or exploit them. Every successful tech product used to fit the Jobs model, and many still do. Personal computers still empower the workers who use them. There should be a version of social media that is human-driven. Facebook and Google seem to have discarded the bicycle for the mind metaphor. They advocate AI as a replacement for human activity, as described in a recent television ad for Google Home: “Make Google do it.”

At Google, Tristan saw that users effectively served artificial intelligence, rather than the other way around. Tristan decided to change that and found a handful of supporters within Google and more on the outside. At Google, Tristan’s principal ally was an engineer named Joe Edelman. From their collaboration grew a website and movement called Time Well Spent, which they launched in 2013. Time Well Spent offered advice on managing time in a world filled with distractions, while also advocating for human-centered design. It grew steadily to sixty thousand members, many of whom were technology-industry people troubled by attention-sucking platforms. Time Well Spent attracted true believers, but it struggled to effect change.

In 2016, a creative and well-connected Irishman named Paddy Cosgrave invited Tristan to speak at his Web Summit conference in Lisbon. Paddy had built a personal brand and business by bringing young tech entrepreneurs, investors, and wannabes together at a string of increasingly high-profile conferences that emphasized personal networking. Tristan gave a well-received presentation about how internet platforms on smartphones hacked the brains of their users. He described the public health consequences of brain hacking as a loss of personal agency, a loss of humanity. Among the attendees was a producer from 60 Minutes named Andy Bast, in Lisbon to scout for new stories. Bast liked what he heard and offered Tristan an opportunity to appear on the show.

Tristan’s 60 Minutes segment aired on April 9, 2017. Three days later, we joined forces. While Tristan was well-connected within his peer group in tech, he had few relationships outside the industry. I had once had a large network inside and outside tech, but I had cut back professionally and lost touch with much of it. When we thought about possible influencers for a national conversation, we realized we knew only a few people we could contact, all in technology and media. We had no relationships in government.

The first potential opportunity was only a couple of weeks away, at the annual TED Conference in Vancouver, British Columbia, ground zero for TED Talks. It would be the perfect platform for sharing Tristan’s message to leaders from the technology and entertainment industries, but we did not know if the organizers were even aware of Tristan’s ideas. They certainly had not offered an invitation to speak. Then a miracle occurred. Eli Pariser, whose legendary presentation on filter bubbles had mesmerized the TED audience in 2011, independently suggested to TED curator Chris Anderson that he add Tristan to the program. And so it happened at the last minute.

Presenters at the TED Conference usually spend six months preparing for their eighteen minutes onstage. Tristan had barely more than a week. Using no slides, he rose to the occasion and delivered a powerful talk. We were hopeful that the TED audience would embrace the ideas and offer to help. What we got instead was polite interest but little in the way of follow-up.

We should not have been surprised. Facebook, Google, Twitter, LinkedIn, Instagram, Snapchat, WhatsApp, and the other social players have created more than one trillion dollars in wealth for their executives, employees, and investors, many of whom attend TED. To paraphrase Upton Sinclair, it is difficult to get a person to embrace an idea when his or her net worth depends on not embracing it.

We took two insights away from TED: we needed to look outside tech for allies, and we needed to consider other formulations of our message besides brain hacking. If we were to have any hope of engaging a large audience, we needed to frame our argument in ways that would resonate with people outside Silicon Valley.

5

Mr. Harris and Mr. McNamee Go to Washington

Every aspect of human technology has a dark side, including the bow and arrow. —MARGARET ATWOOD

A few weeks after TED, a friend passed me the contact information for an aide to Senator Mark Warner, co-chair of the Senate Intelligence Committee. I called the aide, explained what we were doing, and asked a question: “Who is going to prevent the use of social media to interfere in the 2018 and 2020 elections?” Senate Intelligence knew about the role that social media had played in the Russian interference, but the committee had oversight responsibility for intelligence matters, not social media. Their focus was on the hacks of the DNC and DCCC, as well as the meeting in Trump Tower of senior members of the Trump campaign with Russian agents. They would not normally investigate things that happened inside the servers of Facebook. But the aide recognized that Senate Intelligence might be the only committee with the ability to investigate the threat from social media and agreed to arrange a meeting with the senator. It took a couple of months, but in July 2017, we went to Washington. Then things got more interesting.

There is a popular misconception that regulation does not work with technology. The argument consists of a set of flawed premises: (1) regulation cannot keep pace with rapidly evolving technology, (2) government intervention always harms innovation, (3) regulators can never understand tech well enough to provide oversight, and (4) the market will always allocate resources best. The source of the misconception is a very effective lobbying campaign, led by Google, with an assist from Facebook. Prior to 2008, the tech industry maintained an especially low profile in Washington. All of that changed when Google, led by chairman Eric Schmidt, played a major role in Barack Obama’s first presidential campaign, as did Facebook cofounder Chris Hughes. Obama’s win led to a revolving door between Silicon Valley and the executive branch, with Google dominating the flow in both directions. The Obama administration embraced technology, and with it the optimism so deeply ingrained in Silicon Valley. Over the course of eight years, the relationship between Silicon Valley and the federal government settled into a comfortable equilibrium. Tech companies supported politicians with campaign contributions and technology in exchange for being left alone. The enormous popularity of tech companies with voters made the hands-off policy a no-brainer for members of Congress. A few commentators expressed concern about the cozy relationship between tech and Washington, some out of concern about tech’s outsized influence and market power and others out of fear that the internet platforms might not be the neutral parties to democracy they claimed to be.

Once you get past the buzzwords, tech is not particularly complicated in comparison to other industries that Congress regulates. Health care and banking are complex industries that Congress has been able to regulate effectively, despite the fact that relatively few policy makers have had as much involvement with them as they have with technology, which touches everyone, including members of Congress, on a daily basis. The decision about whether or not to impose new regulations on tech should depend on a judgment by the policy makers that the market has failed to maintain a balance among the interests of industry, customers, suppliers, competitors, and the country as a whole. Critics who charge that regulation is too blunt an instrument for an industry like tech are not wrong, but they miss the point. The goal of regulation is to change incentives. Industries that ignore political pressure for reform, as the internet platforms have, should expect ever more onerous regulatory initiatives until they cooperate. The best way for tech to avoid heavy regulation is for the industry leaders to embrace light regulation and make appropriate changes to their business practices.

In July 2017, when Tristan and I arrived in Washington, DC, the town remained comfortably in the embrace of the major tech platforms. Google and Facebook led a large tech industry presence on Capitol Hill. Facebook director Peter Thiel continued to advise President Trump, leading high-profile meetings in the White House with technology executives. We had been able to secure four meetings: with a commissioner of the Federal Trade Commission (FTC), with executives from a leading think tank focused on antimonopoly policy, and with two senators.

The FTC has two important mandates: consumer protection and prevention of anticompetitive business practices. Created in 1914, the FTC plays an essential role in balancing the interests of businesses, their customers, and the public, but deregulation has taken much of the bite out of the FTC over the past three decades. Our visit with Commissioner Terrell McSweeny came at a time when the FTC was effectively paralyzed. Only two of the five slots for commissioners were filled. No company in Silicon Valley worried about regulation from the FTC.

Commissioner McSweeny shared her perspective on how we might best approach the FTC when all the slots were filled, which finally took place in May 2018. She explained the FTC’s consumer protection mandate and suggested that violations of the terms of service were the lowest hanging fruit for regulating software businesses.

The focus of our trip, however, was our meeting with Senator Mark Warner. We started with a briefing on our work as it related to public health and antimonopoly. Then I asked a variant of the question I had asked the senator’s aide in May: Could Congress do something to prevent the use of social media to interfere in future elections? Senator Warner asked us to share our thoughts on what had happened during the 2016 election.

Tristan and I are not investigators. We didn’t have evidence. What we had were hypotheses that explained what we thought must have happened. Our first hypothesis was that Russia had done much more than break into servers at the DNC and the DCCC and post some of what they took on WikiLeaks. There were too many other Russian connections swirling around the election for the hacks to be the whole story. For example, in 2014, a man named Louis Marinelli launched an effort to have California secede from the United States. He initially called the effort Sovereign California, built a presence on Facebook and Twitter to promote his cause, and then released a 165-page report with that name in 2015. The secession idea attracted support from some powerful Californians, including at least one very prominent venture capitalist. However, the secession movement did not begin with Californians. Marinelli, who was born in Buffalo, New York, had deep ties to Russia and lived there part-time while launching Sovereign California. At least some of his funding appears to have come from Russia, and Russian bots supported the effort on social media. In speaking with Senator Warner, we noted that there was also a Texas secession movement, and we hypothesized that it might have had Russian connections as well. These sites were committed to polarizing Americans over social media. What else had the Russians done?

What if Russia had run an entire campaign of discord and disinformation over social media? What would the goals have been of a Russian social media campaign? We hypothesized that the campaign must have started no later than 2014, when the California secession movement began. It might have started as early as 2013, when Facebook introduced Lookalike Audiences, the tool that allows advertisers to target every user on Facebook who shares a given set of characteristics. Given the way political discourse works on Facebook, Lookalike Audiences would have been particularly effective for targeting both true believers and those who could be discouraged from voting. Since Facebook provides advertising support services to all serious advertisers, we could not exclude the possibility that they may have helped the Russians execute their mischief. If the Russians did not use Lookalike Audiences, they missed a huge point of leverage.

In 2014, the Russian social media campaign probably would not have been focused on a candidate. We hypothesized that it focused instead on a handful of particularly divisive issues: immigration, guns, and perhaps conspiracy theories. We had noted an explosion of divisive content on Facebook and other social media platforms in the years before the 2016 election and hypothesized that Russia may have played a role.

How did the Russian agents figure out which Americans to target? Did they build a database of users organically, or did they acquire a database? If the latter, where did it come from? We did not know the answers, but we thought both were possible. The Russians had enough time to build audiences, particularly if they were willing to invest advertising dollars, which would have been most effective if used to build Facebook Groups. Groups have a couple of features that make them vulnerable to manipulation. Anyone can start a Group, and there is no guarantee that the organizer is the person he or she claims to be. In addition, there are few limits on the names of Groups, which enables bad actors to create Groups that appear to be more legitimate than they really are. I hypothesized to Senator Warner that some of the pro–Bernie Sanders Groups I encountered in early 2016 may have been part of the Russian campaign.

We hypothesized that the Russians might have seeded Facebook Groups across a range of divisive issues, possibly including Groups on opposite sides of the issue to maximize impact. The way the Groups might have worked is that a troll account—a Russian impersonating an American—might have formed the Group and seeded it with a number of bots. Then they could advertise on Facebook to recruit members. The members would mostly be Americans who had no idea they were joining a Group created by Russians. They would be attracted to an idea—whether it was guns or immigration or whatever—and once in the Group, they would be exposed to a steady flow of posts designed to provoke outrage or fear. For those who engaged frequently with the Group, the effect would be to make beliefs more rigid and more extreme. The Group would create a filter bubble, where the troll, the bots, and the other members would coalesce around an idea floated by the troll.

We also shared a hypothesis that the lack of data dumps from the DCCC hack meant the data might have been used in congressional campaigns instead. The WikiLeaks email dumps had all come from the DNC hack. The DCCC, by contrast, would have had data that might be used for social media targeting, but more significantly, Democratic Party data from every congressional district. The data would have been the equivalent of inside information about Democratic voters. Hypothetically, the DCCC data might have allowed the Russians—or potentially someone in the Republican Party—to see which Democrats in a district could be persuaded to stay home instead of voting. We learned later that during the final months of the 2016 campaign, the Russians had concentrated their spending in the states and congressional districts that actually tipped the election.

It seemed likely to us that the Russian interference would have been most effective during the Republican primary. The Russians had been inflaming Groups and spreading disinformation about polarizing topics for more than a year when the candidates began running for president. All but one of the seventeen candidates ran on a relatively mainstream Republican platform. The seventeenth candidate, Donald Trump, uniquely benefited from the Russian interference because he alone campaigned on their themes: immigration, white nationalism, and populism. Whether by design or by accident, Trump’s nomination almost certainly owed something to the Russian interference.

In the general election campaign against Hillary Clinton, Trump benefited significantly from the Russian interference on Facebook. We hypothesized that the Russians—and Trump—would have focused on activating a minority—Trump’s base—while simultaneously suppressing the vote of the majority. Facebook’s filter bubbles and Groups would have made that job relatively easy. We didn’t know how much impact the Russians would have had. However, roughly four million Obama voters did not vote in 2016, nearly fifty-two times the vote gap in the states Clinton needed to win but didn’t.

I concluded with an observation: the Russians might have used Facebook and other internet platforms to undermine democracy and influence a presidential election for roughly one hundred million dollars, or less than the price of a single F-35 fighter. It was just an educated guess on my part, based on an estimate of what eighty to one hundred hackers might cost for three or four years, along with a really large Facebook ad budget. In reality, the campaign may have cost less, but given the outcome, one hundred million dollars would have been a bargain. The Russians might have invented a new kind of warfare, one perfectly suited to a fading economic power looking to regain superpower status. Our country had built a Maginot Line—half the world’s expenditures on defense, plus hardened data centers in government and finance—and it never occurred to anyone that a bad actor could ignore that and instead use an American internet platform to manipulate the minds of American voters.

Senator Warner and his staff understood immediately. Senator Warner asked, “Do we have any friends in Silicon Valley?”

We suggested that Apple could be a powerful ally, as it had no advertising-supported businesses and had made data privacy a core feature of the Apple brand.

The senator brightened and asked, “What should we do?”

Tristan didn’t miss a beat. “Hold a hearing and make Mark Zuckerberg testify under oath. Make him justify profiting from filter bubbles, brain hacking, and election interference.”

Washington needed help dealing with the threat of interference through social networks, and Senator Warner asked that we support him by providing insight into the technology.

Two weeks later, in August 2017, the editor-in-chief of USA Today asked me to write an op-ed. It was titled “I Invested Early in Google and Facebook. Now They Terrify Me.” I had never before written an opinion piece for a newspaper. CNBC invited me to discuss the issue on Squawk Alley three times in the next two weeks, breaking the story more broadly. The op-ed and TV appearances came just as a flurry of news about Facebook seemed to confirm every hypothesis we had shared with Senator Warner.

Despite mounting evidence, Facebook continued to deny it had played a role in the Russian interference. They seemed to think that the press would quickly lose interest in the story and move on. It’s easy to see why they felt that way. Facebook knows more about user attention than anyone. They assumed the election-interference story was no different from any of a dozen scandals the company had faced before. Even Tristan and I assumed that Facebook would eventually prevail. Before that happened, we hoped that we could make enough people aware of the dark side of internet platforms on smartphones that Facebook employees might feel pressure to reform the company.

Then, on September 6, 2017, Facebook’s vice president of security, Alex Stamos, posted “An Update on Information Operations on Facebook.” Despite the innocuous headline, the post began with a bombshell: Facebook had uncovered one hundred thousand dollars of Russian spending on three thousand ads from June 2015 through May 2017. The three thousand ads were connected to 470 accounts that Facebook labeled as “inauthentic.” One hundred thousand dollars does not sound like much of an ad buy, but a month later the researcher Jonathan Albright provided context when he pointed out that posts from only six of the Russia-sponsored Groups on Facebook had been shared 340 million times. Groups are built around a shared interest. Most of those doing the sharing would have been Americans who trusted that the leaders of the Group were genuine.

There are millions of Groups on Facebook, for just about every organization, personality, politician, brand, sport, philosophy, and idea. The ones built around extreme ideas—disinformation, fake news, conspiracy theories, hate speech—become filter bubbles, reinforcing the shared value, intensifying emotional attachments to it. Thanks to Groups and filter bubbles, inflammatory posts can reach huge numbers of like-minded people on Facebook with only a little spending. The Russian interference on social media was exceptionally cost effective.

Our fears about interference in future elections were compounded by the refusal of the Trump administration and congressional Republicans to investigate. We had no contact with Special Counsel Robert Mueller’s investigation, but press reports indicated that Mueller might be fired at any time. Journalists reported that Mueller had aligned with New York State attorney general Eric Schneiderman, in whose jurisdiction money laundering and other possible crimes might have occurred. Common Sense Media founder Jim Steyer suggested that I meet with Schneiderman in New York. Jim set it up, and I met the attorney general for dinner at Gabriel’s restaurant on West Sixtieth Street in Manhattan.

When I gave him the short-form description of our work, Schneiderman asked me to work with an advisor to his office, Tim Wu, a professor at Columbia Law School. Tim is the person who coined the term “net neutrality.” He wrote a seminal book, The Attention Merchants, about the evolution of advertising from tabloid newspapers to persuasive-technology platforms like Facebook. When I met Tim a few days later, he helped me understand the role of state attorneys general in the legal system and the kind of evidence that would be necessary to make a case. Over the ensuing six months, he organized a series of meetings with staff in Schneiderman’s office, a truly impressive group of people. We did not have to explain internet platforms to them. Not only did the New York AG’s office understand the internet, they had data scientists who could perform forensics. The AG’s office had the skills and experience to handle the most complex cases. In time, we would furnish them with whistle-blowers, as well as insights. By April 2018, thirty-seven state attorneys general had begun investigations of Facebook.

6

Congress Gets Serious

Technological progress has merely provided us with more efficient means for going backwards. —ALDOUS HUXLEY

In the month following our visit to Washington, journalists validated many of the hypotheses we had shared with Senator Warner. The Russians really had interfered by focusing on divisive issues during the primary and supporting Trump in the general election, while disparaging Clinton throughout. Democrats on Capitol Hill were digging into the issue, and some influential members of Congress wanted us to be part of it. Before the end of August, we got a call from Washington asking that we return. They invited us for three days, and they scheduled every moment. Just in time for the trip, Renée DiResta joined our team. Renée is one of the world’s foremost experts on how conspiracy theories spread over the internet. In her day job, as director of research at New Knowledge, Renée helps companies protect themselves from disinformation, character assassination, and smear attacks, the kind of tactics the Russians used in 2016. New Knowledge also created Hamilton 68, the public dashboard that tracks Russian disinformation on Twitter. Sponsored by the German Marshall Fund and introduced on August 2, 2017, Hamilton 68 enables anyone to track what pro-Kremlin Twitter accounts are discussing and promoting.

Renée is also director of policy of Data for Democracy, whose mission is “to be an inclusive community of data scientists and technologists to volunteer and collaborate on projects that make a positive impact on society.” Renée’s own focus is on analysis of efforts by bad actors to subvert democracy around the world. Unlike us, Renée was a pro in the world of election security. She and her colleagues had heard whispers of Russian interference efforts in 2015 but had struggled to get the authorities to take action.

The daughter of a research scientist, Renée got her first computer at age five or six. She does not remember a time before she had one. Raised in Yonkers, New York, Renée’s other love was music. She learned to play piano as a child and played it “competitively” into her college years. Renée started coding at age nine and volunteered in a research lab at the Sloan-Kettering hospital in eighth grade. She worked on a project that looked for a correlation between music training and temporal reasoning. It was a small-scale study, but it married Renée’s two great interests. She earned a degree in computer science at SUNY Stony Brook before going into government service in a technology operations role. Renée underplays this part of her résumé, focusing instead on her time in algorithmic trading on Wall Street. In that job, she observed the tricks that market participants use to outsmart one another, some of which are similar to the tools hackers could use to interfere in an election.

Our first meeting in Washington was with Senator Warner. “I’m on your team,” he said, by way of an opening. The rest of the meeting focused on the senator’s desire to hold a hearing with the top executives of Facebook, Google, and Twitter to question them about their role in the Russian interference in the 2016 election. The committee staff was negotiating with the internet platforms, in the hope of securing participation by the CEOs. No announcement would be made until that negotiation was complete.

Later that first day, we had the first of two meetings with Representative Adam Schiff of California, the ranking member of the House Permanent Select Committee on Intelligence (HPSCI). The committee had fractured along party lines, and Schiff had the unenviable task of attempting a traditional approach to congressional oversight, despite aggressive opposition by his committee’s chair. The minority party has no power in the House of Representatives, which made the task exceptionally frustrating. Representative Schiff asked Renée and me to meet with the committee staff, which we did in a secure facility near the Capitol. The conversation turned to our hypotheses and what they implied for future elections. Renée characterized techniques the Russians may have used to spread disinformation on social media. The Russians’ job was made easier by the thriving communities of libertarians and contrarians on the internet. They almost certainly focused on sites that promoted anonymous free speech, sites like Reddit, 4chan, and 8chan. These sites are populated by a range of people, but especially those who hold views that may not be welcome in traditional media. Some of these users are disaffected, looking for outlets for their rage. Others are looking to expose what they see as the hypocrisy of society. Still others have agendas or confrontational personalities looking for an outlet. And some just want to play pranks on the world, preying on the gullibility of internet users, just to see how far they can push something outrageous or ridiculous. These and other sites would have been fertile ground for the Russian messages on immigration, guns, and white nationalism. They were also ideal incubators for disinformation.

Renée explained that the typical path for disinformation or a conspiracy theory is to be incubated on sites like Reddit, 4chan, or 8chan. There are many such stories in play at any time, a handful of which attract enough support to go viral. For the Russians, any time a piece of disinformation gained traction, they would seed one or more websites with a document that appeared to be a legitimate news story about the topic. Then they would turn to Twitter, which has replaced the Associated Press as the news feed of record for journalists. The idea was to post the story simultaneously on an army of Twitter accounts, with a link to the fake news story. The Twitter army might consist of a mix of real accounts and bots.

If no journalist picked up the story, the Twitter accounts would post new messages saying some variant of “read the story that the mainstream media doesn’t want you to know about.” Journalism is intensely competitive, with a twenty-four-hour news cycle that allows almost no time for reflection. Eventually some legitimate journalist may write about the story. Once that happens, the game really begins. The army of Twitter accounts—which includes a huge number of bots—tweets and retweets the legitimate story, amplifying the signal dramatically. Once a story is trending, other news outlets are almost certain to pick it up. At that point, it’s time to go for the mass market, which means Facebook. The Russians would have placed the story in the Facebook Groups they controlled, counting on Facebook’s filter bubbles to ensure widespread acceptance of the veracity of the story, as well as widespread sharing. Trolls and bots help, but the most successful disinformation and conspiracy theories leveraged American citizens who trusted the content they received from fellow members of Facebook Groups.

An example is Pizzagate, a disinformation story that claimed that emails found by the FBI on the laptop of Anthony Weiner, a disgraced former member of Congress and the husband of the vice chair of Hillary Clinton’s presidential campaign, suggested the presence of a pedophilia ring connected to members of the Democratic Party at pizza parlors in the Washington area. The theory went on to say that emails stolen from the Democratic National Committee included coded messages about pedophilia and human trafficking and that one pizza parlor in particular might be home to satanic rituals. The story, which appeared nine days before the 2016 election, was a complete fabrication, but many people believed it. One man bought in to such a degree that he showed up at the pizza parlor in December, armed with an AR-15, and fired three shots into the building. Fortunately, no one was hurt.

Untangling a conspiracy theory is tricky, but Pizzagate’s origins are clearer than most. The story first appeared on a white supremacist Twitter account. Wikipedia states that accounts on 4chan and Twitter parsed the stolen DNC emails in search of coded messages and claimed to have found many. A range of conspiracy sites, including Infowars, picked up the story and amplified it on the far right. The story spread in the month after the election, with Twitter playing a large role. A subsequent analysis by the researcher Jonathan Albright indicated that a disproportionate share of the tweets came from accounts in the Czech Republic, Cyprus, and Vietnam, while most of the retweets were from bot accounts. The Czech Republic, Cyprus, and Vietnam? What was that about? Were they Russian agents or just enterprising entrepreneurs? The 2016 US presidential election seems to have attracted some of each. In a world where web traffic anywhere can be monetized with advertising and where millions of people are gullible, entrepreneurs will take advantage. There had been widespread coverage of young men in Macedonia whose efforts to sell ads against fabricated news stories mostly failed with Clinton voters but worked really well with fans of Trump and, to a lesser extent, Bernie Sanders.

On its face, the Pizzagate conspiracy theory is unbelievable. A pedophilia ring associated with the Democratic Party at a pizza parlor in DC? Coded messages in emails? And yet people believed it, one so deeply that he, in his own words, “self-investigated it” and fired three bullets into the pizza parlor. How can that happen? Filter bubbles. What differentiates filter bubbles from normal group activity is intellectual isolation. Filter bubbles exist wherever people are surrounded by people who share the same beliefs and where there is a way to keep out ideas that are inconsistent with those beliefs. They prey on trust and amplify it. They can happen on television when the content is ideologically extreme. Platforms have little incentive to eliminate filter bubbles because they improve metrics that matter: time on site, engagement, sharing. They can create the illusion of consensus where none exists. This was particularly true during the Russian interference, when the use of trolls and bots would have increased the illusion of consensus for human members of affected Facebook Groups.

People in filter bubbles can be manipulated. They share at least one core value with the members of their group. Having a shared value fosters trust in the other members and, by extension, the Group. When a Group member shares a news story, the other members will generally give it the benefit of the doubt. When Group members begin to embrace that story, the pressure mounts on other members to do the same. Now imagine a Facebook Group that includes a Russian troll and enough Russian-controlled bots to represent 1 to 2 percent of the membership. In that scenario, the trust of Group members leaves them particularly vulnerable to manipulation. A story like Pizzagate might get its start with the troll and bots, who would share it. Recipients assume the story has been vetted by members of a shared political framework, so they share it, too. In this way, disinformation and conspiracy theories can gain traction quickly. The Russians used this technique to interfere in the 2016 election. They also organized events. A particularly well-known example occurred in Houston, Texas, where Russian agents organized separate events for pro- and anti-Muslim Facebook Groups at the same mosque at the same time. The goal was to trigger a confrontation.

All of this is possible because users trust what they find on social media. They trust it because it appears to originate from friends and, thanks to filter bubbles, conforms to each user’s preexisting beliefs. Each user has his or her own Truman Show, tailored to press emotional buttons, including those associated with fear and anger. While endless confirmation of their preexisting beliefs sounds appealing, it undermines democracy. The Russians exploited user trust and filter bubbles to sow discord, to reduce faith in democracy and government, and, ultimately, to favor one candidate over the other. The Russian interference succeeded beyond any reasonable expectation and continues to succeed because many key stakeholders in our government have been slow to acknowledge it, taking no meaningful steps to prevent a reoccurrence. Filter bubbles and preference bubbles undermine critical thinking. Worse still, the damage can persist even if the user abandons the platform that helped to foster them.

Listening to Renée describe the techniques employed by the Russians, I realized I was in the presence of a genuine superstar. At the time, I had only the barest outline of her life story, but the elements I knew—technology operations for the government, algorithmic trading, political campaigns, infiltration of antivax networks, harassment on Twitter, research on Russian interference in democracy—spoke to Renée’s intelligence and commitment. Adding Renée to our team was transformational. Unlike Tristan and me, Renée could go beyond hypotheses. She had been researching this stuff for several years. She lived in the world of facts. Every member of Congress and staffer we met took to her immediately. What Renée got from us was a new platform to share what she knew. She had been working at Data for Democracy, identifying threats early and asking the tech companies to take the spread of computational propaganda more seriously. As so often happens with researchers and intelligence professionals, their brilliant insights did not always reach the right people at the right time. It was obviously too late to stop interference in the 2016 election, but perhaps our little trio could help prevent a repeat in 2018. That was the goal.

Our meeting concluded with a request from the House Intelligence Committee staffers: Could we help them learn about Facebook and Twitter? The committee was planning to have a hearing on the same day as the Senate Intelligence Committee, calling the same witnesses. But the staff needed help. Due to the sensitive nature of their work, none of the staff members used social media intensely. They needed to learn the inner workings of Facebook, Instagram, YouTube, or Twitter. Could we prepare briefing materials? Could we prepare questions the members could ask the witnesses? Renée and I jumped at the opportunity. We had seven weeks to create a curriculum and teach the staff Internet Platforms 101.

The opportunity went beyond the minority staff for the House Permanent Select Committee on Intelligence. Senator Warner’s staff had asked for similar help, as did Senators Richard Blumenthal, Al Franken, Amy Klobuchar, and Cory Booker, all of whom served on the Senate Judiciary Committee, which would hold its hearing the day before the intelligence committees.

The process of creating briefing materials was iterative, with many revisions. Staffers posed questions several times a week, using our insights about how the platforms worked to understand intelligence gathered from their sources that they never shared with us. They asked for a briefing on algorithms and how they work in the context of Facebook, in particular. They understood that an algorithm is, as Wikipedia defines it, “an unambiguous specification of how to solve a class of problems,” generally related to calculation, data processing, and automated reasoning. But with advances in AI, algorithms have become more complex as they adapt, or “learn,” based on new data. In Facebook’s relentless effort to eliminate any friction that might limit growth, they automate everything, relying on ever-evolving algorithms to operate a site with 2.2 billion active users and millions of advertisers. Algorithms find patterns shared by different users, based on their online behavior. This goes way beyond their common interests to include things like the time, location, and other context elements of web activity. If User A does a dozen things online prior to buying a new car—many of them unrelated to buying a car—the algorithm will look for other users who start down the same path and then offer them ads to buy a car. Given the complexity of Facebook, the AI requires many algorithms, the interaction of which can sometimes produce unexpected or undesirable outcomes. Even the smallest changes to one algorithm can trigger profound ripple effects through the rest of the system. A clear case where moving fast can break things in unpredictable ways.

While Facebook argues that its technology is “value neutral,” the evidence suggests the opposite. Technology tends to reflect the values of the people who create it. Jaron Lanier, the technology futurist, views the role of algorithms as correlating data from individual users and between users. In an opinion piece in The Guardian, Lanier wrote, “The correlations are effectively theories about the nature of each person, and those theories are constantly measured and rated for how predictive they are. Like all well-managed theories, they improve through adaptive feedback.” When it comes to the algorithms used by internet platforms, “improve” refers to the goals of the platform, not the user. Algorithms are used throughout the economy to automate decision making. They are authoritative, but that does not mean they are fair. When used to analyze mortgage applications, for example, algorithms that reflect the racial biases of their creators can and do harm innocent people. If the creators of algorithms are conscious of their biases and protect against them, algorithms can be fair. If, as is the case at Facebook, the creators insist that technology is by definition value neutral, then the risk of socially undesirable outcomes rises dramatically.

Given the importance of presidential elections to our democracy, the country had every right to insist that the CEOs of Facebook, Google, and Twitter testify. The CEOs of any other industry would have been there. But that did not happen with Facebook, Google, and Twitter. For reasons that underscore the partisan divide in Congress, the majority did not insist on testimony from the CEOs. They settled for the general counsel of each company. These are very well-educated, successful lawyers, but they are not engineers. They are good at talking, but their familiarity with the inner workings of their firm’s products would have been limited. If the goal was to minimize the effectiveness of the hearings from the outset, they were the perfect witnesses. They were there to talk without saying anything, to avoid blunders. Knowing this, we provided a long list of ways that Facebook, Google, and Twitter might deflect questions at the hearing, along with comebacks to get at the key information.

In Silicon Valley, it is widely assumed that the government does not function well. The perception is that the only great people working in Washington are the ones who went there from Silicon Valley. Our experience could not have been more different. The staffers with whom we worked during this period were uniformly impressive. It’s not just that they were smart, conscientious, and hard-working. Like users, policy makers had trusted Silicon Valley to regulate itself, so they had work to do to get up to speed for oversight. They knew what they did not know and were not afraid to admit it.

The night before the first hearing, Facebook disclosed that 126 million users had been exposed to Russian interference, as well as 20 million users on Instagram. Having denied any role in the Russian interference campaign for eight months, only to concede that an internal investigation had uncovered one hundred thousand dollars’ worth of Russian advertising purchases in rubles, this revelation came as a bombshell. The user number represents more than one-third of the US population, but that grossly understates its impact. The Russians did not reach a random set of 126 million people on Facebook. Their efforts were highly targeted. On the one hand, they had targeted people likely to vote for Trump with motivating messages. On the other, they identified subpopulations of likely Democratic voters who might be discouraged from voting. The fact that four million people who voted for Obama in 2012 did not vote for Clinton in 2016 may reflect to some degree the effectiveness of the Russian interference. How many of those stayed away because of Russian disinformation about Clinton’s email server, the Clinton Foundation, Pizzagate, and other issues? CNN reported that the Russians ran a number of Facebook Groups targeting people of color, including Blacktivist, which gained a substantial following in the months before the election. They ran another Group called United Muslims of America, with a similar approach to a different audience. On Twitter, the Russians ran accounts like “staywoke88,” “BlackNewsOutlet,” “Muslimericans,” and “BLMSoldier,” all designed, like Blacktivist and United Muslims of America, to create the illusion that genuine activists supported whatever positions the Russians promoted. In an election where only 137 million people voted, a campaign that targeted 126 million eligible voters almost certainly had an impact. How would Facebook spin that?

The hearings began with Senate Judiciary on Halloween. We knew that the staffers had reached out to many other people, and it was fun to hear some of our questions. The general counsels of Facebook, Google, and Twitter stuck to their scripts. Not surprisingly, Facebook’s general counsel, Colin Stretch, faced the toughest questions, nearly all of which came from Democrats. Stretch held his own until relatively late in the hearing, when Senator John Kennedy, a Republican from Louisiana, surprised the whole world—and especially some of his Republican colleagues—by posing a series of questions to Stretch about whether Facebook had the ability to look at personal data for individual users. Stretch tried to deflect the question by answering that Facebook had policies against looking at personal data. Hidden behind an “aw shucks, I’m a country lawyer” demeanor, Kennedy has a brilliant mind, and he reframed his question until Stretch was forced to answer yes or no. Did Facebook have the ability to look at a user’s personal data? Kennedy reminded Stretch he was under oath. “No,” was Stretch’s final answer. In my head, I heard the game-show sound for a wrong answer. Baaamp. To me, this was a big deal. Facebook is a computer system with oceans of data. Facebook engineers must have access to the data to do their jobs. In the company’s early years, it was not uncommon for a Facebook recruiter to access a candidate’s page during an interview. At some point, though, the company recognized that access to individual accounts had to be off-limits. They made clear to employees that inappropriate access would result in immediate termination. I do not know how effectively Facebook policed the rule—at Facebook, rules often are more about preventing liability than about changing behavior—but the statement that no one at Facebook could access individual data was incorrect. Next time Congress held hearings, the committee could point to Stretch’s testimony as evidence of the need for testimony from executives higher up the organizational chart than the general counsel. It provided grounds for congressional committees to insist that CEOs testify in a future hearing, should the political winds change. It was a small victory.

In the end, Stretch and the other general counsels managed to dodge the toughest questions posed by the Senate Judiciary Committee, eliciting a rebuke from the ranking member, Senator Dianne Feinstein. When the Senate Intelligence hearing began the next morning, the dance continued. I could not help but be impressed by the way the general counsels sidestepped tough questioning with answers that sounded reasonable but were actually content-free.

The final hearing, House Intelligence, was surreal. The Republican members, under the leadership of committee chair Devin Nunes, were holding one kind of hearing, while the Democrats, led by ranking member Adam Schiff, held another. Our interest was in the Schiff-led hearing. You would not think there would be anything left for House Intelligence, following the two Senate hearings, but there was. House Intelligence showed examples of Facebook ads run by Russian-backed groups, which were printed in a large format for display during the hearing. The images of those ads remain indelible in my mind, the defining visual from the hearings.

Televised congressional hearings are typically long on theater and short on substance. That is especially true in an environment as polarized as Capitol Hill in 2017. From our perspective, the normal rules did not apply to these hearings. By making millions of Americans aware that internet platforms had been exploited by the Russians to interfere in our presidential election, these hearings had done something important. They were a first step toward congressional oversight of the internet platforms, and we had played a small role. A few hours after the House Intelligence hearing, I received an email that made me laugh. Sent by the lead investigator for Democrats on House Intelligence, it read, “In a workplace appropriate manner, I love you.”

Other than Stretch’s misstatement to Senator Kennedy, the general counsels succeeded in their mission. They did not add fuel to the fire, but the revelations about Facebook had a long hangover. There was an explosion of press interest in the three companies’ role in the Russian interference. By televising the hearings, the congressional committees ensured at least one news cycle of coverage. In combination with Facebook’s revelation about the 126 million users exposed to Russian interference, the hearings accomplished more than that. The possibility that Facebook, Google, and Twitter had played a role in undermining democracy became a topic of conversation. I noticed a big uptick in interest from mainstream media outlets. On the afternoon of November 1, while the House Intelligence hearing was unfolding, I made my first appearance on MSNBC, talking to Ali Velshi about these issues. It would be the first of many. People were beginning to talk about the role of Facebook in the election interference of 2016. The next day, Tristan and I were chatting on the phone, and he observed that we’d come a long way since April. In less than seven months, we had realized our goal of helping to trigger a serious conversation about the dark side of social media. It was a start, but nothing more. The platforms were still deflecting responsibility and that would not change without dramatically more public awareness and pressure.

7

The Facebook Way

The problem isn’t any particular technology, but the use of technology to manipulate people, to concentrate power in a way that is so nuts and creepy that it becomes a threat to civilization. —JARON LANIER

Thanks to the hearings, the press took a greater interest in the role of internet platforms in the Russian interference. Every story added to public awareness and gradually increased the pressure on policy makers to do something. We met with many politicians, which helped us appreciate one of the rules of politics: if you want to bring about change and don’t have a huge lobbying budget, there is no substitute for pressure from voters. I exercised my Citizens United rights, paid five hundred dollars, and attended a breakfast for Senator John Kennedy of Louisiana the week after the hearings. It was a breakfast with the senator, two staffers, nineteen lobbyists, and me. Before the event started, the senator walked around the room, greeting each person. The lobbyists were from companies like Procter & Gamble, Alcoa, and Amazon. All they wanted to talk about was the upcoming tax-cut bill. When the senator got to me, I said, “I’m here in my capacity as a citizen to thank you for the amazing job you did at the Senate Judiciary hearing last week.” Senator Kennedy did a double take. I no longer remember his exact words, but in a trademark drawl he told me, “Son, I appreciate that. I’m glad you’re here. I want to meet with you again.” That is twenty-first-century democracy in action.

During the second week of November, I participated in a conference in Washington on antitrust regulation, sponsored by the Open Markets Institute think tank. The keynote speaker was Senator Al Franken, who made a full-throated argument for traditional approaches to regulating monopolies. Columbia Law’s Tim Wu and Open Markets’ Lina Khan talked about antitrust in the context of internet platforms. They argued that Amazon, Google, and Facebook all have monopoly power that would not have been permissible for most of the twentieth century, and they use it to block competitors and disadvantage users. My own remarks framed Tristan’s hypotheses about public health as an argument for antitrust regulation of internet giants. The internet still enjoyed exemptions from regulation that were artifacts of the industry’s early days. Over the course of twenty-one years, regulatory safe harbors had enabled the market leaders not only to prosper but also to do things no other industry could get away with, including noncooperation with regulators like the Federal Trade Commission, a careless disregard for consumer data privacy, and an exemption from Federal Communications Commission rules for election-related advertising.

Until 1981, the United States operated with a philosophy that monopoly was bad for consumers and for the economy. Monopolies can charge higher prices to consumers than competitive markets, while also slowing the rate of innovation and new company formation. The rise of Standard Oil and other trusts around the turn of the twentieth century created the impetus for the Sherman Antitrust Act, the Clayton Act, and the Federal Trade Commission Act, which ushered in a long period when both political parties supported efforts to prevent anticompetitive concentration of economic power. A counter philosophy surfaced after the Second World War, which postulated that markets were always best at allocating resources. The “Chicago School” antitrust philosophy emerged as part of this market-driven, neoliberal worldview, arguing that concentration of economic power was not a problem, so long as it did not translate into higher prices for consumers. The Chicago School became official policy with the Reagan administration and has prevailed ever since. Perhaps it is a coincidence, but, as I’ve mentioned, the years since 1981 have seen a massive decline in new company formation (which peaked in 1977), as well as income inequality not seen since the era of Standard Oil.

Three internet platforms—Amazon, Google, and Facebook—have benefited enormously from the Chicago School’s antitrust philosophy. The products of Google and Facebook are free to consumers, and Amazon has transformed the economics of distribution while keeping consumer prices low, which has allowed all three to argue successfully for freedom to dominate, as well as to consolidate. The case against Amazon is probably strongest, and it provides a framework for understanding the larger issues.

For Amazon.com, freedom from antitrust scrutiny has allowed the company to integrate vertically, as well as horizontally. From its original base in retail for nonperishable goods, Amazon has expanded horizontally into perishables, with Whole Foods, and into cloud services, with Amazon Web Services. Amazon’s vertical integration has included Marketplace, which incorporates third-party sellers; Basics, where Amazon private-labels bestselling commodity products; and hardware, such as Alexa voice-controlled devices and the Fire home video server. In a traditional antitrust regime, Amazon’s vertical-integration strategy would not be allowed. The use of proprietary consumer data to identify, develop, and sell products in direct competition with bestsellers on the site represents an abuse of power that would have appalled regulators prior to 1981. Amazon’s ever-expanding distribution business might have run afoul of the same concerns. The horizontal integration into perishables like food would have been problematic due to cross subsidies. Amazon can use its cloud services business to monitor the growth of potential competitors, though there is little evidence that Amazon has acted on this intelligence the way it has leveraged data about bestselling products in its marketplace.

Google’s business strategy is a perfect example of how the Chicago School differs from the traditional approach to antitrust. The company began with index search, arguably the most important user activity on the internet. Google had a brilliant insight that it could privatize a large subset of the open internet by offering convenient, easy-to-use, free alternatives to what the web’s open source community had created. Google leveraged its dominant market position in search to build giant businesses in email, photos, maps, videos, productivity applications, and a variety of other apps. In most cases, Google was able to transfer the benefits of monopoly power from an existing business to a nascent one. The European Union, which still employs a traditional view of economic power, won a $2.7 billion judgment against Google in 2017 for leveraging its search and AdWords data to wipe out European competitors for its brand-new price-comparison application. The EU case was well argued and had the benefit of obvious harm, in that most of Google’s competition had disappeared in short order. Shareholders shrugged off the judgment, which Google has appealed. (In August 2018, the EU fined Google $5 billion for a different antitrust violation, this time related to the Android operating system.)

The Chicago School antitrust model benefited Google and Facebook in another way: it enabled them to create markets in which they could also be a participant. Traditional antitrust rules offered companies a choice: they could create a market or be a participant but not both. The theory was that if the owner of a marketplace also participated in the market, the other competitors would be at a prohibitive disadvantage. Google’s purchase of DoubleClick enabled precisely this situation in the online advertising business, enabling Google to favor its own properties at the expense of third parties. Google did something similar when it acquired YouTube, changing the algorithm in ways that, among other things, gave its own content preferred distribution.

Google and Facebook operate a form of what economists call “two-sided markets,” which Wikipedia defines as “economic platforms having two distinct user groups that provide each other with network benefits.” The original two-sided markets included things like credit cards where the issuer sits between vendor and customer in a single transaction. For platforms, the two sides are not part of the same transaction. Users are the source of data, as well as the product, but they do not participate in a transaction or in the economics. The advertisers are the customer and provide the market’s revenue. What makes the platforms comparable to traditional two-sided markets is that both sides depend on the success (or scale) of the market. At the scale of Facebook and Google, the two-sided market confers advantages that cannot be overcome by competitors, providing monopoly power.

Thanks to its search engine, cloud services, and venture capital operation, Google has an exceptionally good view of emerging products. Google has never been shy about using its market power to limit the upside of new companies, acquiring the best and snuffing out the rest. American regulators do not see any problem with this behavior. The European regulators have been trying to rein in Google on their own.

Facebook has enjoyed similar advantages to Google from the Chicago School antitrust model. Facebook imitated Google’s privatization of the open web, complementing its social network with a photos app (Instagram), text messaging (WhatsApp and Messenger), and virtual reality (Oculus). Having cornered the audience for content, Facebook has undercut the economics of journalism by seducing publishers to work with it on new products, like Instant Articles, and then changing the terms to the disadvantage of publishers. In 2013, Facebook acquired Onavo, an Israeli company that makes a virtual private network (VPN) application. VPNs are a tool for protecting privacy on public networks, but Facebook has given Onavo a twist straight out of Orwell. Onavo enables Facebook to track everything the user does when using the VPN. Onavo also enables Facebook to surveil other applications. Neither of these activities would be considered appropriate for a VPN under normal circumstances. It is roughly analogous to a security service that protects your home from other thieves but steals your valuables while they are doing it. The whole point of a VPN is to prevent snooping. Enough users use Onavo to give Facebook huge amounts of data about users and competitors. In August 2018, Apple announced that Onavo violated its privacy standards, so Facebook withdrew it from the App Store.

One of the competitors Facebook has reportedly tracked with Onavo is Snapchat. There is bad blood between the two companies that began after Snapchat rejected an acquisition offer from Facebook in 2013. Facebook started copying Snapchat’s key features in Instagram, undermining Snapchat’s competitive position. While Snapchat managed to go public and continues to operate as an independent company, the pressure from Facebook continues unchecked and has taken a toll. Under a traditional antitrust regime, Snapchat would almost certainly have a case against Facebook for anticompetitive behavior.

Freedom from antitrust scrutiny has enabled the internet giants to dominate their markets to a degree unseen since the heyday of IBM’s dominance in mainframe computers. In reality, today’s internet platforms are far more influential than IBM in its prime. With 2.2 billion monthly users on its core platform, Facebook directly influences nearly one-third of the world’s population. Other Facebook platforms also have huge monthly user bases: 1.5 billion use WhatsApp, 1.3 billion use Messenger, and 1 billion use Instagram. While there is overlap, particularly between Messenger and Facebook, both WhatsApp and Instagram have large numbers of users who are not on Facebook. It’s not crazy to imagine that Facebook as a whole may have more than three billion users, or 40 percent of the world’s population. On its best day, IBM’s monopoly was limited to governments and the largest corporations. Thanks to brain hacking and the filter bubbles that result from it, Facebook’s influence over consumers may be greater than any single business before it.

Persuading 40 percent of the world’s population to use your products is an extraordinary accomplishment. In many circumstances, it would be entirely laudable. For example, Coca-Cola serves 1.9 billion beverages per day across two hundred countries. But Coca-Cola does not influence elections or enable hate speech that leads to violence. As a giant communications network, Facebook has far more influence than Coca-Cola, and unlike Coca-Cola, Facebook has monopoly power. With such influence and monopoly power should come great responsibility. Facebook owes a duty to its users—and the whole world—to optimize itself for the public good, not just for profits. If Facebook cannot do that—and the evidence at this point is not promising—then government intervention to reduce its market power and introduce competition will be required.

Zuck’s and Sheryl’s failure to take action to address obvious flaws in the product and to protect their brand is at least suggestive of their monopoly power. They may not have been concerned about brand damage because they knew that users had no alternative.

There is a second possible explanation for why Facebook might have ignored early warnings and later criticism. From his time at Harvard, Mark Zuckerberg showed a persistent indifference to authority, rules, and the users of his products. He hacked servers at Harvard, took university property to create his first products, exploited the trust of the Winklevoss brothers, and then shared his view of users in an instant messaging exchange with a college friend just after the launch of TheFacebook. As quoted in Business Insider:

Zuck: Yeah so if you ever need info about anyone at Harvard

Zuck: Just ask.

Zuck: I have over 4,000 emails, pictures, addresses, SNS

[Redacted Friend’s Name]: What? How’d you manage that one?

Zuck: People just submitted it.

Zuck: I don’t know why.

Zuck: They “trust me”

Zuck: Dumb fucks.

As far as I can tell, Zuck has always believed that users value privacy more than they should. As a result, he has generally chosen to force them to be more open and then dealt with the fallout when it came. For the most part, the bet against privacy paid off for Facebook. Negative user feedback forced Facebook to withdraw Beacon, but the company’s relentless efforts overwhelmed resistance far more often than not. Users either did not know or did not care about the loss of privacy, enabling Facebook to join the list of most valuable companies on earth.

Facebook’s motto, “Move fast and break things,” reflects the company’s strengths and weaknesses. Facebook constantly experiments, tinkers, and pushes envelopes in the pursuit of growth. Many experiments fail or work imperfectly, necessitating an apology and another experiment aimed at doing better. In my experience, there have been few, if any, companies that have executed a growth plan—moving fast, if you will—as effectively as Facebook. When moving fast leads to breaking things, and to mistakes, Facebook has been brilliant in its ability to recover from them. Seldom has Facebook allowed a mistake or problem to slow it down. Most of the time, promises to do better have been enough to get past a problem.

To be clear, I believe that taking risks is a positive thing in business when accompanied by good judgment. Where Facebook failed was in not recognizing that tactics need to change as a company’s influence grows. Experiments that are acceptable at small scale can be problematic at a larger one. When a company reaches global scale, as Facebook has done, it needs to approach experimentation with extreme care. It must prioritize users and the public interest. It must anticipate and prepare for side effects.

One of the things that distinguished Zuck from the beginning was his vision that Facebook could connect the entire world. When I knew him, Zuck had his eyes set on reaching one billion users. At this writing, the company has 2.2 billion monthly users. Revenues in 2017 exceeded forty billion dollars. To reach those numbers in fourteen years from a standing start required more than brilliant execution. There were costs, borne by others. Facebook eliminated all forms of friction that might have slowed it down, an activity that Zuck and his team have transformed into a fine art. Regulation and criticism? Facebook makes them disappear with the magic words “We apologize. We’ll do better!” Too often, those words have not been matched to action, as that kind of action would have slowed down the company. And there is almost no way for regulators or critics to verify Facebook’s compliance. Until recently, the company resisted all attempts at transparency with respect to its algorithms, platforms, and business model. The company’s recent requirement for the labeling of political ads is a step in the direction of transparency, but it arguably impacts third parties more than Facebook. Without transparency, compliance cannot be verified.

Even at huge scale, Facebook’s business is relatively straightforward. In comparison to a similarly sized business, such as the Walt Disney Company, Facebook is operationally far less complex. The core platform consists of a product and a monetization scheme. The acquired products—Instagram, WhatsApp, and Oculus—operate with a fair amount of autonomy, but their business models add little complexity. The relative simplicity of the business enables Facebook to centralize its decision making. There is a core team of roughly ten people who manage the company, but two people—Zuck and Sheryl Sandberg—are the final arbiters of everything. They have surrounded themselves with a team of brilliant operators who executed the strategy of maximum growth almost flawlessly through the end of 2017.

Thanks to Facebook’s extraordinary success, Zuck’s brand combines elements of rock star and cult leader. He is deeply committed to products and not much interested in the rest of the business, which he leaves to Sheryl. According to multiple reports, Zuck is known for micromanaging products and for being decisive. He is the undisputed boss. Zuck’s subordinates study him and have evolved techniques for influencing him. Sheryl Sandberg is brilliant, ambitious, and supremely well organized. When Sheryl speaks, she chooses her words very carefully. In an interview, for example, she has mastered the ability to appear completely genuine and heartfelt, while being totally nonresponsive. When Sheryl talks, friction disappears. She manages every detail of her life, paying particular attention to her image. Until mid-2018, Sheryl had a consigliere, Elliot Schrage, whose title was vice president of global communications, marketing, and public policy, but whose real job appeared to be protecting Sheryl’s flank, something he had done since her time at Google.

If you wanted to draw a Facebook organizational chart to scale, it would look like a large loaf of bread with a giant antenna pointing straight up. Zuck and Sheryl are at the top of the antenna, supported by Schrage until he departed, the company’s chief financial officer David Wehner, product boss Chris Cox, and a handful of others. Everyone else is down in the loaf of bread. It is the most centralized decision-making structure I have ever encountered in a large company, and it is possible only because the business itself is not complicated. Early in Sheryl’s tenure at Facebook, something happened that revealed her management philosophy to me. The context was a failure of judgment that in most companies would have resulted in the termination of the person who made the decision and changes in policy. I called Sheryl to ask her how she planned to handle it, and she said, “We are a team at Facebook. When we succeed, we do so as a team. When we fail, it is a team failure.” When I pushed back, Sheryl did the same. “Are you saying you want me to fire the entire team?” In retrospect, that might have been for the best.

The management philosophy that Sheryl described has huge benefits when everything is going well because it keeps everyone focused on their metrics rather than on self-promotion. In Facebook’s case, everything went perfectly from shortly after the IPO in 2012 until the end of 2017. Imagine a finely tuned race car zooming down a straightaway with no pebbles on the road. That was Facebook. Inevitably, something will go wrong. That is the real test. In theory, the team philosophy might create a safe space for disagreement and self-examination, but that is not what happened at Facebook. When there is no individual credit for members of the team, much of the credit for every success goes to the people at the top. Given Zuck’s status as the founder, the team at Facebook rarely, if ever, challenged him on the way up and did not do so when bad times arrived. This reveals the downside of Sheryl’s management philosophy: no credit/no blame can eliminate accountability for mistakes. When faced with a setback, the team may circle the wagons and deflect criticism rather than do any soul-searching. That appears to be what happened to Facebook when confronted with evidence that its platform had been exploited by the Russians.

Facebook has made many mistakes in its history, but the Russian interference was the first that could not be easily dismissed. It created friction unlike anything Facebook had encountered in its first thirteen years. The company had no experience—no muscles—for dealing with that kind of friction. They rolled out their standard response—deny, delay, deflect, dissemble—expecting the friction to go away. It always had in the past. But this time, the friction remained. Perhaps it might evaporate at some point, but not so quickly as in the past. With no one to push back on Zuck and Sheryl, Facebook stuck with its playbook, doing the same thing over and over, expecting a different result. Unused to negative feedback, Zuck and Sheryl retreated into a bunker. They reappeared only when there was no alternative.

Tristan, Renée, and I watched in wonder as Facebook executed its strategy of deny, delay, deflect, dissemble. How could Zuck and Sheryl not see where this was heading? We were a tiny team with few resources, but we were not alone any longer. Election interference was an issue whose time had come. A lot of smart people were looking at the problem from different angles. We just happened to be in the right place when the story hit, with growing demand for our perspective from policy makers and journalists. Fortunately, two recruits joined us in November, giving us new skills and new energy. Lynn Fox, who had been a senior communications executive at Apple, Palm, and Google, brought expertise in media that would soon transform our effort. At mid-month, The New York Times wrote a profile about Renée. A week later, a former Facebook privacy manager named Sandy Parakilas wrote an op-ed in the Times entitled, “We Can’t Trust Facebook to Regulate Itself.” Chris Kelly, the original chief privacy officer at Facebook who had introduced me to Zuck in 2006, knew Sandy and made that introduction. Sandy was aware of what Tristan, Renée, and I were doing and asked if he could join forces with us. Sandy would prove to be an exceptionally fortuitous addition to our team. When we met, Sandy was a former Facebook employee; four months later, events would transform him into a whistle-blower.

On December 11, 2017, The Verge reported that Chamath Palihapitiya, Facebook’s former vice president of growth, had given a speech at Stanford the month before in which he had expressed regrets about the negative consequences of Facebook’s success. “I think we have created tools that are ripping apart the social fabric of how society works,” he told the students at the Graduate School of Business. Palihapitiya’s remarks echoed those of Sean Parker, the first president of Facebook, who in November had expressed regret about the “social-validation feedback loop” inside the social network, which gives users “a little dopamine hit every once in a while, because someone liked or commented on a photo or a post or whatever.” Facebook had ignored Parker, but apparently they jumped on Palihapitiya. Within seventy-two hours of The Verge’s initial report, Palihapitiya publicly reversed course. “My comments were meant to start an important conversation, not to criticize one company—particularly one I love. I think it’s time for society to discuss how we use the tools offered by social media, what we should expect of them and, most importantly, how we empower younger generations to use them responsibly. I’m confident that Facebook and the broader social media category will succeed as they navigate this uncharted territory.” He subsequently appeared on Christiane Amanpour’s show on CNN International and made it clear he thought Mark Zuckerberg was the smartest person he had ever met and suggested that Zuck was uniquely qualified to figure it out and save us all.

I don’t really know Chamath. I have had only one substantive conversation with him, for ninety minutes in 2007, when Zuck asked me to help recruit Chamath to Facebook. At the time, Chamath was working at the venture firm Mayfield Fund, whose office was one flight up from mine at Elevation. Chamath was born in Sri Lanka and emigrated with his family to Canada. He overcame economic challenges, got a first-class education, and made his way to Silicon Valley. Brilliant, hard-working, exceptionally ambitious, and confident that his actions would always be right, Chamath exudes the vibe of classic Silicon Valley bro. He is also a very successful poker player, having once placed 101st out of 6,865 participants in the World Series of Poker’s Main Event. In short, Chamath Palihapitiya is no shrinking violet. He is not the sort of person to back down because someone yells at him. And yet, he went from being an articulate critic of Facebook to a willing purveyor of the company’s PR lines almost overnight. It was enough to make one suspicious.

Why was Chamath’s criticism more problematic for Facebook than that of Sean Parker or any of the earlier critics? There was one obvious difference. Before Chamath left Facebook in 2011, he had recruited many of the leaders of the Growth team. In Facebook parlance, Growth is about all the features that enable the company to increase user count and time on site and sell ads so successfully. (In Tristan’s framing, Growth is the group responsible for brain hacking.) If Chamath had continued to question Facebook’s mission, it is quite possible that the people he hired at the company, and those who knew him, might begin to question their leaders’ and company’s choices. The result might be a Susan Fowler Moment, named for the Uber engineer whose blog post about that company’s toxic culture led to an employee revolt and, ultimately, the departure of the executive team. What made Fowler so important was that Uber’s management team, board of directors, and investors had done nothing for years to change the toxic culture, despite a steady flow of bad news about it. Fowler framed the problem in a way that no one could deny, causing the employees to demand change. That is precisely what Palihapitiya did in his remarks at Stanford. It’s easy to imagine that Facebook might do whatever it took to prevent a Susan Fowler Moment.

Chamath’s reversal triggered an insight. The window for Facebook to make a graceful exit from its predicament would not stay open forever. The opportunity to follow the example of Johnson & Johnson after the Tylenol tampering crisis of the 1980s would last only as long as Facebook could credibly plead ignorance of its misdeeds. Chamath had presented Facebook with a teachable moment. They could have said, “Now we get it! We screwed up! We will do everything possible to fix the problems and restore trust.” By failing to exploit Chamath’s regrets as a teachable moment, Facebook signaled a commitment to avoiding responsibility for the Russian election interference and all the other problems that had surfaced. This was bad news. I had been giving Facebook the benefit of the doubt since October 2016, assuming that the company had been a victim. For six months after my original email to Zuck and Sheryl, I had assumed that my delivery was flawed or that I had been the wrong messenger. When Tristan and I started speaking out, I hoped that Facebook employees and alumni would join the cause and that people like Sean Parker and Chamath Palihapitiya might succeed in convincing Zuck and Sheryl to change their approach. That did not happen.

8

Facebook Digs in Its Heels

Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks. —STEPHEN HAWKING

When a company grows from nothing to 2.2 billion active users and forty billion dollars in revenues in only fourteen years, you can be sure of three things: First, the original idea was brilliant. Second, execution of the business plan had to be nearly flawless. And third, at some point along the way, the people who manage the company will lose perspective. If everything your company touches turns into gold for years on end, your executives will start to believe the good things people say about them. They will view their mission as exalted. They will reject criticism. They will ask, “If the critics are so smart, why aren’t they as successful and rich as we are?”

Companies far less successful than Facebook have fallen victim to such overconfidence. The culture of Silicon Valley, which celebrates the brash and the bold, breeds overconfidence and then lets nature take its course. The corpses of overconfident companies litter the landscape of the tech industry. Companies like Digital Equipment, Compaq, Netscape, Sun Microsystems, and MySpace were hot growth stories in their prime. Then there are the survivors who had lost prestige as their growth slowed down, companies like Intel, EMC, Dell, and Yahoo. The executives of these companies confidently predicted strong growth right up to the moment when there was none and the stock—and their dreams of endless growth—came tumbling down. Then there are companies like Microsoft, Oracle, and IBM, at one time undisputed leaders but whose giant market capitalization masks a dramatic loss in influence.

It took me a very long time to accept that Zuck and Sheryl had fallen victim to overconfidence. I did not pick up the signal when I first reached out to them in October 2016. It was not even clear to me in February 2017, when I gave up on trying to convince Dan Rose to investigate my concerns. The evidence started to pile up in the month prior to the hearings on October 31 and November 1, 2017, but I still wanted to believe that Zuck and Sheryl would eventually change their approach. The clincher was the episode with Chamath. Before Chamath, Facebook could have said, “We didn’t cause the Russian interference, but it happened to our users and we will do everything in our power to protect them.” Facebook could have followed the crisis management playbook, cooperated fully and enthusiastically with investigators and reached out to users who were touched by the Russian interference with an explanation and evidence. A lot of time had passed, but I am pretty sure that everyone who mattered—users, advertisers, the government, Facebook employees—would have reacted favorably. There might have been a hit to earnings and the stock price in the short term, but before long Facebook would have enjoyed the benefits of greater trust from its constituents, which would have taken the stock to new highs.

Instead, Facebook finished 2017 as it had begun it, by not giving an inch, thus violating a central precept of crisis management: embracing criticism. Instead, Facebook defied its critics without even acknowledging their existence. The company’s message to the world—“nothing to see here, move along”—was so completely out of step with what we already knew that I was taken aback. What were they thinking?

The idealist in me still hoped there would be a way to persuade Zuck and Sheryl to look at the situation differently, to recognize that the 2018 US midterm elections were fast approaching and only Facebook had the ability to protect that election from mischief similar to 2016.

From the start, we understood that all the best outcomes required cooperation from Facebook. Election interference and threats to public health were the result of Facebook’s design choices, made in service of a brilliantly successful advertising business model. Regulation could change Facebook’s incentives and behavior, but that would almost certainly take years to implement, even in a best-case scenario, and that scenario was not really an option. Our only choices were to persuade Facebook to harm its business for the good of the country and the world—which seemed about as likely as my winning the hundred-meter dash in the Olympics—or just hope for the best.

Tristan remained optimistic that we might find allies among Facebook employees or alumni who could influence Zuck and Sheryl. No matter the odds, it was worth a try. No current employees were speaking out yet, but Tristan did not give up on them. He secured a series of meetings with influential Facebook executives who expressed interest in humane design, but so far that interest has not translated into changes in policy, presumably because only Zuck and perhaps Sheryl have the power to do that.

We had achieved our original goal of helping to trigger a conversation about the dark side of social media, but that had not yet produced any substantive change by the internet platforms. Our allies—especially those in Washington and in the media—encouraged us to keep pushing. They argued that Facebook would respond only to pressure, and they thought we could play a role in bringing pressure to bear. Facebook’s strategy was to outlast our outrage, to concede nothing, and to hope the press and Congress would move on to other topics. Given the distraction of the Trump administration, that seemed like a good bet. Facebook had built up so much goodwill with users and politicians that it was understandable that they would expect the pressure to fade and disappear. Facebook had been overstepping boundaries and apologizing since Zuck’s days at Harvard, and apologizing had always been enough to make past problems go away. Facebook was confident, but it was not invulnerable. The company’s decision-making process, dominated by Zuck and Sheryl, appeared to be suboptimal for a crisis, which is where the election-interference story appeared to be going.

I had some perspective on an analogous situation. In 1994, Bill Gates asked me to be an early reader and sounding board for his first book, The Road Ahead. In those days, I paid exceptionally close attention to all things Microsoft. Not long thereafter, the US Justice Department initiated an antitrust case against Microsoft, citing unfair bundling of the Internet Explorer browser with Windows.

In those days, Microsoft was a global powerhouse equivalent to Google today, dominant and unassailable by competitors. A relatively small team in Redmond, Washington, made all the decisions. As an early adopter of electronic mail, Microsoft managed its global operations with the shortest lag times imaginable. Email enabled Microsoft employees in the remotest parts of Australia, South America, Africa, or Asia to escalate problems through the chain of command to the proper decision maker in Redmond in a matter of hours. It is hard to overstate the significance of the breakthrough represented by Microsoft’s email system and the competitive advantage it provided. Until the antitrust case. The first thing Microsoft’s antitrust lawyers did was to force a change in email practices to reduce the possibility of legal jeopardy. Overnight, a lawyer’s decree converted internal communications at Microsoft from an asset to a liability. The lawyers effectively decapitated the company. Microsoft probably would have messed up the internet opportunity in any case, but thanks to the antitrust case, they missed it by a mile.

If anything, decision making at Facebook was even more centralized than at Microsoft. Employees at Microsoft revered Bill Gates, but Bill encouraged debate. He was famous for saying, “That is the stupidest thing I have ever heard!” . . . but it was an invitation. He expected you to defend your position. If you did so well, Bill would come around. It’s possible that something like that could happen at Facebook, but that did not appear to be the norm. At Facebook, Zuck is on a pedestal. I don’t think many people debate or contradict him.

Back in early October 2017, Barry Lynn of the Open Markets Institute had convinced me to write a long-form essay describing the dark side of social media, our journey to date, and our best policy ideas. He then persuaded the editors of Washington Monthly, a venerable magazine for progressive policy advocates, to commission a 6,000-word essay. My goal was to crystallize the issues and our policy recommendations for policy makers inside the Beltway, an intellectual one-stop-shop that would frame the debate and create a platform for the next phase of our work. I submitted the first draft in late October.

I would get a master class in the Socratic method from the piece’s editors, Paul Glastris and Gilad Edelman, who provided a series of brilliant questions, the answers to which filled in many holes. We showed the policy prescriptions to a number of others on Capitol Hill to get their feedback. The editing and reviewing went on through the month of November until one day Gilad told me we were done. The essay would be the cover story of the January 2018 issue, slated for publication on January 8. It went beyond election interference to talk about the threats from internet platforms to public health, privacy, and the economy.

—

PUBLIC HEALTH HAD BEEN Tristan’s and my original focus, but Washington’s interest in election integrity had dominated our attention since July. In late 2017, we resumed our public health effort, starting with the impact of technology products on children. In the mindless pursuit of growth, internet platforms had built a range of products for kids. It is hard to know whether the platforms were ignorant of children’s vulnerability or drawn to it, but the kids’ products they created appeared to cause developmental and psychological problems. On this issue, we found a terrific partner in Common Sense Media, the largest nonprofit focused on children and media in the United States. We had first talked to Common Sense in the summer of 2017. In addition to providing parents with reviews of television, films, and video games, Common Sense embraced the challenge of protecting children from age-inappropriate content on the web. This led to frequent and sometimes fierce battles with Facebook, Google, YouTube, Instagram, and Snapchat. I first met Common Sense founder Jim Steyer in tenth grade, and we have been friends ever since. From our first conversation about Tristan’s work, Jim saw the opportunity for collaboration. Common Sense understood the threat posed by addiction to smart screens and was creating a series of public service announcements featuring comedian Will Ferrell to advocate for device-free dinners. The organization’s biggest challenge was that its staff, well endowed with childhood development, policy, and lobbying skills, did not have enough credibility in the technology community. Without brand-name technologists in their team, Common Sense Media had less influence inside the industry than it wanted. In December 2017, after several months of conversations, Jim offered us a compelling package. Common Sense would allow us to use their offices for meetings and to leverage their considerable legislative prowess in Washington, DC, and the California statehouse in Sacramento. In exchange, Tristan would join Common Sense as a senior fellow and I as an advisor, bringing our technology experience and relationships to bear on their behalf. We planned to announce Tristan’s new affiliation in Washington at a one-day conference on February 7. Common Sense’s connections with policy makers and the media would draw attention to the event and increase the pressure on Facebook.

At the same time, Tristan initiated another effort. He wanted to bring technologists and other concerned parties together to create, enlarge, and strengthen the opposition to the business practices of internet giants. Having already built Time Well Spent into a vibrant community of people focused on taking control of their digital lives, Tristan understood that our advocacy needed a different kind of organization. He decided to create it: the Center for Humane Technology.

Tristan and I shared a view that human-driven technology could be the Next Big Thing in Silicon Valley. Tech products should not be dangerous. They should not misinform or dumb us down. The objective of new technology should be to empower users, enabling them to improve their lives. The current model cannot continue, but that does not mean that the technology industry has to suffer a decline. Like renewable energy—where solar and wind power have succeeded at utility scale—human-driven technology could replace an outdated approach with a new one, converting a man-made problem into a huge business opportunity. We want technology to make the world a better place. Human-driven technology is the way to do it.

What do I mean by human-driven technology? I want to see a return to technology that leverages the human intellect, consistent with Steve Jobs’s “bicycle for the mind” metaphor. Human-driven products do not prey on human weakness. They compensate for weakness in users and leverage strengths. This means taking steps to prevent addiction and, when those fail, to mitigate the downsides. The design of devices should deliver utility without dependence. The design of applications and platforms should respect the user, limiting the effects of existing filter bubbles and preventing new ones from forming. Done right, every internet platform would be a new bicycle for the mind. In data privacy, a really useful idea would be a universal authentication system, an alternative to Facebook Connect or OpenID Connect that protects users. Facebook Connect is convenient for signing on to every site, but users need a way to do that without surrendering their privacy. The ideal would be to follow the model Apple set for facial recognition, where the data always remains on the smartphone, in the possession of the user. What I have in mind is an independent company that represents the interest of users at login, providing the minimum information required for each transaction.

With each new generation of technology, entrepreneurs and engineers have an opportunity to profit from designing products that serve rather than exploit the needs of their users. Virtual reality, artificial intelligence, self-driving cars, and the Internet of Things (IoT)—smart speakers and web-enabled televisions, automobiles, and appliances—all present opportunities to create bicycles for the mind. Unfortunately, I see no evidence yet that the designers in those categories are thinking that way. The term you hear instead is “Big Data,” which is code for extracting value rather than creating it. At the end of the day, the best way to persuade Facebook and Google to adopt human-driven technology is to foster competition and demonstrate value in the marketplace. Giving consumers different design choices will take years, so we should start as soon as possible.

On January 1, 2018, Zuck published a post announcing his goal for the year ahead. It had become a tradition for Facebook’s CEO to begin each year by giving himself a challenge. One year he learned to speak Mandarin. Another year he only ate meat he had killed himself. I have no idea why Zuck makes these challenges public. Zuck’s goal for 2018 was to fix Facebook. He offered a nine-point plan. Wait. What? Fix Facebook? Where did that come from? No one at the company had previously admitted to problems that might require fixing. Suddenly Zuck acknowledged concerns about fake news and the possibility that too much Facebook (or other social media) might lead to unhappiness. He offered a classic Zuck fix: more Facebook! Zuck’s plan for addressing the problems created by Facebook was for users to do more of the things that created the problems in the first place. People who had not realized there was anything broken at Facebook were caught off guard by Zuck’s post. What did it mean?

In response to Zuck’s post, Washington Monthly published my cover story online a few days early, on January 5. Even though I had completed the essay more than a month earlier, it read like a rebuttal to Zuck’s New Year’s resolution. Where Zuck’s post had framed Facebook’s flaws obliquely, my essay was direct and specific. Where his remedy was more Facebook, my essay recommended ten remedies, aimed at user privacy, ownership of data, terms of service, and election interference. The press picked up on it, and the next thing I knew, an essay designed for a handful of policy makers in Washington began spreading outside the Beltway. We had managed to find a pretty good audience for our message in 2017, but we had made no progress with the only audience that mattered: the top people at Facebook. The company’s PR people had begun to say unflattering things in private but were ignoring us in public. And it was working for them. Then came Washington Monthly. The lucky timing of the essay would lead Facebook to engage directly.

On Sunday, January 7, I flew to New York City with my wife, Ann, for a six-week stay. The next morning, I received an email from Jamie Drummond, Bono’s partner on the ONE campaign, asking if he could introduce me to someone who represented George Soros, the billionaire investor who had dedicated his fortune to the promotion of democracy around the world. In my years in the investment business, there were a handful of people whose brilliance dazzled me, and George Soros was one. In an email, Soros’s colleague Michael Vachon explained that Soros had read my Washington Monthly essay and liked it so much he planned to use it as the frame for a speech at the World Economic Forum in Davos on January 25. Would I be willing to meet with Mr. Soros to help him write the speech? I certainly would. We agreed to meet at the end of the week.

That same day, I called my friend Chris Kelly, the former chief privacy officer of Facebook, who had originally introduced me to Zuck. I wanted Chris’s take on everything that we had learned. Chris shared my view that the only people who could fix Facebook quickly were Zuck and Sheryl. There was no way to protect elections or innocent people from harm without some cooperation from Facebook. Inside the company, Zuck and Sheryl had the power. They had the moral authority to change direction.

Unfortunately, Zuck and Sheryl refused to engage with critics. There are two reasons why crisis management experts advise clients to reach out to critics: you learn the dimensions of the problem, and by cooperating with critics, you take the first step on the path to restoring trust. Facebook had ignored all critics until Chamath Palihapitiya spoke at Stanford. Facebook’s successful effort to get Chamath to recant his regrets and the resolution’s focus on “more Facebook” as the solution to whatever ailed users suggested Facebook did not plan to concede anything.

The day took a turn into the twilight zone when a friend shared a tweet posted by long-time Facebook executive Andrew “Boz” Bosworth. It read, “I’ve worked at Facebook for 12 years and I have to ask: who the fuck is Roger McNamee?” It’s a question I have often asked myself in other contexts, but in this case it pointed to an inescapable conclusion: the Washington Monthly essay had found its way into Facebook headquarters. He wasn’t Zuck or Sheryl, but Boz was a member of the inner circle. We looked at the bright side. Getting on Boz’s radar seemed like progress. It certainly caught the eye of many journalists, which helped our cause.

One thing had not changed from when I first reached out to Zuck and Sheryl in 2016: Facebook was not open to criticism, much less taking it to heart. Ignore the messenger was their first instinct; if that failed, presumably they would bring in the heavy artillery.

Later that day, Tim Berners-Lee tweeted the Washington Monthly essay to his followers. Berners-Lee is one of my heroes. His endorsement of the essay meant the world to me. Suddenly, the essay was everywhere, and requests came in from all sorts of media: CNBC, Tucker Carlson on Fox, CBS Morning News, NBC Nightly News, the Today show, MSNBC, Frontline, CNN, 60 Minutes, Bloomberg Technology, BBC Radio, and Bloomberg Radio. Tristan, Sandy Parakilas, and I did a huge amount of TV and radio between Monday and Thursday of that week. Network television enabled us to share our message with millions of people. But the highlight of the week came on Friday, when I went to Soros’s house in Bedford, New York, north of New York City.

George Soros was eighty-seven years old at the time and exceptionally full of life. I arrived as he was returning from a tennis match. George welcomed me to his home, introduced me to his wife, Tamiko, and begged my forbearance while he took a quick shower before our session. During the short wait, Tamiko quizzed me about the Washington Monthly article.

Soros’s speech was already great when I first saw it, but he is a perfectionist and thought that it could be much better. We spent more than four hours editing it line by line until George expressed satisfaction with the substance. When we got to the end, I assumed my job was done, but George asked if I could return the following day, which was Saturday. He wanted to review the speech again and then prepare for questions he might get from the press. No one was expecting George Soros to deliver a warning about the dangers of internet platform monopolies, and he wanted to be certain he understood the technical issues described in my essay well enough to answer questions from journalists. On Saturday morning, George, Tamiko, Michael Vachon, and I sat around the dining room table, reviewing every issue from multiple directions until George felt he could respond to whatever the reporters asked. It took more than three hours. The speech is included in the appendices to this book.

Soros’s commitment to democracy around the world had particular salience in January 2018, given the rise of Donald Trump and the growing strength of hypernationalists in Europe. After an opening that focused on geopolitics, Soros’s speech turned to the threat to democracy from internet monopolies like Google and Facebook. Playing to his strengths, Soros framed the threat in economic terms. He characterized the internet monopolies as extraction businesses in the vein of oil companies, but with a better business model. Network effects allow for ever higher returns as they grow. Growth requires more time and attention from every user every year, gained through surveillance of users and designs that create psychological addiction. Exceptional reach enables monopolies to act as gatekeepers. Media companies must work with them on their terms. Yet the internet monopolies do not acknowledge responsibility for the content on their site, which allows disinformation to flourish. Active users lose the ability to separate fact from fiction, making them vulnerable to manipulation. Soros emphasized the potential threat to democracy of an alliance between authoritarians and internet monopolies. He warned that the monopolies are vulnerable both to China’s influence and to competition from Chinese companies playing their version of the same game. Soros concluded the speech with praise for the European Union’s approach to protecting users from internet monopolies. George may have started from my Washington Monthly essay, but the final speech went much further, tying the threat from internet platforms to geopolitics. By the time I left the Soros home, I had every hope that George’s speech would have an impact.

It did. The Soros speech at Davos on January 25 reverberated through the halls of government in both Europe and the United States, reframing the conversation from the relatively narrow confines of the US presidential election to the much broader space of global economics and politics. Policy makers take Soros very seriously, even the ones who disagree with him, and few expected the eight-seven-year old billionaire to speak so thoughtfully and forcefully about technology. For many, it was a wake-up call. In the US, where policy makers’ enormous trust in tech platforms had already been tested by the congressional hearings three months earlier, Soros added pressure for a further reassessment. For users, the effect of Soros’s speech was more abstract. Most users really like Facebook. They really like Google. There is no other way to explain the huge number of daily users. Few had any awareness of a dark side, that Facebook and Google could be great for them but bad for society. I don’t know how many users heard Soros’s speech—probably fewer than watched at least some of the congressional hearings back in October and November, which itself was not a big number—but many more saw the headlines. I suspect the details of Soros’s argument did not fully register, but coming so soon after the hearings, the headlines had to leave an impression: same companies, new problems. An increasing number of users registered an awareness of controversy surrounding Facebook and Google. More knew that the platforms had issues, even if they did not yet know the particulars or how they might be affected personally.

9

The Pollster

Technology is cool, but you’ve got to use it as opposed to letting it use you. —PRINCE

Andrew Bosworth’s tweet—“Who the fuck is Roger McNamee?”—was not the kind of engagement I had hoped for from Facebook. It was hard to imagine that Boz viewed me as a threat, so why bother to mention me? As we had learned from Zuck’s New Year’s resolution, any response at all from Facebook engaged the news media. It amplified our signal, increasing both awareness and skepticism about Facebook’s business practices in the context of the 2016 election.

Zuck’s New Year’s resolution was just the first in a series of public pronouncements. It was followed ten days later by changes to News Feed. Facebook demoted publisher content, while promoting posts from family, friends, and Groups. It positioned the change as an effort to reduce fake news and increase content from the sources users trusted most. Skeptics suggested that Facebook made the change to reduce the risk that regulators would view it as a media company. Less publisher content would also minimize the opportunity for accusations of editorial bias. The problem is that Facebook really is a media company. It exercises editorial judgment in many ways, including through its algorithms. Facebook’s position has always been that users choose their friends and which links to view, but in reality, Facebook selects and sequences content for each user’s News Feed, an editorial process that had led to criticism in the past, most notably when conservatives accused the company in May 2016 of bias in its Trending Stories feature. At that time, human editors curated Trending Stories. Stories with a conservative slant represented something less than half in the spring of 2016, the result of multiple factors. Facebook may have bowed to the accusation of bias because of cofounder Chris Hughes’s role in President Obama’s reelection campaign in 2012, when Hughes ran digital operations. Whatever the reason, Facebook’s decision in May 2016 to replace human curators with algorithms proved to be a disaster. Far-right voices gamed the algorithm effectively, and disinformation dominated Trending Stories, just in time to amplify the Clinton email server story.

Whether or not the changes to News Feed were another attempt to deny responsibility for third-party content on the platform, they had the effect of promoting the primary elements of filter bubbles—family, friends, and Groups—at the expense of the content most likely to pierce a filter bubble, journalism. The changes seemed like a step backward. Had they been implemented in 2015, they would likely have magnified the effect of the Russian interference.

February 2018 began with two events that were our first efforts to put organizational muscle behind our effort: the launch of the Center for Humane Technology (CHT) and the one-day Truth About Tech conference on kids and social media. CHT is a not-for-profit dedicated to helping consumers deal with the dark side of technology. The New York Times wrote a launch story about CHT that included a list of founders and advisors, two of which were Facebook alumni. Both suffered through hostile phone calls from Facebook for associating with us. While the mission of CHT was nonpartisan and user-centric, Zuck and Sheryl did not take kindly to former colleagues lending their names to it. Other than annoying the two Facebook alumni, Facebook’s reaction had no impact on CHT. This was confirmed the following day, when we convened in Washington for the Truth About Tech conference. Explicitly positioned as a joint project of Common Sense Media and the Center for Humane Technology, Truth About Tech had a speaker list that included Senators Mark Warner and Edward Markey, as well as Representative John Delaney; Dr. Robert Lustig, the pediatric endocrinologist who had exposed the addictive properties of sugar; author Franklin Foer; Chelsea Clinton; and Tristan, Randima Fernando, and me from the CHT team. Randima had recently joined CHT, after working with Tristan on Time Well Spent. Common Sense Media had invited people from Facebook and Google to attend the conference, hoping for constructive dialogue about protecting children from the harmful aspects of screens and online content, but they were not willing to engage in the conversation.

At the kickoff event for the conference, House Minority Leader Nancy Pelosi sought me out. We have similar taste in music and had shaken hands a few times backstage at Grateful Dead and U2 concerts. She took me aside, thanked me for the work our team had been doing with House Intelligence, and asked if we needed help reaching other members of the Democratic House caucus. The shortest unit of time in the universe is how long it took me to say yes. She recommended that I brief her entire staff as a first step, which I did a few weeks later. That momentary encounter would soon pay larger dividends.

That same day, The Verge published a story by Casey Newton about Tavis McGinn, who had recently left Facebook after a six-month stint as the personal pollster for Zuck and Sheryl. The story shocked us. Why would Facebook—which employs a small army to survey users on every issue imaginable—need to hire a new person for the sole purpose of polling the popularity of its two top executives? More remarkable was the timing: Tavis had been at Facebook from April through September 2017. They had hired the pollster while they were still denying any involvement in the Russian interference.

In the article, Tavis explained that his experience at Facebook did not work out the way he had hoped.

“I joined Facebook hoping to have an impact from the inside,” he says. “I thought, here’s this huge machine that has a tremendous influence on society, and there’s nothing I can do as an outsider. But if I join the company, and I’m regularly taking the pulse of Americans to Mark, maybe, just maybe that could change the way the company does business. I worked there for six months and I realized that even on the inside, I was not going to be able to change the way that the company does business. I couldn’t change the values. I couldn’t change the culture. I was probably far too optimistic.

“Facebook is Mark, and Mark is Facebook,” McGinn says. “Mark has 60 percent voting rights for Facebook. So you have one individual, 33 years old, who has basically full control of the experience of 2 billion people around the world. That’s unprecedented. Even the president of the United States has checks and balances. At Facebook, it’s really this one person.”

No one on our team had interacted with Zuck and Sheryl since the 2016 election. We could only guess what they were thinking. Here was someone who knew what they were thinking just a few months earlier. We were keen to connect with him. A reporter at The Washington Post, Elizabeth Dwoskin, knew how to reach Tavis and volunteered to introduce us. It took a couple of days, but Tavis called my cell phone while I was riding the subway in New York. Fortunately, the call came through while my subway train was stopped at the Twenty-eighth Street station on the 1 line. I hopped off the train and spoke to Tavis for nearly half an hour on the subway platform, our conversation punctuated by the noise of passing trains.

Tavis reframed my understanding of the psychology of Zuck and Sheryl, as well as the way that Facebook’s culture had evolved since the IPO. He emphasized that spectacular success had cemented Zuck’s position as the undisputed leader of the world’s largest network of people. As Zuck’s partner, Sheryl enjoyed comparable regard from employees. Internally, everyone defers to the Big Two. Tavis’s hiring reflected Zuck’s and Sheryl’s concern for their personal brands, which they feared would be tarnished by any negative feedback that came Facebook’s way. Tavis was convinced that both Zuck and Sheryl had bigger plans after Facebook, and those plans were threatened by the rising tide of criticism. Soon after joining the company, Tavis learned that neither Zuck nor Sheryl wanted to hear bad news. As much as I would have liked to dig deeper, I respected Tavis for honoring Facebook’s nondisclosure agreement (NDA).

On February 16, Special Counsel Robert Mueller issued a thirty-seven-page indictment of thirteen Russian nationals and three organizations for interference in the 2016 US election, wire fraud, and bank fraud. The indictment referred to Facebook, Instagram, and Twitter by name and underscored the ease with which the Russians had exploited the architecture and algorithms of social platforms to spread disinformation and suppress votes. The story landed like a bombshell. As a bonus, the world got a peek into Facebook’s culture, thanks to a tweet storm from Rob Goldman, Facebook’s vice president of advertising, in response to the indictments.

The president of the United States retweeted Goldman’s tweet, making it a global news story with consequences for which Facebook had not prepared.

Goldman’s tweets provided a glimpse into the state of mind of Facebook executives. Apparently, they viewed the Mueller indictment as exoneration. They thought it was okay that the Russians had exploited Facebook and Instagram to “divide America,” so long as they did not intend to sway the election. It demonstrated a stunning lack of situational awareness by a member of Facebook’s inner circle. Journalists and the blogosphere mocked Goldman and Facebook for being clueless. Goldman’s tweet storm had effectively confirmed Tavis’s view of the mind-set inside Facebook.

A few days later, I met Tavis for the first time, in a coffeehouse on Market Street in San Francisco. He told me that he hailed from North Carolina and went to college at the University of North Carolina at Chapel Hill, where he discovered a talent for entrepreneurship, launching a business that rented refrigerators to students. After college, Tavis began his career in market research. He became an expert at creating and executing surveys, which eventually landed him at the insurance company GEICO, then at Google. Facebook pursued him several times at Google, but Tavis was not tempted until early 2017, when the opportunity arose to be the personal pollster for Zuck and Sheryl.

With the Mueller indictment and the subsequent Goldman tweet storm as context, Tavis and I shared insights for ninety minutes. After leaving Facebook, Tavis had launched a new market research business, Honest Data, but hoped to join our team on a part-time basis, with the goal of communicating his concerns about Facebook to regulators. He had done research on the NDA that every Facebook employee must sign and concluded that it could be pierced in the event of a legal case, such as an investigation by a state attorney general. While we were not actively working with a state attorney general, we had built a relationship with the attorney general of New York and members of his team. I offered to make an introduction. It made sense to initiate relationships with other attorneys general.

Two days later, on Wednesday, Tristan and I went to Seattle to meet the chief of staff to the attorney general of Washington, the adolescent mental health team at the Gates Foundation, and the CEO of Microsoft. The three had very different interests and no prior exposure to us, so the best we could hope for would be to plant seeds. We did that in the first two meetings, before going to Microsoft headquarters for a meeting with the CEO, Satya Nadella, and the head of business development, Peggy Johnson. Nadella’s book, Hit Refresh, had expressed a philosophy consistent with the values Tristan had set for the Center for Humane Technology, and we hoped to secure his support for our effort. Companies like Microsoft don’t commit in the first meeting, but Satya and Peggy engaged thoughtfully with us. Satya noted that while two Microsoft products, Xbox and LinkedIn, used techniques from the Fogg playbook, most of its products did not. There would be significant benefits to adopting Tristan’s notions of humane design in the core Windows line. He asked that Tristan schedule a return visit to brief Microsoft’s engineering leadership. On the way out of Satya’s office, we ran into Microsoft founder Bill Gates, on his way to visit Nadella. In an Axios interview a week earlier, Bill had criticized the tech giants of Silicon Valley for acting cavalierly, suggesting that they risked the kind of government regulation that had plagued Microsoft. “The companies need to be careful that they’re not . . . advocating things that would prevent government from being able to, under appropriate review, perform the type of functions that we’ve come to count on,” he warned.

Even apart from the Mueller indictment and Goldman’s tweets, February delivered a series of public relations failures to Facebook. Two huge consumer packaged goods vendors, Procter & Gamble and Unilever, criticized Facebook (and Google) and threatened to stop advertising. P&G expressed displeasure with the platforms’ lack of transparency and accountability and argued that advertisers should not tolerate the biggest internet platforms’ failure to conform to the disclosure standards of the advertising industry. Current practices caused P&G to ask if it was getting what it paid for. Unilever objected to fake news, extremist content, and the role that the platforms had played in sowing discord.

Days later, journalists disclosed that Facebook had sent millions of marketing messages to phone numbers that users had provided as part of a security feature called two-factor authentication, something it had promised not to do. A storm of criticism followed, eliciting a couple of tweets from Facebook’s vice president of security, Alex Stamos, that reprised Facebook’s tin ear to legitimate criticism. Once again, a press revelation confirmed Tavis’s hypothesis about the company’s culture. Next, a court in Belgium ruled that Facebook broke privacy laws and ordered the company to stop collecting user data in that country. Even when news reports dealt with another tech platform—as was the case when journalists revealed that Russian bots promoted disinformation on Twitter in the wake of the school shooting in Parkland, Florida—Facebook’s reputation took a hit. Finally, a virtual-reality shooting game that Facebook sponsored at the Conservative Political Action Conference (CPAC) drew massive criticism, also coming on the heels of the Parkland shooting.

It seemed as though a negative story hit Facebook almost every day. In a news environment dominated by the unprecedented behavior of the Trump administration, the Facebook story kept breaking through. Most of the world was barely paying attention to the details, but the story had legs.

Facebook continued to defend its business model. In the past, apologies had always been enough to neutralize criticism. Not this time. Ignoring criticism for more than a year had not worked. Zuck’s 2018 New Year’s resolution and the tweets from inner-circle executives had backfired, but with those responses, Facebook acknowledged the criticism for the first time. Public pressure made a difference.

—

MY ORIGINAL FEAR—that Facebook’s problems were systemic—had been validated repeatedly by journalists, policy makers, and the Mueller investigation. Facebook executives had begun to engage, but it seemed that the rest of the company continued to operate as it always had. We heard rumors of internal discontent, but that may have been wishful thinking. No new whistle-blowers had emerged, and no one inside the company leaked any data to support the investigations. But the pressure on Facebook was about to intensify.

10

Cambridge Analytica Changes Everything

Once a new technology rolls over you, if you’re not part of the steamroller, you’re part of the road. —STEWART BRAND

March 2018 brought almost daily revelations about unintended damage from social media. Science magazine published a study conducted by professors at MIT of every controversial story in English on Twitter. It revealed that disinformation and fake news are shared 70 percent more often than factual stories and spread roughly six times faster. The study noted that bots share facts and disinformation roughly equally, suggesting that it is humans who prefer to share falsehoods. No one claimed that the problem might be confined to Twitter. The study provided further evidence that the dark side of social networks may be systemic, driven by design choices that favor some of the worst aspects of human behavior.

As if on cue, disinformation spread by Infowars about bombing suspects in Austin, Texas, reached the top of the charts on YouTube. YouTube responded to this failure in moderation by trying to pass the buck to Wikipedia, which it claimed would debunk disinformation. When I checked with Katherine Maher, the executive director of Wikipedia, that day, I learned that YouTube had made the announcement without first speaking to or offering to reimburse Wikipedia, a nonprofit with a small professional staff. When Wikipedia pushed back, the folks from YouTube seemed not to understand why Wikipedia would not want to spend its limited budget being YouTube’s fact-checker.

For Facebook, a tide of bad news washed in from outside the United States. Early in March, the Sri Lankan government ordered internet service providers to block Facebook, Instagram, and WhatsApp temporarily, due to an explosion of real-life violence against that country’s Muslim minority, triggered by online hate speech. The government criticized Facebook and its subsidiaries for not taking action to limit hate speech on their platforms, a criticism that would increasingly be echoed in jurisdictions around the world. Facebook’s response—that its terms of service prohibited the inciting of violence—was classic. They designed the site so that hardly anyone will read the terms of service, but somewhere in those terms is one that prohibits hate speech. The company promised to work with the government of Sri Lanka to address the problem, a promise that seemed transparently hollow. Facebook is huge; relative to the economics of Facebook, Sri Lanka is not. To imagine that Facebook would let Sri Lanka be friction seemed like wishful thinking.

Days later, a United Nations report accused Facebook of enabling religious persecution and ethnic cleansing of the Rohingya minority in Myanmar. As in Sri Lanka, hate speech on Facebook triggered physical violence against innocent victims. According to Médecins Sans Frontières, the death toll from August through December 2017 was at least nine thousand. In a country where Facebook completely dominates social media, the platform plays a central role in communications. The Guardian reported:

The UN Myanmar investigator Yanghee Lee said Facebook was a huge part of public, civil and private life, and the government used it to disseminate information to the public.

“Everything is done through Facebook in Myanmar,” she told reporters, adding that Facebook had helped the impoverished country but had also been used to spread hate speech.

“It was used to convey public messages but we know that the ultra-nationalist Buddhists have their own Facebooks and are really inciting a lot of violence and a lot of hatred against the Rohingya or other ethnic minorities,” she said.

“I’m afraid that Facebook has now turned into a beast, and not what it originally intended.”

Slate quoted Facebook executive Adam Mosseri as saying the situation in Myanmar was “deeply concerning” and “challenging for us for a number of reasons.” He argued that in Myanmar, Facebook had not been able to employ its standard practice of working with third-party fact-checkers. Instead, it was attempting to regulate hate speech through its terms of service and community standards, which presumably are at least as opaque to users in countries like Myanmar as they are in the United States. And the situation is actually worse than that. Facebook has a program called Free Basics, which is designed for countries where mobile communications is available but too expensive to permit widespread use of internet services. The functionality of Free Basics is limited, designed to plant seeds in developing countries, while gaining positive press for doing so. Sixty emerging countries around the world have embraced Free Basics, all countries with minimal experience with telecom and media, and some have been disrupted by it. In Myanmar, Free Basics transformed internet access by making it available to the masses. That is also the case in most of the other countries that have adopted the service. The citizens of these countries are not used to getting information from media. Prior to Free Basics, they had little, if any, exposure to journalism and no preparation for social media. Their citizens did not have filters for the kind of disinformation shared on internet platforms. An idea that sounded worthy to people in the US, Free Basics has been more dangerous than I suspect its creators would have imagined.

In Myanmar, a change in government policy caused an explosion in wireless usage, making Facebook the most important communications platform in the country. When allies of the ruling party used Facebook to promote violence against the Rohingya minority, the company fell back on its usual strategy of an apology and a promise to do better. The truth is that countries like Myanmar are strategically important to Facebook, but only as long as the cost of doing business there remains low. Facebook had not hired enough employees with the language skills and cultural sensitivity to avoid disruption in countries like Myanmar or Sri Lanka. The company demonstrated little urgency to address this issue, framing it as a process problem rather than a humanitarian crisis.

On March 16, all hell broke loose.

It began when Facebook announced the suspension of a political consulting firm, Cambridge Analytica, and its parent, SCL Group, from the platform. This turned out to be an attempt to preempt a huge story that broke the following day in two newspapers in the United Kingdom, The Observer and The Guardian, as well as in The New York Times. The Guardian story opened with a bang:

The data analytics firm that worked with Donald Trump’s election team and the winning Brexit campaign harvested millions of Facebook profiles of US voters, in one of the tech giant’s biggest ever data breaches, and used them to build a powerful software program to predict and influence choices at the ballot box.

A whistleblower has revealed to the Observer how Cambridge Analytica—a company owned by the hedge fund billionaire Robert Mercer, and headed at the time by Trump’s key adviser Steve Bannon—used personal information taken without authorisation in early 2014 to build a system that could profile individual US voters, in order to target them with personalised political advertisements.

Christopher Wylie, who worked with a Cambridge University academic to obtain the data, told the Observer: “We exploited Facebook to harvest millions of people’s profiles. And built models to exploit what we knew about them and target their inner demons. That was the basis the entire company was built on.”

The story suggested that Cambridge Analytica had exploited a researcher at Cambridge University, Aleksandr Kogan, to harvest and misappropriate fifty million user profiles from Facebook. Kogan, a researcher who was also affiliated with a university in St. Petersburg, Russia, had previously worked on research projects with Facebook. Cambridge University had originally rejected Kogan’s request to access its data, leading Kogan and his partner, Joseph Chancellor, to start a company, funded by Cambridge Analytica, that would create a new data set of American voters. They created a personality test that would target Facebook users and recruited test takers from an Amazon service that provided low-cost labor for repetitive information technology projects. Two hundred seventy thousand people were paid one to two dollars each to take the test, which was designed to collect the personality traits of the test taker, as well as data about friends and their Facebook activities. The people who took the test had to be American, and it turned out that they had a lot of friends, more than forty-nine million of them.

Cambridge Analytica was created in 2014 as an affiliate to SCL Group, a British firm that specialized in market research based on psychographics, a technique designed to categorize consumers according to personality types that might have predictive value in the context of elections. In the world of market research, there is considerable doubt about how well psychographics work in their current form, but that issue did not prevent Cambridge Analytica from finding clients, mostly on the far right. To serve the US market, SCL needed to obey federal election laws. It created a US affiliate staffed by US citizens and legal residents. Reports indicated that Cambridge Analytica took a casual approach to regulations. The team of Robert Mercer and Steve Bannon financed and organized Cambridge Analytica, with Alexander Nix as CEO. The plan was to get into the market within a few months, test capabilities during the 2014 US midterm elections, and, if successful, transform American politics in 2016. To be confident that their models would work, Nix and his team needed a ton of data. They needed to create a giant data set of US voters in a matter of months and turned to Kogan to get one. According to Wylie, the Kogan data set formed the foundation of Cambridge Analytica’s business. Cambridge Analytica’s election-centric focus clearly violated Facebook’s terms of service, which did not permit commercial uses of Kogan’s data set, but Wylie reported that Facebook made no attempt to verify that Kogan had complied.

At the time that Kogan and Cambridge Analytica misappropriated fifty million user profiles, Facebook was operating under a 2011 consent decree with the FTC that barred Facebook from deceptive practices with respect to user privacy. The decree required explicit, informed consent from users before Facebook could share their data. Apparently, Facebook had taken no steps to secure consent from the friends of the 270,000 test takers, which is to say, something like 49.7 million Facebook users. While the enforcement language of the consent decree is ambiguous, its intent is clear: Facebook had an obligation to safeguard the privacy of its users and their data. You could almost sense a shock wave as people understood the ease with which Kogan had harvested fifty million profiles. Facebook made it easy.

Speculation by journalists and pundits about legal issues that might arise from the Cambridge Analytica story lit up Twitter for hours. Legal analysts focused on the possibility of a data breach that might have placed Facebook in violation of state laws and FTC regulations. Failure to comply with the FTC consent decree carried a penalty as high as forty thousand dollars per offense. In the case of Cambridge Analytica, the penalty could potentially be measured in the trillions of dollars, far more than the value of Facebook. Cambridge Analytica might be vulnerable to prosecution for fraud and campaign finance violations.

The Cambridge Analytica story transformed the conversation about Facebook, providing something to worry about for just about everyone. Those troubled by the role of Facebook in the 2016 US presidential election could obsess over Facebook enabling inappropriate access to user profiles and how that might have affected the outcome. Those worried about privacy on Facebook saw their worst fears validated. Kogan harvested fifty million user profiles under a Facebook program designed to let third-party app vendors gain access to friends lists. How many third-party app vendors had taken advantage of the program? Only a tiny fraction of affected users knew their profile had been harvested. The data was still out there—quite likely still available for use—with no way to get it back.

Facebook tried and failed to minimize fallout from the story. Having failed to preempt it on day one, Facebook tried to reframe the story in a way that shifted all the blame to Cambridge Analytica. Facebook’s initial response, a series of tweets from vice president of security Alex Stamos, denied The Guardian’s characterization that Kogan and Cambridge Analytica had committed a data breach. Stamos emphasized that Kogan had authorization to harvest friends lists for research purposes and that the guilty party was Cambridge Analytica, which had misappropriated the user profiles. According to Stamos’s tweets, Facebook was a victim.

In disputing the initial characterization of a “data breach,” Facebook inadvertently made its public relations problem worse, so much so that Stamos deleted the tweets. When it described Kogan as a legitimate researcher, Facebook effectively acknowledged that the harvesting of user profiles by third parties was routine. Our team hypothesized that every Facebook user profile in that era was harvested at least once. Facebook’s acknowledgment came as a shock. It should not have been. We soon learned that sharing private user data with third parties was one of the core tactics that contributed to Facebook’s success.

In its early years, Facebook had been far more successful in growing its user base than in growing the amount of time each user spent on the site. The introduction of third-party games, particularly Zynga’s FarmVille in 2009, changed that by rewarding social interaction and leveraging friends lists to boost the population of players. By March 2010, FarmVille had more than 83 million monthly users and 34.5 million daily users, and it changed the economics of Facebook. Zynga leveraged its user growth with in-game advertising and purchases, which translated rapidly into revenue of hundreds of millions of dollars. On Facebook, 30 percent of Zynga’s in-game advertising and purchase revenues went to Facebook, making Zynga a key partner in the era before Facebook had a scalable advertising business model. In the year prior to the IPO, Zynga alone accounted for twelve percent of Facebook’s revenue. Zynga’s ability to leverage friends lists contributed to an insight: giving third-party developers access to friends lists would be a huge positive for Facebook’s business. Social games like FarmVille cause people to spend much more time on Facebook. Users see a lot of ads. Zynga had a brilliant insight: adding a social component to its games would leverage Facebook’s architecture and generate far more revenue, creating an irresistible incentive for Facebook to cooperate. In 2010, Facebook introduced a tool that enabled third-party developers to harvest friends lists and data from users. They saw the upside of sharing friends lists. If they recognized the potential for harm, they did not act on it. Despite the 2011 consent decree with the FTC, the tool remained available for several more years.

Kogan’s data set included not only Facebook user IDs but also a range of other data, including activity on the site. Such a list had great value if used inside Facebook, but Cambridge Analytica had bigger plans. They married the data set to US voter files, which include both demographic information and voting history. According to Wylie, Cambridge Analytica was able to match at least thirty million Facebook profiles to voter files, equivalent to 13 percent of all eligible voters in the country. At that scale, the data set had tremendous value to any campaign. Facebook’s advertising tools allow targeting by demographics and interests but are otherwise anonymous. Tying the voter files to the user profiles would have enabled Cambridge Analytica to target advertising inside Facebook with exceptional precision, particularly if one of the goals was voter suppression. In 2016, the winner in the electoral college lost the popular tally by nearly three million votes. Three states, which Trump won by a total of 77,744 votes, provided more than the margin of victory in the electoral college. Is it possible that the Cambridge Analytica data set might have influenced the outcome? Yes. It’s virtually impossible that it didn’t.

Targeting inside Facebook mattered because it works. Cambridge Analytica’s original client, the presidential campaign of Senator Ted Cruz, complained that the psychographic models sold by Cambridge Analytica did not work for them. In the end, psychographics probably didn’t matter to the Trump campaign. They had more powerful weapons available to them, in the form of Cambridge Analytica’s data set of thirty million enhanced voter files and Facebook’s targeting tools and employees.

After the initial bombshell story, The Guardian published a video interview with the whistle-blower, Christopher Wylie, whose pink hair made him instantly recognizable and ubiquitous online and in newspapers. The UK’s ITN Channel 4 added to the story with a series of undercover exposés about Cambridge Analytica that reflected very badly on that company and, by extension, on Facebook. In one of the exposés, senior executives of Cambridge Analytica are captured on film bragging about their ability to use prostitutes to entrap politicians.

The Guardian also reminded readers that it had previously revealed the connection between Kogan and Cambridge Analytica in a story in December 2015. Facebook claimed at the time not to have known that Cambridge Analytica had gained possession of Kogan’s data set. Citing a violation of its terms of service, Facebook sent letters to Cambridge Analytica and Kogan, insisting that they destroy all copies of the data set and certify that they had done so by checking off a box in a form. Facebook never audited either Cambridge Analytica or Kogan and did not dispatch inspectors to confirm destruction of the data set. Once again, the focus at Facebook was on protecting against legal liability, not on protecting users.

Facebook’s argument that it had been a victim of Cambridge Analytica fell apart when Slate’s April Glaser reminded her readers that the company had hired and continued to employ Joseph Chancellor, who had been Aleksandr Kogan’s partner in the startup that harvested Facebook user profiles on behalf of Cambridge Analytica. Facebook had known about the connection between Cambridge Analytica and Kogan/Chancellor since at least December 2015. They should have been really angry at Kogan and Chancellor for misappropriating the data set. Why would they hire someone who had misappropriated private user data? And yet Chancellor was now a Facebook employee. The Glaser story was actually old news that acquired new salience in the context of recent revelations. The Facebook/Kogan/Chancellor link had originally been reported by The Intercept in March 2017, and it had connected the dots from Cambridge Analytica to Kogan to Chancellor to Facebook in a way that did not make anyone look good. Facebook eventually placed Chancellor on administrative leave.

If the relationship between Facebook, Kogan, and Cambridge Analytica had been known since late 2015, why was this story a much bigger deal the second time around? The short answer is that context had been missing the first time the story made news. Unlike in December 2015, we now knew that the Russians had exploited Facebook to sow discord among Americans and then support Donald Trump’s presidential candidacy. We also knew that Cambridge Analytica had been the Trump campaign’s primary advisor for digital operations and that Facebook had embedded three employees in the Trump campaign to support that effort. The presidential election had been especially close, and it seemed likely that Trump’s targeting of voters in key states late in the campaign had been decisive. There were half a dozen things that had to happen on election day in order for Trump to win, and successful Facebook advertising in key states was one of them. The new context made it hard to escape the conclusion that Cambridge Analytica and the Trump campaign had exploited Facebook, just as the Russians had. Little had been learned about Facebook’s engagement with Russian agents, but there could be little doubt that Facebook had willingly engaged with Kogan, Cambridge Analytica, and the Trump campaign. It was entirely possible that Facebook employees had played a direct role in the success of Trump’s digital strategy on Facebook.

It is hard to overstate the impact of the Cambridge Analytica story. Coming on the heels of so many other bad stories, it confirmed many people’s worst fears about Facebook. The relentless pursuit of growth had led Facebook to disregard moral obligations to users, with potentially decisive consequences in a presidential election and as yet unknown other consequences to the millions of users whose data had been shared without prior consent. The national conversation Tristan and I had hoped to start eleven months earlier had reached a new level. The next few days were going to be a real test for Facebook. There was no good way to spin the Cambridge Analytica story. How would they handle the reckoning?

The first wave of stories about Cambridge Analytica had an especially profound effect on one member of our team, Sandy Parakilas. Since joining us in November 2017, Sandy had dedicated himself to our cause, using his experience from Facebook to shed light on the dark side of social media in op-eds and interviews. He had also played a role in the rollout of the Center for Humane Technology. Overnight, Sandy’s role changed dramatically. He went from activist to whistle-blower. From 2011 to 2012, Sandy had been an operations manager for Facebook Platform, home to all third-party applications on the site. Sandy had a uniquely valuable perspective on Facebook’s policies and actions relative to user data privacy and security.

The child of academics in Maine, Sandy grew up wanting to be a jazz drummer. He gave that career a try, then opted for business school in pursuit of a more stable path. Sandy won a national business plan competition to recast the business model of a not-for-profit called One Laptop per Child. That success helped Sandy secure an offer from Facebook, which evolved into a newly created position focused on user privacy. In classic Facebook style, the company installed an inexperienced and untested recent graduate in a position of great responsibility, a position to which other companies would have traditionally assigned someone with meaningful relevant experience. The job did not contribute to growth, which meant it would not be a high priority inside Facebook. In fact, the task of protecting user privacy would internally be viewed as a form of friction—which put Sandy in a very difficult position. To have any chance of success, he had to push back against a core element of Facebook’s culture and make the company embrace at least one form of friction—privacy protection—that almost certainly would have at least a small negative impact on growth. It did not take long for Sandy to understand that the odds were against him.

In November 2011, early in Sandy’s tenure, Facebook entered into its consent decree with the FTC to settle an eight-count complaint about material misrepresentations to users with respect to privacy. The complaint included a long list of Facebook misrepresentations, beginning in 2009. In some cases, Facebook promised one thing and did the exact opposite. In others, Facebook made commitments to regulators that it did not keep. According to the FTC’s press release:

The proposed settlement bars Facebook from making any further deceptive privacy claims, requires that the company get consumers’ approval before it changes the way it shares their data, and requires that it obtain periodic assessments of its privacy practices by independent, third-party auditors for the next 20 years.

The spirit of the settlement is obvious, and the original deal with Aleksandr Kogan was one of many that appeared to violate it.

With respect to the sharing of user data, the consent decree seemed to offer Facebook two options: it could eliminate the tool for harvesting friends lists and/or it could create a team to enforce the consent decree by monitoring and auditing third-party developers. According to Sandy, at the time Facebook did neither. Sandy’s requests for engineering resources to enforce the decree were denied with an exhortation to “figure it out.” In the end, the consent decree’s enforcement provision gave Facebook a “get out of jail free” card. The FTC allowed Facebook to both pick and pay the third-party auditor whose certification of compliance with the consent decree would be required. Facebook did not have to worry about compliance. It received passing grades every time, even as it failed to comply with the spirit of the decree.

At Facebook, figuring it out is a way of life. The company got its start with a bunch of Harvard undergraduates who knew how to code but had almost no experience with anything else. They figured it out. Each new wave of employees followed the same path. Some took too long and were pushed out. The rest got comfortable with the notion that experience was not helpful. At Facebook, the winners were people who could solve any problem they encountered. The downside of this model is that it encourages employees to circumvent anything inconvenient or hard to fix.

In the run-up to Facebook’s May 2012 IPO, the company scrutinized every aspect of its business. A series of privacy issues emerged that related to Facebook Platform, specifically to the tool that enabled third-party apps to harvest data from users’ friends. As Sandy describes it, Facebook’s lack of commitment to user data privacy created issues of disclosure and legal liability that could and should have been addressed before the initial public offering. That did not happen. Recognizing that Facebook did not intend to enforce the spirit of the FTC consent decree—and would blame him if ever there was bad press about it—Sandy quit his job.

Two years later, the person who occupied Sandy’s position as operations manager for Facebook Platform approved Aleksandr Kogan’s application to use a personality test to harvest friends data for academic research. Eighteen months after that, the person in that position sent a letter to Kogan and Cambridge Analytica in response to the article in The Guardian, ordering them to destroy the data set and certify that they had done so. While I have no proof one way or the other, I hypothesize that Facebook’s commitment to enforcing the spirit of the FTC consent decree was no greater in 2014 than it was during Sandy’s time at the company. If it had been greater, they almost certainly would have exercised their right to audit and inspect Kogan and Cambridge Analytica to ensure compliance.

The Cambridge Analytica story caused our team to rethink everything we knew about two things: the number of people who might have been affected by Facebook’s casual approach to privacy and the company’s role in the 2016 presidential election. On privacy, we had one terrifying data point: Facebook disclosed that there were nine million applications on Facebook Platform at the time of the IPO in 2012. In theory, all of them might have attempted to use the tool for friend harvesting. We knew that wasn’t true because many of the “applications” were single pages created by third parties, designed to communicate a message rather than gather data. If only 1 percent of the apps on Platform harvested friends data, however, that would still have been ninety thousand applications. Sandy confirmed that during his tenure, the number of apps that harvested data was in the tens of thousands. The program continued for two years after Sandy left, so the number may have grown.

And as bad as the Cambridge Analytica harvest was, it was nowhere near the largest. The problem, as Sandy described it, was that some of the applications that harvested data were huge. Games like CityVille and Candy Crush had peak user bases that approached one hundred million players worldwide, including perhaps a quarter of all users in the United States. If games like CityVille and Candy Crush harvested friends data, they would have captured nearly every user in the US many times over. Lots of applications had one million users, and every one would have had access to the friends lists of four times as many Facebook users as Cambridge Analytica. The odds that any Facebook user in the 2010–14 period escaped data harvesting are vanishingly small.

Other than a handful of tweets from executives like Alex Stamos, Facebook kept quiet for five days after the Cambridge Analytica story broke. The only news from Facebook also related to Stamos, who announced that he planned to leave the company in five months. Journalists and industry people speculated about whether Stamos was being fired or was leaving voluntarily, but he departed Facebook on August 17 to join the faculty at Stanford. There were several data points to suggest that Stamos had pushed for greater transparency with respect to Facebook’s role in the 2016 election but had been overruled by Sheryl Sandberg and Elliot Schrage. A few journalists noted that Stamos’s own history made him less sympathetic than he might have been. For example, he led Yahoo’s security team when that company built a tool to scan all incoming email on behalf of US intelligence agencies. No internet platform had ever acceded to such a broad request before, and Yahoo was heavily criticized.

When he finally broke his silence after five days, Zuck apologized for “a breach of trust between Facebook and the people who share their data with us and expect us to protect it.” As reported in The Guardian, Zuck sounded remorseful.

“We have a responsibility to protect your data, and if we can’t then we don’t deserve to serve you,” Zuckerberg wrote. He noted that the company has already changed some of the rules that enabled the breach, but added: “We also made mistakes, there’s more to do, and we need to step up and do it.”

Zuck promised to change Facebook’s rules for sharing data with third-party applications, a promise that rang hollow because the company had eliminated the tool for harvesting friends data in 2014 and could not recapture harvested data. Once the profiles left Facebook, they could have gone anywhere. They could have been copied over and over. And no one knew where the data sets and copies had gone. Could a copy of the Cambridge Analytica data set have found its way to Russian groups like the Internet Research Agency?

In the context of Sandy’s experience, one conclusion was inescapable: Facebook had not protected user data privacy because sharing data broadly was much better for its business. Third-party applications increased usage of Facebook—time on site—a key driver of revenue and profits. The more time a user spends on Facebook, the more ads he or she will see and the more valuable that user will be. From Facebook’s perspective, anything that increases usage is good. They seemingly never considered the possibility that what they were doing was wrong.

Journalists and policy makers expressed outrage at Facebook’s failure to respond formally to the story for five days. Members of Congress and the UK Parliament called for Zuck to testify under oath. The analyst in me could not help but notice that the story of Facebook’s role in the 2016 election had unfolded with one consistent pattern: Facebook would first deny, then delay, then deflect, then dissemble. Only when the truth was unavoidable did Facebook admit to its role and apologize. Suddenly, a lot of people understood that apologies had been a standard part of Facebook’s public relations tool kit from Zuck’s days at Harvard. Zeynep Tufekci, a brilliant scholar from the University of North Carolina, framed Facebook’s history as a “fourteen-year apology tour.” I reflected that it might be time to tweak Facebook’s corporate motto:

Move fast, break things, apologize, repeat.

Zuck embarked on a charm offensive, beginning with interviews with The New York Times, CNN, and the tech blog Recode. As I watched and read the interviews, I could see why Zuck had waited five days before speaking. He wanted to be prepared. He must have concluded that the damage from bad answers would be greater than that from five days of silence. There is no way to rerun the experiment, but at the time, it seemed that waiting five days increased the brand damage to Facebook, Zuck, and Sheryl; and Zuck’s performance in the interviews did not reduce the pressure on Facebook.

The following day, Sheryl began her own apology tour. As the former chief of staff to the secretary of the Treasury, Sheryl has years of experience at the highest levels of politics. As the chief operating officer of Facebook and a board member of the Walt Disney Company, she has been exposed to the widest possible range of business executives and situations. As a bestselling author, she has built a brand with consumers. In all these contexts, she has demonstrated exceptional communications skills. Back in the fall of 2017, in the first interview she did about Russia’s use of Facebook to interfere in the 2016 election, Sheryl gave a master class in crisis management communications. She looked and sounded sincere, she was convincing, but when I reviewed the transcript, it was obvious she had not admitted anything substantive or committed Facebook to any material change. This made her failure in the first post–Cambridge Analytica interviews shocking. As Zuck had done, Sheryl seemed to choose interviewers who might not probe deeply. It didn’t help. She left a bad impression. Several people who knew Sheryl only by her excellent reputation expressed surprise that she came across so poorly, so lacking in sincerity. Industry professionals responded in one of two ways. Most seemed to want the controversy to go away so they could go back to making money. The relatively small number who were troubled by Facebook’s behavior expressed shock that Sheryl could be so unconvincing.

Sheryl Sandberg knows she is capable of achieving any goal to which she commits herself. People who know Sheryl well cannot help but agree. Her talents are exceptional. Ever since her career began, Sheryl has carefully cultivated her public image, controlling every aspect of it, moving from government to business to philanthropy to family. Sheryl’s brilliant career did not come without collateral damage to some unfortunate people in her orbit, but in the culture of Silicon Valley, such damage comes with the territory. The trick is to appear virtuous when you take advantage of others. Did Sheryl have plans after Facebook that might suffer from the escalating PR crisis? Where another executive might have leaned into the problem, taking a short-term hit in the hope of long-term benefit, Sheryl had chosen to lean out. She seemed to be avoiding the spotlight when it mattered most. A few industry people and journalists I encountered appeared to be enjoying a moment of schadenfreude.

Even after the first salvo of press appearances by Zuck and Sheryl, the pressure on Facebook continued to grow. On March 21, a Facebook user filed a proposed class action lawsuit in San Jose, California. That same day, this showed up on Twitter:

On March 22, a game designer by the name of Ian Bogost published a piece in The Atlantic titled, “My Cow Game Extracted Your Facebook Data.”

For a spell during 2010 and 2011, I was a virtual rancher of clickable cattle on Facebook. . . .

Facebook’s IPO hadn’t yet taken place, and its service was still fun to use—although it was littered with requests and demands from social games, like FarmVille and Pet Society.

I’d had enough of it—the click-farming games, for one, but also Facebook itself. Already in 2010, it felt like a malicious attention market where people treated friends as latent resources to be optimized. Compulsion rather than choice devoured people’s time. Apps like FarmVille sold relief for the artificial inconveniences they themselves had imposed.

In response, I made a satirical social game called Cow Clicker. Players clicked a cute cow, which mooed and scored a “click.”

In creating Cow Clicker, Bogost set out to lampoon FarmVille and the culture that developed around it. In the end, his game triggered the same social forces that had enabled the success of FarmVille. Users got hooked. Bogost got concerned and decided to end the game in an event he called “cowpocalypse.” He returned to real life and apparently did not give much thought to Cow Clicker until the news broke about Cambridge Analytica, when he realized that his app had harvested user and friends data, all of which was still on a hard drive in his office. He had forgotten all about it. It seems unlikely that he is alone in that respect.

Bogost’s article placed a spotlight on an aspect of Facebook’s data security problem that had not received enough public attention to that point: once data leaves Facebook, it is no longer possible to retrieve it, and it may well live on. There is no way now for Facebook to police third parties who harvested data between 2010 and 2014. Someone, somewhere has the data. Maybe not all of it, but most of it. Why wouldn’t they? It still has economic value. Data sets may have been sold or given away. Some may have been destroyed. Nobody knows what happened to all that private user data. And no matter how old a data set may be, if you use it inside Facebook again, it will gain benefit from all the data Facebook has acquired since the day the data set was harvested.

The following day, a second whistle-blower emerged from Cambridge Analytica. Unlike Christopher Wylie, who had been at Cambridge Analytica from the start but left prior to the 2016 election, Brittany Kaiser was a senior executive who worked on both Brexit and the US presidential election. She was a political liberal who had joined the 2008 Obama presidential campaign under Facebook cofounder Chris Hughes and who voted for Bernie Sanders in the 2016 Democratic primary. In becoming a whistle-blower, Kaiser said she wanted to stop telling lies. As quoted in The Guardian, Kaiser shared her motivation:

“Why should we make excuses for these people? Why? I’m so tired of making excuses for old white men. Fucking hell.”

She says she believes that Silicon Valley has much to answer for. “There’s a much wider story that I think needs to be told about how people can protect themselves, and their own data.”

One of the most significant disclosures in the first interview with Kaiser was about how effective Hughes had been at getting Facebook to implement changes that reduced the workload for the Obama campaign. On behalf of Obama’s reelection campaign, Hughes created an application that harvested friends data. The app differed from Kogan’s in that it was honest about its true mission, and the mission itself—encouraging people to vote—was admirable, where voter suppression is not, but data harvesting was just as wrong when the Obama campaign did it as it was when Kogan did it four years later.

Kaiser was working at SCL Group when Alexander Nix created Cambridge Analytica as an affiliate. Kaiser’s experience in the Obama campaign appealed to Nix, who made a case that the next big market opportunity would be to help Republicans catch up to the Democrats in data analytics. Kaiser transferred into Cambridge Analytica and went to work bringing in clients. Her early clients were in Africa, but in 2015 she and Nix shifted their focus to the United States in anticipation of the presidential election cycle. Kaiser asserted that Nix was not a political ideologue—unlike his patrons Robert Mercer and Steve Bannon—and hoped to create a “famous advertising company in the US market.” As quoted in The Guardian:

“Corporations like Google, Facebook, Amazon, all of these large companies, are making tens or hundreds of billions of dollars off of monetising people’s data,” Kaiser says. “I’ve been telling companies and governments for years that data is probably your most valuable asset. Individuals should be able to monetise their own data—that’s their own human value—not to be exploited.”

In her Guardian interview, Kaiser contradicted Cambridge Analytica’s repeated assertions that it had not worked on the Leave campaign during Brexit. Kaiser said that two different organizations affiliated with Leave had entered into data-sharing relationships with Cambridge Analytica. No money had changed hands, she said, but there had been an exchange of value. The Guardian explained that such an exchange may have violated UK election law.

The Cambridge Analytica story was growing into a tsunami. Notwithstanding Brexit, the UK government still knew how to conduct an investigation. In all probability, it would not be so easy for Facebook to deflect as the US Congress had been at the hearings in October and November. Facebook was already struggling to manage all the bad news. The threat from the UK would make that much harder.

11

Days of Reckoning

Facebook’s Cambridge Analytica scandal has everything: peculiar billionaires, a once-adored startup turned monolith, a political mercenary who resembles a Bond villain and his shadowy psychographic profiling firm, an eccentric whistleblower, millions of profiles worth of leaked Facebook data, Steve Bannon, the Mercers, and—crucially—Donald Trump, and the results of the 2016 presidential election. —CHARLIE WARZEL

The United States has many laws and regulations that limit corporate behavior. Passing laws and creating regulations requires enormous effort that happens only in cases of major violations of community standards. Companies are not allowed to dump toxic materials without a permit because society at one time recognized that the consequences of doing so produced unacceptable costs in the form of pollution and damage to public health. Financial institutions are allowed to use customer deposits only in legally authorized ways. Doctors and lawyers are not allowed to share private information provided by clients except in a limited number of strictly specified situations. Companies chafe at regulation, but most accept that rules are a form of friction necessary to protect society. Most executives appreciate the notion that society has the right to limit economic freedom in the interest of the public good, but a tension remains between the freedom of business and the rights of society. Few want limits on their business, and most large businesses retain professional lobbyists and other advocates to protect their interests in the halls of government and in public opinion.

In capitalism, there should be a symbiotic relationship between government and business. Businesses depend on the rule of law, especially property law, to protect their assets. They depend on the government to set the rules and enforce them. In a democracy, the central tension is over which constituencies should have a voice in rule setting. Should it be a private negotiation between businesses and policy makers? Should employees have a voice? How about the communities where businesses operate? Who will protect customers? The aphorism “Let the buyer beware” is helpful, but what happens when the actions of a business affect people who are not customers? These are situations for which laws and regulations exist.

At the federal level, laws are made by Congress and interpreted by courts. To implement laws, agencies in the executive branch create regulations. For example, the Federal Trade Commission regulates consumer protection and aspects of antitrust related to business practices. The Department of Justice addresses antitrust issues related to mergers and large-scale anticompetitive behavior, among many other things. The Department of Labor protects employees. The formulation of new regulations usually involves input from a wide range of constituencies, including the affected businesses. In many cases, businesses are successful at narrowing the scope of regulation from the intent of the original legislation. Each executive-branch agency’s mission has evolved in response to new issues, and periodically the country reframes its approach to regulation. The fifty states also play a role in setting the rules that govern business. California conspicuously leads the country in environmental regulations. As the fifth-largest economy in the world, California has unique leverage to enforce emissions standards and other regulatory priorities. Many states have implemented laws and regulations to fill perceived holes at the federal level.

Relative to internet platforms, one conspicuous hole in federal laws and regulations relates to privacy. There is no federal right to privacy in the United States. For most of the country’s history, that did not seem like a problem. The Fourth Amendment, which provides protection against unlawful search and seizure, is the closest thing to privacy protection offered in the Constitution. As a result of the privacy gap, many states have implemented privacy-protection laws and regulations to safeguard their citizens.

The current era of federal deregulation has lasted long enough that few business leaders have experience with any other philosophy. Few imagine that regulations can play a constructive role in society by balancing the interests of the masses with those of the rich and powerful. Over time, some regulations become obsolete, but the notion that government “is the problem” overlooks the fundamental importance of sound rules and impartial enforcement to the success of capitalism.

Today, there are few rules and regulations that limit the business activities of internet platforms. As the newest generation in an industry with a long track record of good corporate behavior and products that made life better for customers, internet platforms inherited the benefits of fifty years of trust and goodwill. Today’s platforms emerged at a time when economic philosophy in the United States had embraced deregulation as foundational. The phrase “job-killing regulations” had developed superpowers in the political sphere, chilling debate and leading many to forget why regulations exist in the first place. No government or agency creates a regulation with the goal of killing jobs. They do it to protect employees, customers, the environment, or society in general. With an industry like tech, where corporate behavior had been relatively benign for generations, few policy makers imagined the possibility of a threat. They focused on industries with a history of bad behavior and rule breaking. They focused on harms they could see.

Customers expect products and services to provide good value for their money, but the public generally does not look to business for moral leadership. They expect that businesses will compete for profits, taking advantage of whatever tools are available. When harmed by corporate actions, people get angry, but most feel powerless in the face of wealth and power. They feel that different rules apply to the powerful, which is demonstrably true, but there are limits to the harm a business can do without punishment. Even the rich and powerful face legal or regulatory action if they go too far. By the spring of 2018, policy makers and the public were engaged in a lively debate about the internet platforms. Should there be limits on Facebook, Google, and others? Had they gone too far?

If the data set that Cambridge Analytica misappropriated from Facebook had not played a role in the 2016 presidential election, policy makers and the public might have dismissed the story of misappropriated user data as “businesses being businesses.” If Facebook employees had not worked with Cambridge Analytica inside the Trump campaign only months after the data-misappropriation scandal first broke in December 2015, Facebook might have had a viable alibi. As things worked out, though, the whole world caught a brief glimpse of an aspect of Facebook that the company had taken pains to hide.

The news hit hard because most users love Facebook. We have come to depend on it. Facebook is not just a tech platform; it has taken on a central role in our lives. As consumers, we crave convenience. We crave connection. We crave free. Facebook offers all three in a persuasive package that offers enough surprise and delight to cause us to visit daily, if not more often. It enhances birthdays, provides access to a wide range of content, and is always available. It enables activists to organize events. Even ads on Facebook can be useful. Cambridge Analytica filled in an unwritten portion of the Facebook story related to the true cost. Convenience and connection on Facebook may not have a sticker price, but they are not free. The downstream costs are substantial but not apparent until something goes wrong, which it has done with alarming frequency since Facebook’s founding in 2004. Careless sharing of personal data is terrible, but the story underscored a bigger problem: user data is feeding artificial intelligences whose objective is to manipulate the attention and behavior of users without their knowledge or approval. Facebook’s policy of allowing third-party app vendors to harvest friends lists, its tolerance of hate speech, its willingness to align with authoritarians, and its attempts to cover up its role in the Russian election interference are all symptoms of a business that prioritized growth metrics over all other factors.

Was this not just business as usual? Even if the country does not approve of Facebook’s choices, do the offenses rise to a level that requires regulatory intervention? Would regulation cause more harm than good? In debating these questions, countries are coming to terms with their disappointment in internet platforms. The fact that we never expected to face these questions makes them especially challenging, but to do nothing would be to turn over stewardship of democracy, public health, privacy, and innovation to a company, and one with a terrible track record.

Facebook has done a brilliant job of converging the virtual world with the real world, but to do so, it has had to rearrange key elements of the social fabric. It has transformed the way people see the world by enabling more than two billion users to have their own reality. It has changed the nature of community by allowing people to sort themselves into like-minded groups where they never have to engage with other viewpoints. It has altered relationships by promoting digital interaction as an alternative to real life. It has manipulated users’ attention to increase their level of engagement. It has enabled bad actors to manipulate users and do harm to innocent people on a giant scale. It has provided a platform to bad actors to undermine democracy. Thanks to Cambridge Analytica, users finally had a sense of how much Facebook knew about them and what they did with that knowledge. Users did not like what they learned. Facebook treated private user data as a pawn to be traded for its own advantage.

It is no exaggeration to say that Facebook is one of the most influential businesses in history. Facebook’s failures have a profound impact. Hate speech can have fatal consequences, as has been the case in Myanmar and Sri Lanka. Election interference can undermine democracy and change history, as has been the case in the United States and possibly the United Kingdom. When such things happen offline, we send in the police. When they happen online, what is the correct response? How long can we afford to trust Facebook to regulate itself?

Journalists continued to expose examples of Facebook abusing its users’ trust. Another disturbing story revealed that users of Facebook on Android discovered their phone data—calls, texts, and other metadata—had been downloaded by Facebook. Presumably Facebook just added the Android data to its oceans of user data. Users had no idea it was happening. While the insecurity of Android has been common knowledge in the industry, it has not prevented the operating system from dominating the cell phone market, with a global share in excess of 80 percent. Like the Cambridge Analytica story, the Facebook/Android news made a security threat real for millions of users.

Now that reporters and users were looking for it, they found examples of bad behavior every day. A particularly ugly example emerged on March 29 in a story from BuzzFeed. It described an internal Facebook memo written in January 2016 by Vice President of Advertising Andrew Bosworth, entitled “The Ugly.” Written the day after a Facebook Live video captured the shooting death of a man in Chicago, the memo justified Facebook’s relentless pursuit of growth in sinister terms.

“We connect people. Period. That’s why all the work we do in growth is justified. All the questionable contact importing practices. All the subtle language that helps people stay searchable by friends. All of the work we do to bring more communication in. The work we will likely have to do in China some day. All of it,” VP Andrew “Boz” Bosworth wrote.

“So we connect more people,” he wrote in another section of the memo. “That can be bad if they make it negative. Maybe it costs someone a life by exposing someone to bullies.

“Maybe someone dies in a terrorist attack coordinated on our tools.”

When the article came out, Boz attempted damage control:

I don’t agree with the post today and I didn’t agree with it even when I wrote it. The purpose of this post, like many others I have written internally, was to bring to the surface issues I felt deserved more discussion with the broader company. Having a debate around hard topics like these is a critical part of our process and to do that effectively we have to be able to consider even bad ideas, if only to eliminate them. To see this post in isolation is rough because it makes it appear as a stance that I hold or that the company holds when neither is the case. I care deeply about how our product affects people and I take very personally the responsibility I have to make that impact positive.

The memo took my breath away. What was he thinking? How could anyone say something like that? What kind of company thinks such language is acceptable? Boz is one of the keepers of the Facebook culture. He is a thought leader inside the company who is known to say provocative things. When he writes a memo, every recipient reads it right away. More important, they take it seriously. Facebook may be much more than Boz’s memo and tweet, but the memo and tweet reflect the Facebook culture. The message was clear: the culture of Facebook revolves around a handful of metrics, things like daily users, time on site, revenues, profits. Anything that is not explicitly on the list is definitively off the list. No one at the company allowed him- or herself to be distracted by downstream consequences. They have a hard time imagining why downstream consequences should be Facebook’s problem. Boz’s memo and tweet were a coup de grace to my idealism about Facebook. The only silver lining was that someone had leaked the memo to the press. If it was an employee, that might signal internal recognition that some of Facebook’s internal policies were harmful to society and that management’s refusal to cooperate with authorities in the face of clear evidence justified whistle-blowing. Even if the whistle-blower turned out to be a Facebook alum, that was still good news. I have been told the memo came from an alum, but I have been unable to confirm that.

Why don’t Facebook employees blow whistles on the company’s bad behavior? Why don’t users abandon the platform in protest? I cannot explain the behavior of employees, but I understand users. They crave convenience and utility. They struggle to imagine that they would ever be victims of manipulation, data security breaches, or election interference, much less what those things would mean to them. They don’t want to believe that the screens they give their children might be causing permanent psychological harm. Elected officials like the campaign technology and contributions they get from Silicon Valley. They like that tech is popular with voters. Confident that they would never need it, policy makers have not developed the expertise necessary to regulate technology. Intelligence agencies do not appear to have anticipated the possibility that the country’s enemies might weaponize internet platforms to harm the United States. As a result, no one was prepared for election interference, hate speech, and the consequences of addiction. Major technology companies have exploited both users’ trust and the persuasive technology in their platforms to minimize political fallout and protect their business models. Until Cambridge Analytica, it worked.

As new stories emerged almost daily that reinforced the narrative that Facebook had failed at self-regulation, Zuck rejected calls for heads to roll, saying that he was the best person to run the company and was responsible for what had gone wrong. The Washington Post reported on a Facebook admission that “malicious actors” had exploited the search tools on its platform to “discover the identities and collect information on most of its 2 billion users worldwide.” Then we learned that a change Facebook made in the way that third-party apps interact with its system had inadvertently locked people out of Tinder, a dating app that uses Facebook for authentication and other personal data. (This story soon seemed like foreshadowing when, a month later, Facebook announced a dating application.) On April 4, Facebook announced the first revision to its terms of service since 2015. The bulk of the changes related to disclosures with respect to privacy and the handling of user data. Small steps, but progress. Public pressure was working.

One particularly awkward story that week revealed that Facebook had been deleting Zuck’s Messenger messages from the inboxes of recipients, a feature not available to users. Facebook initially claimed it made the change for security purposes, but that was patently unbelievable, so the next day it announced plans to extend the “unsend” feature to users. The company then announced greater transparency for political ads, following the model of the Honest Ads Act introduced by Senators Mark Warner, Amy Klobuchar, and John McCain but extending it to include ads supporting issues as well as candidates. Uniquely among Facebook’s recent changes, this one stood out for being right on substance, as well as on appearances. While false flag ads had played a relatively small role in the Russian interference in 2016, that role had been essential to attracting American voters into Russian-organized Facebook Groups, which in turn had been a major tool in the interference. If the new Facebook policy eliminated false flag ads, that would be a very good thing.

With pressure building, journalists and technologists seemed nearly unanimous in their view that members of Congress did not understand technology well enough to regulate it. Many suggested that regulating technology was a fool’s errand in any case, as it would distort the marketplace in a way that protected the largest incumbents at the expense of smaller players and startups. That concern was valid but argued for care in formulating regulations, not for laissez-faire. Congress’s lack of experience in regulating tech does not absolve it of its responsibility to protect Americans from the failures of the marketplace. In reality, tech is less complicated than health care, banking, and nuclear power. It just changes faster. Every time a new industry requires regulation, Congress must get up to speed. The challenge would be to develop the necessary skills quickly. This would not be the first time Congress faced that challenge.

Public pressure produced more concessions from Facebook, which announced additional policy and product changes in an attempt to appear cooperative and preempt regulatory action. As usual, the announcements featured sleight of hand. First, Facebook banned data brokers. While this sounded like a move that might prevent future Cambridge Analyticas, what it actually did was move Facebook closer to a data monopoly on its platform. Advertisers acquire data from brokers in order to improve ad targeting. By banning data brokers, Facebook forced advertisers to depend entirely on Facebook’s own data. As the month of March ended, Facebook posted on its blog an update about its effort to prevent future election interference. The post focused on Facebook’s plans to stop bad actors from hiding behind false identities, as well as a new initiative to anticipate interference rather than waiting for users to report it. While the announcement included a new program to target disinformation, the change to News Feed in January that reduced the weight of journalistic sources almost certainly made at least one aspect of preventing interference—the piercing of filter bubbles—much harder.

Zuck agreed to testify at two congressional hearings—a joint session of the Senate Judiciary and Commerce committees, the other with the House Committee on Energy and Commerce—but refused to appear before the UK Parliament.

The hearings began on the afternoon of April 10 in the Senate. Zuck arrived in a suit, shook lots of hands, and settled in for five hours of questions. The combined committees have a total of forty-five members. Each senator would have only four minutes, which favored Zuck, who prepared well for the format. If he could be long-winded with each answer, Zuck might be able to limit each senator to only three or four questions. Perhaps more important, the most senior members of the committee went first, and they were not as well prepared as Zuck. Whether by luck or design, Facebook had agreed to appear on the first day after a two-week recess, minimizing the opportunity for staff members to prepare senators. The benefits of that timing to Facebook were immediately obvious. Several senators did not seem to understand how Facebook works. Senator Orrin Hatch asked, “How do you sustain a business model in which users don’t pay for your service?” revealing his ignorance about Facebook’s advertising business model. Armed with a cheat sheet of diplomatic answers, Zuck patiently ran out the clock on each senator. Senators attempted to grill Zuck, and in the second hour, a couple of senators asked pointed questions. For the most part, Zuck deflected. Zuck also benefited from a lack of coordination among the senators. It seemed that each senator addressed a different issue. Perhaps a dozen different problems emerged, each of which might have justified its own hearing.

Early in the third hour, Zuck caught a lucky break: networks interrupted their coverage to reveal that the FBI had raided the home and office of Donald Trump’s personal attorney, Michael Cohen. News outlets pivoted instantly. Hardly anyone saw the rest of the Senate hearing or any of the House Committee on Energy and Commerce hearing the next day. For the five-hour House hearing, Zuck used the same “run out the clock” strategy. Without a big TV audience, it probably didn’t matter, but the Democratic House members landed some punches. Several coordinated their questions, some of which caught Zuck unprepared. Representative Frank Pallone of New Jersey pushed Zuck for a yes-or-no answer as to whether Facebook would change its default settings to minimize data collection. Zuck equivocated. He would not answer Pallone directly, presumably because Facebook has no intention of minimizing data collection. For Zuck, the hearing went downhill from there.

Representative Mike Doyle of Pennsylvania focused on Cambridge Analytica and the harvesting of user data. In response to a question from Doyle, Zuck claimed that he first learned that Cambridge Analytica had acquired the data set when The Guardian reported the story in December 2015. Doyle gently suggested that perhaps Facebook was not paying attention to such things. He observed, “It seems like you were more concerned with attracting and retaining developers on your platform than you were with ensuring the security of Facebook user data.”

Representative Kathy Castor of Florida grilled Zuck on the breadth of the company’s data collection, both on and off the platform.

“For all of the benefits that Facebook has provided in building communities and connecting families, I think a devil’s bargain has been struck,” she said. “And, in the end, Americans do not like to be manipulated. They do not like to be spied on. We don’t like it when someone is outside of our home, watching. We don’t like it when someone is following us around the neighborhood or, even worse, following our kids or stalking our children.

“Facebook now has evolved to a place where you are tracking everyone. You are collecting data on just about everybody. Yes, we understand the Facebook users that—that proactively sign in, they’re in part of the—that platform, but you’re following Facebook users even after they log off of that platform and application, and you are collecting personal information on people who do not even have Facebook accounts. Isn’t that right?”

According to Politico, Castor’s questioning left Zuck “looking particularly on edge.” She focused on a foundational element of Facebook’s business: when it comes to data privacy, user choice is an illusion. The terms of service protect Facebook, not the user. Castor’s questions revealed that she recognized Congress has a duty to address digital surveillance to protect consumers.

Representative Ben Luján of New Mexico dug much deeper into the issue of data collection. When Zuck professed not to know how many data points Facebook had on the average user, Luján told him: twenty-nine thousand. Luján also pinned Zuck down on a paradox: Facebook collects data on people who do not use the platform and have no ability to stop Facebook from doing that without themselves joining Facebook.

Representative Joe Kennedy of Massachusetts focused on metadata. His questions reflected concern that users have no idea how much data Facebook collects or that metadata can be used to paint a detailed picture of the user. Kennedy’s questions highlighted that users have some control over the content they post on Facebook but not over the metadata created by their activity, which is the fuel for Facebook’s advertising business.

The House hearing exposed the extent of Facebook’s data collection and its lack of regard for user privacy. For those who watched the hearing, it seemed that Facebook has lots of policies that are designed to protect the company from legal challenges without actually accomplishing anything else. When challenged, Zuck often professed ignorance. He repeatedly promised to have his staff follow up with a response. He apologized for Facebook’s lapses. It didn’t matter. The verdict in the press—and on Wall Street—was formed in the first hour of the Senate hearing, and it was nearly unanimous: Zuck had exceeded expectations, while Congress fell short. Many commentators cited the hearings as evidence that Congress lacked the sophistication necessary to regulate technology. Based on follow-up meetings with members, I learned that the Democrats in Congress recognized the need for real oversight of internet platforms. To prepare, they needed help from experts without conflicts and asked if our team could help. The age of innocence was over.

12

Success?

Everybody gets so much information all day long that they lose their common sense. —GERTRUDE STEIN

Months of daily revelations about Facebook’s business model and choices drove the conversation about the dark side of social media into the public consciousness, but that did not mean users understood why it should matter to them. Facebook had announced product and policy changes in response to public pressure, but the threat to public health, democracy, privacy, and innovation remained. Reforming the behavior of internet platforms remained an uphill battle. To use the ascent of Everest as an analogy, we had hiked to an elevation of 17,598 feet and had only reached Base Camp. The hard part is in front of us.

Internet platforms still enjoyed a massive reservoir of goodwill with policy makers and the public, and they leveraged it where they could. Their challenge was made easier by the wide range of harms. It was hard to keep up. Anecdotes like Cambridge Analytica, Russian election interference, ethnic cleansing in Myanmar, and the rising suicide rate among teens attracted attention, but most users could not understand how products they trusted could possibly have caused so much harm. Understanding how the choices made by internet platforms had caused these things to happen would require more time and effort than most users were willing to commit. Figuring out what to do about it would be even more challenging.

Tech had become so powerful that by pointing it at the weakest links in human psychology, platforms could manipulate their users’ attention for massive profit. Whether they acknowledged it or not, the platforms had demonstrated the ability to influence huge groups, including whole countries. Policy makers and the public had to decide whether this kind of business activity violated societal norms. Scientists have the ability to create deadly viruses, but society does not permit them to do so, except in carefully controlled research settings. Financial services businesses have the ability to defraud their customers, but society does not allow that either. What should be the limits, if any, on internet platforms? The next phase of the conversation needed to address the proper role of internet platforms in society. How far should platforms be allowed to go in exploiting human weakness? How much responsibility should they bear for harm that results from their products and their business model? Should platforms bear fiduciary responsibility for the user data they hold? Should there be limits on the exploitation of that data?

The issues go far beyond Facebook. Google’s surveillance engine gathers more data on users than any other company. YouTube has become the nexus for recruiting and training extremists. It is home to countless conspiracy theories. It hosts age-inappropriate content targeting little children. Instagram and Snapchat magnify the anxieties of teenagers in ways both small and large. But as the dominant social network, Facebook has benefited most from exploiting the lack of awareness and regulation of online business practices. Its scale magnifies its failures. Not all of the most extreme problems are on Facebook, but the platform has been a magnet for bad actors because of its reach, its unguarded nature, and its cultural indifference to the downstream consequences of its actions.

With 2.2 billion active users, Facebook rivals the world’s largest religion in terms of scale, and that number does not include its subsidiary platforms. It has huge influence in every country in which it operates. In some countries, like Myanmar, the internet essentially is Facebook. The persecution of the Rohingya minority continues in that country, and Facebook has been cited by United Nations investigators for enabling “ethnic cleansing.” In August 2018, Reuters released a special report that uncovered more than “1,000 examples of posts, comments, and pornographic images attacking the Rohingya and other Muslims” even after the platform had taken steps to prevent hate speech in Myanmar. Later that month, Facebook banned Myanmar military accounts from the site. While the ban is unlikely to prevent hate speech in Myanmar, it is nonetheless historic. It is the first time that I am aware of that Facebook acted against the powerful on behalf of the powerless. Until there is evidence to the contrary, I will assume the ban reflects a short-term desire for a public relations win rather than a major change in Facebook policy.

Despite a huge increase in focus and resources, there is no indication yet that Facebook has been able to stop the hate speech on its platform in Myanmar or any other country. As a result, the Rohingya continue to suffer and die. In the United States, Facebook has become the most important platform for news and politics. The impact of Facebook on public discourse is unprecedented, thanks to its Truman Shows, filter bubbles, and manipulation of attention. No one elected the employees of Facebook, but their actions can have a decisive impact on our democracy. In almost every democracy, Facebook has become an unpredictable force in elections. For authoritarian regimes, Facebook has become a preferred tool for controlling the citizenry. This has been demonstrated in both Cambodia and the Philippines. The government of China is taking the idea to its limit, creating a social media platform based on “social credit,” which rewards users for actions approved by the government, while penalizing actions that are not approved. The goal of the Chinese project appears to be behavior modification on a national scale.

When the conversation about the appropriate role of internet platforms began in 2017, Facebook chose to fight rather than listen to its critics. It tried to bluff its way past criticism and failed. Facebook suffered some brand damage but did not alter its course. The pressure grew, and Facebook responded, first with small changes to its business practices, then with larger ones. I have no doubt that by the middle of 2018 Facebook was doing its best to fix many of the problems that have come to light, but only did so in ways that protect its business model and growth. At this writing, it has not made the fundamental changes necessary to prevent future election interference, limit manipulation of its users by third parties, prevent hate speech, or protect users from the consequences of Facebook’s willingness to share user data. These issues are now known, if not fully understood. The question is whether policy makers and users will insist on change.

After Zuck’s performance at the hearings, Facebook may have concluded that the storm had passed. Confirmation came a couple of weeks after the hearings, when Facebook reported earnings for the first quarter of 2018. It was a blowout. Facebook’s key metrics showed big improvement. Revenue for the quarter came in just below $12 billion, half a billion more than analysts had forecast. Profits jumped 63 percent. Monthly active users of 2.2 billion and daily active users of 1.47 billion both rose 13 percent from the prior year. The company finished the quarter with forty-four billion dollars in cash and marketable securities. On the conference call with investors, Zuck made a quick reference to the hearings and Cambridge Analytica, but anyone expecting a mea culpa would have been disappointed. In combination with the reviews of his testimony before Congress, the earnings report restored Zuck to his happy place. Everything about his conference call remarks proclaimed that Facebook had returned to business as usual. Investors could not have been happier. The stock jumped 9 percent the next day.

But bad news continued to surface, including stories about illegal ivory trading on Facebook and fake Facebook pages that scammed Vietnam veterans. As late arrivals to a riot of bad behavior, the new stories had little impact. They were joined by a second, more analytical wave of postmortems from the congressional hearings that took some of the shine off Zuck’s performance, at least with policy makers.

The Washington Post published a lengthy article that fact-checked Zuck’s testimony. It detailed the way that Zuck repeatedly reframed questions to hide as many of Facebook’s unattractive behaviors as possible. For example, when asked questions about users’ ability to access the data Facebook has about them, Zuck focused exclusively on content data, which is generally accessible, avoiding wherever possible any reference to the metadata that drives its advertising business and is generally not viewable or manageable by users. He was extremely effective at this kind of reframing, particularly in the Senate hearing. The public probably missed this story, but the members of Congress charged with oversight did not.

Those of us who believe in democracy, who want to protect public health and privacy and encourage innovation, understood we have a long journey in front of us. Facebook had come through two huge scandals—the Russian interference and Cambridge Analytica—and two sets of congressional hearings, with only a few dings in its reputation to show for it. The business itself was running at full speed, unimpeded by all the criticism. It was going to take a lot more than a scandal and some hearings to persuade Facebook to make the fundamental changes necessary to protect users from harm.

The truth of this insight became obvious the first week of May, at F8, Facebook’s annual conference for third-party developers. For Zuck and Facebook, F8 was a triumph. Zuck mentioned Cambridge Analytica, but it occupied roughly the same proportion of his speech as vermouth in a very dry martini at the bar of a private club. Otherwise, the event was a wall-to-wall lovefest. Developers showed zero concern about the recent scandals. Facebook exhibited no remorse. If anything, the company behaved as if surviving the crisis had made it stronger. Perhaps it had.

Facebook announced new product initiatives at F8, including a dating service and Clear History, a tool for seeing and erasing the browsing data the company has accumulated on you. The dating service offered a new wrinkle to the market—a focus on events—and had an immediate impact on the market leader, Match.com, which owns the eponymous site, as well as Tinder. Match’s stock dropped 22 percent when the news broke, in no small measure because its sites, as well as those of competitors, had long leveraged Facebook for user authentication and data. As music apps, games, and news publishers before it had learned the hard way, trusting Facebook to be a good partner generally leads to disappointment. Eventually Facebook will undermine the economics of your business.

Clear History may be a great idea, but Facebook’s recent behavior also suggested the possibility that the announcement was just another public relations stunt. Facebook deploys trackers—tiny pieces of code dropped into the browser—to follow users around the web. They do this not only from their various platforms but also from the Facebook Connect log-in tool and the millions of Like buttons that are sprinkled all across the World Wide Web. For users who leverage Facebook credentials to log in to other sites and touch Like buttons where they go, this translates into a massive trove of browsing history and metadata that can be used to construct a high-resolution image of the user that proved to be the key to making Facebook’s advertising valuable. In offering users a Clear History app, Facebook is signaling one of two things: either it is finally taking user concerns about privacy to heart, or it no longer needs to maintain browser histories in order to sell ads. The former would be amazing, but I do not think we can rule out the latter. Either way, public pressure helped to bring it about.

In a conversation with Representative Joe Kennedy days after the House hearing, Zuck indicated that Clear History would apply to metadata as well as links, which would represent a huge departure from recent practice and a genuine benefit to users. Skeptics point to a more ominous explanation. Facebook has been using its massive store of user data to train the behavioral-targeting engine of its artificial intelligence. In the early phases of training, the engine needs every piece of data Facebook can find, but eventually the training reaches a level where the engine can anticipate user behavior. Perhaps you have heard anecdotes about people saying a brand name out loud and then seeing an ad for that brand on Facebook. The users assume Facebook must be using their device’s microphone to eavesdrop on conversations. That is not practical today. A more likely explanation is that the behavioral-prediction engine has made a good forecast about a user desire, and the brand in question happens to be a Facebook advertiser. It is deeply creepy. It will get creepier as the technology improves. Once the behavioral-prediction engine can forecast consistently, it will no longer need the same amount of data that was required to create it. A smaller flow of data, much of it metadata, will get the job done. If that is where we are, letting users clear their browsing history on Facebook would provide the illusion of privacy, without changing Facebook’s business or protecting users.

From our first days together, Tristan convinced me that among the many dark sides of social media, artificial intelligence engines might pose the greatest threat to society. He argued that the AIs of companies like Facebook and Google have insurmountable advantages: infinite resources and scalability; an exceptionally detailed profile of more than two billion users (including, in Facebook’s case, a deep understanding of emotional triggers); a complete picture of each user’s location, relationships, and activities; and an economic incentive to manipulate user attention without regard to consequences. Effectively the AI has a high bandwidth connection directly into the cerebral cortex of more than two billion humans who have no idea what they are up against. When the AI behavioral-prediction engines of Facebook and Google reach maturity, they may be able to abandon the endless accumulation of content data and some forms of metadata—addressing a meaningful subset of the privacy concerns that have been raised in the press and in congressional hearings—without actually improving users’ privacy. That would be a terrible outcome. Under intense political pressure to “do something” about privacy, policy makers might rush to make changes that would create only the illusion of benefit. Users need privacy protection that starts with prior, informed consent for any use of their data. Without it, all users will be vulnerable to bad actors who can use the power of the internet to smear reputations and cause irreparable harm.

Judy Estrin, the second woman founder to take a technology company public in the United States, believes that the power of technology monopolies will be difficult to restrain. The combination of free-market capitalism plus platform monopolies plus trust in tech by users and policy makers has left us at the mercy of technological authoritarians. The unelected leaders of the largest technology platforms—but especially Facebook and Google—are eroding the foundations of liberal democracy around the world, and yet we have entrusted them with the information security of our 2018 election. They are undermining public health, redefining the limits of personal privacy, and restructuring the global economy, all without giving those affected a voice. Everyone, but especially technology optimists, should investigate the degree to which the interests of the internet giants may conflict with those of the public.

Policy makers must expect intense opposition from the industry. Some will be tempted to bow to lobbyists. The industry is entitled to a voice in policy, but current law gives them disproportionate power in the regulatory process. They will try to narrow the focus and direct it in ways that minimize the impact on their business. That is their right, but they are not guaranteed the last word. The public can and should ensure that its voice is decisive. Public pressure is already having an effect, and more pressure can have a greater effect. Users can also influence internet platforms by changing their online behavior.

I have come to appreciate that in rapidly changing industries regulation is a blunt instrument. Policy makers understand this, which is one reason why they are reluctant to regulate an industry like tech. Again, the goal is to improve behavior by changing incentives. In a perfect world, the threat of regulation would be enough to accomplish that. When threats do not work, policy makers usually start with the easiest, least painful regulations. If they fail, each new round of regulation will become progressively more onerous. For this reason, the target industry is usually smart to embrace the process early, cooperate, and try to satisfy the political needs of policy makers before the price gets too high. For Facebook and Google, the first “offer” was Europe’s Global Data Protection Regulation (GDPR). Had they embraced it fully, their political and reputational problems in Europe would have been reduced dramatically, if not eliminated altogether. For reasons I cannot understand, both companies have done the bare minimum to comply with the letter of the regulation, while blatantly violating the spirit of it.

In 2018, I received an email from Representative Zoe Lofgren, a member of Congress from the Bay Area. A strong supporter of the platforms during their honeymoon period, Representative Lofgren told me she was working on an internet privacy bill of rights. Her approach was straightforward:

In a free society, people must have a right to privacy. To promote that freedom and privacy, we declare that you own your data.

Accordingly, you have a right in a clear and transparent manner to:

(1) consent or opt in when personal information is collected or shared with a third party and to limit the use of personal information not necessary to provide the requested service.

(2) obtain, correct or delete personal data held by a company.

(3) be notified immediately when a security breach is discovered.

(4) be able to move data in useable, machine-readable format.

I loved the simplicity and directness of this data bill of rights. Similar in objectives and approach to a bill introduced by Senators Klobuchar and Kennedy, as well as to Europe’s GDPR, Representative Lofgren’s proposal could be a valuable first step in an effort to regulate the platforms. Getting any data privacy bill of rights through Congress in the current environment would be an extreme challenge. Passing a bill that would actually restore ownership and control to users would be even harder. Congress would face intense lobbying from the platforms, who, no matter their public posture, would do their best to weaken any bill that limited their freedom to act. The long odds are not an argument against trying to pass a bill, but they do create an incentive not to waste energy on bad legislation. At this writing, Facebook and Google are doing precisely that, pushing Congress to implement underpowered privacy regulations.

In my response, I congratulated Representative Lofgren and provided some feedback:

Relative to #4, I think it is important to specifically secure the rights to all metadata—the full social graph with relationships and actions, in addition to names—in a portable fashion. Without that, startups are going to be disadvantaged and innovation will be limited to some degree.

Whatever bill of rights we create has to focus as much on how data is used as on how it is collected.

This last point reflected my concern that Facebook, Google, and others have enabled reams of private user data to escape their networks. There is no way to reclaim that data or even to know where it has gone. The best we can do is protect users from unforeseen and inappropriate uses of the data. Any internet bill of rights that does not address uses of data may have little if any practical value to users.

In addition, I asked Representative Lofgren to embrace the view that no matter how well implemented, privacy regulations would address only a subset of the problems created by platforms. For example, I hypothesized that the lack of competition in core social media categories narrowed the scope and slowed the pace of innovation. There is no alternative to Facebook or YouTube. If you don’t like their business practices, you are stuck. The platforms have been able to acquire promising startups in adjacent categories—as Facebook had done with Instagram and WhatsApp—converting potential competitors into extensions of their monopoly. In addition, Facebook and Google have gotten footholds in many promising new categories—ranging from virtual reality to AI to self-driving cars—in their pre-market stages. Engagement by the platforms has validated new categories, but in all probability, it has also distorted them, changing the incentives for market participants. It is hard to imagine that Facebook’s purchase of and commitment to the Oculus virtual-reality platform did not discourage investment in alternative hardware platforms. What venture capitalist would want to compete with Facebook in a category that might require an investment of hundreds of millions of dollars? It is also hard to believe that early-stage projects inside giant platforms operate with the same sense of urgency as startups, which suggests that the pace of innovation might suffer.

From my seat in Silicon Valley, I can see that the success of Google, Amazon, and Facebook has distorted the behavior of entrepreneurs and investors. Entrepreneurs have a simple choice: stay away from the giants or create businesses designed to be sold to them. The result has been a flood of startups that do things your mother used to do for you, including all manner of transportation and delivery services, as well as services that do things like clean up after your dog. Many new products seem to be targeted at billionaires, as was the case with Juicero’s seven-hundred-dollar juicer. In an environment that is already challenging for entrepreneurs and startups, it will be important for policy makers not to make the situation worse.

Regulations like the GDPR or Representative Lofgren’s privacy bill of rights impose a cost of compliance with a fairly high minimum that applies to all affected companies, irrespective of size. Without modification, the costs may be disproportionately burdensome on startups, further enhancing the competitive advantages of the largest companies, but there are ways to compensate for that without undermining a very important new regulation. My feedback to Representative Lofgren recommended modifying her article #4 to allow portability of the entire social graph—the entire friend network—as a way to promote competition from startups. If you want to compete with Facebook today, you have to solve two huge problems: finding users and then persuading them to invest in your platform to reproduce some of what they already have on Facebook. Portability of the social graph—including friends—would reduce the scope of the second problem to manageable levels, even when you factor in the need for permission from every friend. But graph portability was just the first step. I also advocated antitrust measures.

In my message to Representative Lofgren, I proposed the adoption of a classic model of antitrust as the least harmful, most pro-growth form of intervention she could advocate. I had just written an op-ed for the Financial Times on the subject of the 1956 consent decree with AT&T, which ended that company’s first antitrust case, but it had not yet been published, so I gave Representative Lofgren a preview. The decree had two key elements: AT&T agreed to limit itself to its existing regulated markets, which meant the landline telephone business, and it agreed to license its patent portfolio at no cost. By limiting itself to regulated markets, AT&T would not enter the nascent computer industry, leaving that to IBM and others. This was a very big deal and was consistent with historical practice. AT&T owed its own existence to a prohibition on telegraph companies entering telephony. Allowing the computer industry to develop as its own category proved to be good policy in every possible way.

Compulsory licensing of the AT&T patent portfolio turned out to be even more important. AT&T’s Bell Labs did huge amounts of research that led to a wide range of fundamental patents. Included among them was the transistor. By making the transistor available for license, the 1956 consent decree gave birth to Silicon Valley. All of it. Semiconductors. Computers. Software. Video games. The internet. Smartphones. Is there any way that the US economy would have been better off allowing AT&T to exploit the transistor on its own timeline? Does anyone think there is a chance AT&T would have done as good a job with that invention as the thousands of startups it spawned in Silicon Valley? Here’s the clincher: the 1956 consent decree did not prevent AT&T from being amazingly successful, so successful that it precipitated a second antitrust case. The company was ultimately broken up in 1984, a change that unleashed another tsunami of growth. Post-breakup, every component of the old monopoly flourished. Investors prospered. And two new industries—cellular telephony and broadband data communications—came to market far sooner than would otherwise have been the case.

Applying the logic of the 1956 AT&T consent decree to Google, Amazon, and Facebook would set limits to their market opportunity, creating room for new entrants. That might or might not require the divestiture of noncore operations. There is nothing in the patent portfolios of the platform giants that rivals the transistor, but there is no doubt in my mind that the giants use patents as a defensive moat to keep competitors at bay. Opening up those portfolios would almost certainly unleash tremendous innovation, as there are thousands of entrepreneurs who might jump at an opportunity to build on the patents.

In my message to Representative Lofgren, I forgot to include something important. Harvard professor Jonathan Zittrain had written an op-ed in The New York Times that recommended extending to data-intensive companies the fiduciary rule that applies to professions that hold sensitive data about clients. As fiduciaries, doctors and lawyers must always place the needs of the client first, safeguarding privacy. If doctors and lawyers were held to the same standard as internet platforms, they would be able to sell access to your private information to anyone willing to pay. Extending the fiduciary rule to companies that hold consumer data—companies like Equifax and Acxiom, as well as internet platforms—would have two benefits. First, it would create a compelling incentive for companies to prioritize data privacy and security. Second, it would enable consumers (and businesses) harmed by data holders to have a legal remedy that cannot be unilaterally eliminated by companies in their terms of service. Today, the standard practice is to force users who feel they have been harmed to go into arbitration, a process that has historically favored companies over their customers. If consumers always had the option of litigation, companies would be less likely to act carelessly. The fiduciary rule had another benefit: simplicity. It would not require a new bureaucracy or even a complicated piece of legislation.

In the last week of April 2018, I returned to Washington for several days of meetings and events. I met with a number of members of Congress, including Representative Ro Khanna, a friend from Silicon Valley who had joined forces with Zoe Lofgren on the data privacy bill of rights. Ro was really interested in the fiduciary rule, and we discussed how it might be paired with a bill of rights to make the former more effective in protecting consumers and encouraging competition.

Later that day, I had an impromptu conversation with Nancy Pelosi, who wanted to be certain that members of her caucus had access to insight from sources besides industry lobbyists. We discussed the work I had been doing on the data privacy bill of rights with Representatives Lofgren and Khanna. She let me know that the next step would be to engage with members of the Energy and Commerce Committee, as any such legislation would need to begin in that committee. She agreed to organize a meeting with key members of the committee so that we could share our ideas not only on data privacy but also on the fiduciary rule, antitrust, election security, and public health. In response to Pelosi’s concern about counterbalancing the influence of lobbyists, I offered to organize a curriculum with coaches, much as we had done with the staff of the House Permanent Select Committee on Intelligence prior to the November 1 hearing. The goal was to prepare the Democrats in the House for the future, for the day when they would be back in power. Pelosi’s goal was to ensure her party would be well prepared to exercise its oversight responsibility.

Washington is just one venue where change can occur. Another is the states. State attorneys general have subpoena power and the ability to bring legal cases where they find violations of consumer rights or other malfeasance. We first met with the attorney general of New York and his staff in 2017, and we expanded our effort to include the AG offices in Massachusetts, California, Washington, and Maryland. A few of these offices dug into Facebook’s representations to users with respect to data privacy. Only time will tell if a case emerges. In addition, we joined with our partners at Common Sense Media to work with members of the California legislature on bills to protect user privacy and regulate bots. California has a long history of leadership in such matters and began to extend that leadership to the regulation of internet platforms in June 2018 with the nation’s strongest digital privacy law.

On the afternoon of July 25, Facebook reported its second quarter earnings. The big news was that user count was flat in North America and declined in Europe, the two most profitable markets for Facebook. Usage of the Facebook.com website declined precipitously in North America, more than offsetting the growth of the mobile app. The stock declined about 20 percent the following day, losing $120 billion in market value, the largest one day loss of value in history. While investors did not show any concern about Facebook’s business practices, they punished the stock for what may be nothing more than market saturation, which does not have to be a bad thing for a monopolist. To me, the real question is whether a lower stock price might cause employees to reconsider the company’s strategy and their role in it. Might it produce whistle-blowers?

At the end of July, Facebook announced that it had shut down thirty-two false pages and profiles that employed the same tactics that the Russians used to interfere in the 2016 election. The pages and profiles worked in a coordinated way across both Facebook and Instagram. Two hundred ninety thousand Facebook users had interacted with the pages, one of which had ties to the Russian Internet Research Agency. In early August, Apple, Facebook, and YouTube removed content and pages associated with Alex Jones and Infowars for violations of unspecified rules regarding hate speech; Twitter did not initially follow suit. The action was an abrupt reversal for Facebook and YouTube. Facebook, in particular, had long argued that it was a neutral platform and did not want to be in the business of deciding what content was appropriate on its site, leaving such decisions to amorphous “community standards.” Other than a few obvious categories like child pornography, Facebook has avoided judging the content on its site. This policy had the effect of enabling high-engagement content like conspiracy theories and disinformation to flourish, with significant benefits to profitability. A hypothesis emerged that Apple’s announcement—which had preceded the other two by a matter of hours—had given political air cover to Facebook. Twitter attempted to defend its initial inaction on free speech grounds, which unleashed a tsunami of criticism. Twitter responded by suspending Jones for a week, and later banned him and Infowars after Jones was streamed harassing and insulting a CNN reporter who was covering the appearance of Twitter’s CEO, Jack Dorsey, at a Congressional hearing. One might reasonably conclude that the internet platforms do not want to damage their business models by banning conspiracy theories, disinformation, and hate speech, unless it becomes politically impossible not to.

Later in August, The New York Times reported that Facebook deleted more than 652 fake accounts and pages with links to Iran that were operating a coordinated campaign to influence US politics. According to CNN, the campaign included 254 Facebook pages and 116 Instagram accounts that had more than one million followers. Unfortunately, Facebook did not discover the accounts and pages, despite the investment it has made in election security; a cybersecurity firm named FireEye made the initial discovery. At Facebook’s current scale, I believe it’s not enough to rely on third parties to identify bad actors—too much harm gets done before the process can stop the problem.

Shortly after the August deletions, the website Motherboard published an investigative story about the way that Facebook moderates content. Facebook gave Motherboard access to the moderation team, which Motherboard supplemented with leaked documents, possibly the first to come from active Facebook employees. According to the story’s authors, Jason Koebler and Joseph Cox, “Zuckerberg has said that he wants Facebook to be one global community, a radical ideal given the vast diversity of communities and cultural mores around the globe. Facebook believes highly-nuanced content moderation can resolve this tension, but it’s an unfathomably complex logistical problem that has no obvious solution, that fundamentally threatens Facebook’s business, and that has largely shifted the role of free speech arbitration from governments to a private platform.”

Facebook told Motherboard that its AI tools detect almost all of the spam it removes from the site, along with 99.5 percent of terrorist-related content removals, 98.5 percent of fake account removals, 96 percent of nudity and sexual content removals, 86 percent of graphic violence removals, and 38 percent of hate speech removals. Those numbers sound impressive, but require context. First, these numbers merely illustrate AI’s contribution to the removal process. We still do not know how much inappropriate content escapes Facebook’s notice. With respect to AI’s impact, a success rate of 99.5 percent will still allow five million inappropriate posts per billion. For context, there were nearly five billion posts a day on Facebook . . . in 2013. AI’s track record on hate speech—accounting for 38 percent of removals—is not helpful at all. Human moderators struggle to find inappropriate content missed by AI, but they are forced to operate within the constraints of Facebook’s twin goals of maximum permissiveness and generalized solutions to all problems. The rule book for moderators is long and detailed, but also filled with conflicts and ambiguity. Moderators burn out very quickly.

The Motherboard reporters concluded that Facebook is committed to getting moderation right, but will not succeed in doing so on their terms. The academics quoted in the article argued that moderation is not possible at Facebook’s scale with Facebook’s approach. The network is too complex. Facebook has not yet accepted this reality. They continue to believe that there is a software solution to the problem and that it can be successful without changing their business model or growth targets. Facebook is certainly entitled to that point of view, but policy makers and users should be skeptical.

Zuck and Sheryl must know that Facebook’s brand has suffered from the onslaught of bad news. To get a sense of the impact, I asked Erin McKean, founder of Wordnik and former editor of the Oxford Dictionary of American English, to study changes in the nouns and adjectives mostly frequently associated with each of the largest tech companies: Apple, Google, Amazon, Facebook, and Microsoft, plus Twitter. Prior to the 2016 election, the tech leaders enjoyed pristine reputations, with no pejorative word associations. For Google, Amazon, Apple, and Microsoft, that is still true. For Facebook, things have changed dramatically. The word “scandal” now ranks in the top 50 nouns associated with Facebook. “Breach” and “investigation” are in the top 250 nouns. With adjectives the situation is even worse. Alone among the five tech leaders, Facebook had one pejorative adjective in its top 100 in 2015–2016: “controversial.” In 2017 and 2018, the adjective “fake” ranked in the top 10 for Facebook, followed by “Russian,” “alleged,” “critical,” “Russian-linked,” “false,” “leaked,” and “racist,” all of which ranked in the top 100 adjectives. Apple, Google, Amazon, and Microsoft do not have a single pejorative noun or adjective on their lists. Twitter has two nouns on its list that may or may not imply brand issues: “Trump” and “bots.” The study was conducted using the News on the Web (NOW) corpus at Brigham Young University. The top 10 US sources in the corpus, ranked by number of words, are Huffington Post, NPR, CNN, The Atlantic, TIME, Los Angeles Times, Wall Street Journal, Slate, USA Today, and ABC News.

Despite all the political fallout, Facebook continues to go about its business. In early August, the Wall Street Journal reported that Facebook had asked major banks “to share detailed financial information about their customers, including card transactions and checking-account balances, as part of an effort to offer new services to users.” Among the banks were JP Morgan Chase, Wells Fargo, and U.S. Bancorp. At least one large bank “pulled away from the talks due to privacy concerns.” Facebook spokesperson Elisabeth Diana disputed the report, saying, “A recent Wall Street Journal story implies incorrectly that we are actively asking financial services companies for financial transaction data—this is not true.” She asserted that Facebook’s goal is to integrate chat bots from Messenger with bank services, so that customers can look up their balances and the like.

Also in early August, Facebook announced a new organization called Facebook Connectivity, an umbrella for its many efforts to bring onto its service the remaining 4 billion unconnected humans on earth. Presumably the Free Basics program at the heart of the problems in Myanmar and Sri Lanka falls under the Connectivity umbrella. In late August, Facebook began testing a label to show users their common interests with random people they might see in a comment thread.

The activists I have met are right: the best way to bring about change is to create public pressure for it. When Tristan and I joined forces, we could not have imagined the progress in the ensuing sixteen months. Nor did we understand that creating pressure is only the first step. Millions are aware of the problem. Far fewer understand how it affects them, why the threat to society may increase, and why they should take steps to protect themselves.

—

I HAVE SPENT MORE than two years trying to understand Facebook’s role in the 2016 election and other undesirable events. In the process, I have learned about the other ways the internet platforms have transformed society and the economy. While intellectually stimulating, the journey has been emotionally draining. I have learned things about Facebook, Google, YouTube, and Instagram that both terrify and depress me.

This story is still emerging. As this book makes clear, I still have more hypotheses than conclusions. That said, I am convinced that Facebook’s culture, design goals, and business priorities made the platform an easy target for bad actors, which Facebook aggravated with algorithms and moderation policies that amplified extreme voices. The architecture and business model that make Facebook successful also make it dangerous. Economics drive the company to align—often unconsciously—with extremists and authoritarians to the detriment of democracy around the world.

Facebook, Google, and Twitter insinuated themselves into the public square in nearly every country in which they operate and today they dominate it in many, including the United States. They have assumed a role normally reserved in democracies for government. Unlike a democratically elected government, the platforms are not accountable to their users, much less to the countries on which they have impact. To date, the platforms have not demonstrated any understanding of the responsibilities that come with control of the public square.

The technologist Judy Estrin hypothesizes that Facebook’s failures were inevitable. When Zuck first proposed his goal of connecting the entire world, that meant developed countries with broadband telecom infrastructure. The addressable population would have been less than 1.5 billion. Smartphones opened up dozens of emerging economies, increasing the potential audience to something like 4 billion. Only a few products appeal to that many people, but Facebook’s core product proved to be one. Getting 2.2 billion users a month to use Facebook required brilliant execution, one aspect of which was avoiding all forms of friction. To that end, Facebook optimized for speed of communication, eliminating anything that required deliberation or might cause a user to leave the site. To maximize engagement, Facebook packaged its persuasive technologies in a design that delivered simplicity and convenience. The design of Facebook trained users to unlock their emotions, to react without critical thought. On a small scale this would not normally be a problem, but at Facebook’s scale it enables emotional contagion, where emotions overwhelm reason. Emotional contagion is analogous to wildfire. It will spread until it runs out of fuel. Left unchecked, hate speech leads to violence, disinformation undermines democracy. When you connect billions of people, hate speech and disinformation are inevitable. If you operate a large public network, you have to anticipate wildfires of hate speech and disinformation.

In the real world, firefighters combat wildfires with a strategy of containment. Similarly, financial markets limit panics with circuit breakers that halt trading long enough to ensure that prices reflect a balance between facts and emotion. Facebook grew to 2.2 billion monthly users without imagining the risk of emotional contagion, much less developing a strategy for containing it. The company has failed to grasp that convenience is the reciprocal of friction, and that too much convenience, too much of “what users want,” creates an environment in which emotional contagion would be an ever present danger for which the company had no answer. At some level, this is understandable. Businesses strive for efficiency and productivity; internet platforms that deliver convenience have an advantage on both counts. But businesses also have obligations to their employees, communities, and the world that the internet platforms did not meet. At the scale of Facebook, Google, and Twitter, there is no excuse for failing to prepare for emotional contagion.

The internet platforms have harvested fifty years of trust and goodwill built up by their predecessors. They have taken advantage of that trust to surveil our every action online, to monetize personal data. In the process they have fostered hate speech, conspiracy theories, and disinformation, and enabled interference in elections. They have artificially inflated their profits by shirking civic responsibility. The platforms have damaged public health, undermined democracy, violated user privacy, and, in the case of Facebook and Google, gained monopoly power, all in the name of profits.

No one working inside the internet platforms objected to these outcomes enough to take a public stand against them. In the final two chapters of this book, I will share my thoughts on top down solutions, ones that require government intervention, and on bottom up ideas for managing the risk from internet platforms in your own life. To provide context, let me summarize my understanding of what I have learned on this journey so far.

First, internet platforms that we love are harming the country and the world. Those platforms we love may also be harming us without our being aware of it. In addition, there are indirect harms to all of us that result from the undermining of public health, democracy, privacy, and the economy. I do not believe the platforms are causing harm on purpose. The harm is a byproduct of hyper-focused business strategies that failed to anticipate negative side effects. These are really smart people operating in a culture that sees the world through the narrow lenses of business metrics and code. They have created problems for which there may be no technology solutions.

Second, Facebook, Google, YouTube, Instagram, and Twitter have too much influence on our democracy. At this writing, less than ninety days before the 2018 US midterm elections, I am wondering what impact those platforms will have on the outcome. We may get lucky this time, but getting lucky is not a good long-term strategy. The internet platforms have consistently underestimated and misunderstood the threat from bad actors, and may do so again, despite substantial new investments in election security and efforts to combat hate speech. The country can no longer afford to take democracy for granted. I would like to think that every American will now invest the time to be informed about important issues, to vote, and to hold elected officials accountable. The country needs all the critical thinking it can muster. As citizens, we would be well served to anticipate how the algorithms of Facebook, Google, Instagram, YouTube, and Twitter try to manipulate our attention and world view.

Third, users and policy makers are far too trusting of technology. It is no longer rational to assume the best about technology entrepreneurs, companies, and products. Not because they are bad people, but rather because their incentives and culture blind them to their civic responsibilities. We now know that many technology products are unsafe. The aspects that make them unsafe are central to their economic value, which means that pressure for change must come from the outside. Consumers—who should never forget that the industry refers to them pejoratively as “users”—have enormous power, both politically and economically, should they choose to exercise it.

When a new product or technology comes to market, we should be skeptical. It is important to understand the incentives underlying new products and be selective about adoption. Before buying an Amazon Echo or Google Home, we need to read up on what it means to have a private business listening to everything we say in the presence of their devices. Even if we trust the vendor, such devices may be vulnerable to hackers. Is having a device to select our music really valuable enough to justify endless snooping into our lives? Over time, platforms will use our data in ways we cannot imagine today. Before we attach a smart TV to our home network, we should understand what the vendor will do with the data it collects. To date, the answer has been “anything the vendor wants.” Among other things, privacy is the ability to make our own choices without fear.

We should be particularly skeptical about artificial intelligence. As implemented by internet platforms, AI is a technology for behavior modification with far more downside than upside. For too many companies, AI is designed to take over activities that define us: our jobs, our routine preferences, and the choice of ideas we believe in. I believe the government should insist on guardrails for AI development, licensing for AI applications, and transparency and auditing of AI-based systems. I would like to see the equivalent of an FDA for tech to ensure that large scale projects serve the public interest.

Fourth, the best way to differentiate the good from the bad is to look at economic incentives. Companies that sell you a physical product or a subscription are far less likely to abuse your trust than a company with a free product that depends on monopolizing your attention. The platforms are led by really smart, well intentioned people, but their success took them to places where their skills no longer fit the job. They have created problems they cannot solve.

Fifth, kids are far more vulnerable to screen-based technology than I ever imagined. For a generation, we have assumed that exposing kids to technology was an unalloyed positive. That was incorrect, with a high cost. I will go into this more deeply in chapter 14.

Sixth, users are not being compensated properly for their data. There is no way companies should be allowed to collect user data and then claim ownership to it. We cannot retrieve our data, but we should be able to control how it is used. Each person should own his or her own data and be free to move it or sell it in a competitive marketplace.

Seventh, it is just not realistic at the scale of Facebook or Google to have the community police content. Too much harm happens during the process. Moderation can help, but has failed to date, particularly with hate speech, in part because of constraints imposed by other corporate priorities. We have asked the platforms politely to fix their problems with hate speech and disinformation. Now is the time for stronger measures. I will go into this in depth in chapter 13.

Eighth, the culture, business model, and practices that made internet platforms spectacularly successful produce unacceptable problems at global scale that will not resolve themselves. Here again, the platforms continue to resist necessary changes. If policy makers and consumers want the problems to go away, they will have to force changes to the business model and business practices.

One business practice I want to eliminate is the use of microtargeting in political advertising. Facebook, in particular, enables advertisers to identify an emotional hot button for individual voters that can be pressed for electoral advantage, irrespective of its relevance to the election. Candidates no longer have to search for voters who share their values. Instead they can invert the model, using microtargeting to identify whatever issue motivates each voter and play to that. If a campaign knows a voter believes strongly in protecting the environment, it can craft a personalized message blaming the other candidate for not doing enough, even if that is not true. In theory, each voter could be attracted to a candidate for a different reason. In combination with the platforms’ persuasive technologies, microtargeting becomes another tool for dividing us. Microtargeting transforms the public square of politics into the psychological mugging of every voter.

Ninth, I believe the threat from internet platforms justifies aggressive regulation, even with all the challenges of doing so in tech. The goal is to slow down the platforms and change incentives. The platforms have shown little ability or willingness to reform themselves, so the alternative is regulation. Congress has a lot of work to do to prepare for its role in oversight, but I believe the capability and commitment are there. Regulations are required relative to public health, democracy, privacy, and antitrust. In the near term, regulation can introduce appropriate friction to slow down the internet platforms, which is a necessary first step. Long term, it can change incentives to change behavior. I will discuss specific proposals in the next chapter.

Tenth, the country would benefit from an honest conversation about the values we expect from businesses, with a focus on the things we would sacrifice in service of those values. In the realm of technology, what will we give up to protect democracy? For example, would we sacrifice some convenience to safeguard elections? What would we forego to safeguard public health? To ensure privacy? To promote a vibrant entrepreneurial economy? A bit of friction in our relationship with technology may yield huge benefits.

Eleventh, technology has unlimited potential, but the good of society depends on entrepreneurs and investors adopting an approach that respects the rights of users, communities, and democracies. If the country and the world allow the laissez-faire capitalism that has powered the internet platforms to continue, the cost will be ongoing damage to public health, democracy, privacy, and the economy. Is that what we want? Bad outcomes are not inevitable, but we need to overcome inertia to prevent them.

Twelfth, with much reluctance I have concluded that platforms like Facebook, YouTube, Instagram, and Twitter are currently doing more harm than good. I would like to think we can clean up the mess, but we must summon the will.

The final two chapters look forward. Chapter 13 describes policy options for limiting future damage and creating a more competitive and innovative tech industry. Chapter 14 brings the focus to the individual, with advice for protecting yourself from the negative aspects of internet platforms.

—

WE CAN STILL HOPE that Zuck and Sheryl will eventually embrace the responsibilities that come with global dominance of an industry that influences democracy and civil liberties. Facebook has exceeded their wildest dreams, and they have made giant fortunes from it. The time has come for Facebook’s leaders to accept their civic responsibilities and put users first.

The world’s democracies want Facebook to act responsibly. Eventually those democracies will be able to compel change. Europe has taken the first step. It would be a smart move for Facebook to anticipate where this is going and go there without a struggle, so as to preserve value and goodwill. If Zuck and Sheryl won’t take on the reform mission themselves, perhaps their employees and advertisers will rise to the challenge. Facebook’s employees have shown some interest in Tristan’s ideas about humane designs, which is very exciting, but we have not yet seen evidence that they have the power or will to effect the changes in business practices and business model that would be necessary to provide meaningful protection to users. Even with horrible news from Myanmar and Sri Lanka and the mounting evidence of Facebook’s harm to democracy, employees have been reluctant to come forward as whistle-blowers. That is incredibly disappointing. Until change comes from within, we have to keep up the pressure on policy makers and the public. We have made a lot of progress in raising awareness, but much heavy lifting is still to come. The most important voice can and should be that of the people who use Facebook, who will have to decide if they care more about the convenience of internet platforms or the well-being of themselves, their children, and society. It should not be a tough call. The fact that it is speaks volumes about our addiction to internet platforms.

13

The Future of Society

The problem with Facebook is Facebook. —SIVA VAIDHYANATHAN

Google and Facebook started up without modesty or a sense of irony. Google’s original 1998 mission statement was to “organize the world’s information and make it universally accessible and useful.” Not to be outdone, Facebook launched with this mission: “To give people the power to share and make the world more open and connected.” It is demonstrably true that both companies succeeded on their own terms. Unfortunately, the mission statements defined success narrowly, in terms that created massive wealth for their founders, while imposing negative side effects on far too many users.

By pursuing strategies of global domination, Google and Facebook exported America’s twin vices of self-centered consumerism and civic disengagement to a world ill-equipped to handle them. Tools that allow users to get answers and share ideas are wonderful in the ideal, but as implemented by Google and Facebook, with massive automation and artificial intelligence, they proved too easy to manipulate. Google’s ability to deliver results in milliseconds provides an illusion of authority that users have misinterpreted. They confuse speed and comprehensiveness with accuracy, not realizing that Google is skewing search results to reflect what it knows about user preferences. Users mistakenly believe their ability to get an answer to any question means they themselves are now experts, no longer dependent on people who actually know what they are talking about. That might work if Google did not imitate politicians by giving users the answers they want, as opposed to the ones they need. Google’s YouTube does something similar, but more extreme, in video. Though it may have started as industry snark, “three degrees of Alex Jones” is a directionally accurate reflection of the way YouTube recommends conspiracy theories. Facebook has leveraged our trust of family and friends to build one of the most valuable businesses in the world, but in the process, it has aggravated the flaws in our democracy—and those of our allies—while leaving citizens ever less capable of thinking for themselves, knowing who to trust, or acting in their own interest. Bad actors have had a field day exploiting Google and Facebook, leveraging user trust to spread disinformation and hate speech, to suppress voting, and to polarize citizens in many countries. They will continue to do so until we, in our role as citizens, reclaim our right to self-determination.

You would think that Facebook’s users would be outraged by the way the platform has been used to undermine democracy, human rights, privacy, public health, and innovation. Some are, but most users love what they get from Facebook. They love to stay in touch with distant relatives and friends. They like to share their photos and their thoughts. They do not want to believe that the same platform that has become a powerful habit is also responsible for so much harm. That is why I have joined with Tristan, Renée, Sandy, and our team to connect the dots for users and policy makers.

Facebook remains a threat to democracy. Democracy depends on shared facts and values. It depends on communication and deliberation. It depends on having a free press and other countervailing forces to hold the powerful accountable. Facebook (along with Google and Twitter) has undercut the free press from two directions: it has eroded the economics of journalism and then overwhelmed it with disinformation. On Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets much better treatment. To Facebook, facts are not an absolute; they are a choice to be left initially to users and their friends but then magnified by algorithms to promote engagement. In the same vein, Facebook’s algorithms promote extreme messages over neutral ones, disinformation over information, conspiracy theories over facts. Every user has a unique News Feed and potentially a unique set of “facts.” Like-minded people can share their views, but they can also block out any fact or perspective with which they disagree.

Communication matters, but so does thoughtful consideration of facts, of candidates, and of policy options, none of which is easy on Facebook. When it comes to democracy, Facebook does a few things very well. It enables communication of ideas, as well as the organization of events. We have seen Black Lives Matter, the Women’s March, Indivisible, and the March for Our Lives all leverage Facebook to bring people together. The same thing happened in Tunisia and Egypt at the start of the Arab Spring. Unfortunately, the things Facebook does well are only a small part of the democracy equation.

According to Stanford professor Larry Diamond, there are four pillars of democracy:

1. Free and fair elections;

2. Active participation of the people, as citizens, in civic life;

3. Protection of the human rights of all citizens;

4. Rule of law, in which the laws and procedures apply equally to all citizens.

When it comes to free and fair elections, we know the grim story. In 2016, the Russians exploited Facebook, Google, and Twitter to interfere in the US presidential election. They also attempted to influence the outcome in several European elections, including the United Kingdom’s referendum on Brexit. The platforms have made changes, but the elements that allowed interference remain and could be exploited by anyone.

Relative to active participation of the people as citizens, three key factors are the willingness to respect other viewpoints, engage with them, and compromise. When the three factors are present, deliberation enables democracies to manage disagreements, find common ground, and move forward together. Unfortunately, everything about Facebook’s architecture and design undermines deliberation. News Feed is an endless series of identically formatted posts scrolling by. The comments section is itself a news feed, with no “reply all” function to enable debate. Facebook’s architecture and advertising tools enable bad actors to sow discord. Bad actors have also exploited YouTube, Twitter, and Google to harm democracy. The design of these platforms is what makes them susceptible to exploitation. Those designs can only be fixed by radically changing the business model, which the platforms will not do unless someone forces them to do it.

The third pillar—equal rights for all—is beyond the scope of internet platforms like Facebook, but that does not mean they do not exert significant influence. Facebook has become the closest thing many countries have to a public square. It is the largest and one of the most important places where citizens exchange views. And every interaction is governed by the terms of service of a private corporation whose priority is profits. Facebook applies community standards in each country, but in most countries those standards reflect the interests of the powerful. Enforcement of community standards is automated, with rules that can be gamed, which works disproportionately to the benefit of those in power. As a result, Facebook locks out the wrong people and blocks reasonable voices and content far too often. Only the well-connected or highly visible can recover from these mistakes. And then there is the impact of Truman Shows and filter bubbles, the primary consequence of which seems to be polarization. As amplifiers of disinformation and hate speech, Facebook, Google, and Twitter have effectively abridged the rights of the peaceful to benefit the angry. The persecution of the Rohingya in Myanmar is the most extreme example to date, but far from the only one. The advantages on Facebook enjoyed by the most extreme voices can have a lasting impact seen not only in elections, but in many other aspects of life.

The fourth and final pillar of democracy is the rule of law. Here Facebook’s impact is indirect. Facebook is the law on its platform, and it enforces the law selectively, which can have an impact in the real world. For example, the use of Facebook to discriminate in housing, in violation of the Fair Housing Act, persisted long after Facebook claimed to have stopped people from doing it, as demonstrated by ProPublica. The outcome of the US presidential election of 2016, the one in which the Russians used Facebook to interfere, has resulted in a broad assault on the rule of law.

At Facebook’s scale—or Google’s—there is no way to avoid influencing the lives of users and the future of nations. Recent history suggests that the threat to democracy is real. The efforts to date by Facebook, Google, and Twitter to protect future elections may be sincere, but there is no reason to think they will do anything more than start a game of Whack-A-Mole with those who choose to interfere.

Facebook remains a threat to the powerless around the world. The company’s Free Basics service has brought sixty emerging countries into the internet age, but at the cost of massive social disruption. Cultural insensitivity and lack of language skills have blinded Facebook to the ways in which its platform can be used to harm defenseless minorities. This has already played out with deadly outcomes in Sri Lanka and Myanmar. Lack of empathy has caused Facebook to remain complacent while authoritarians exploit the platform to control their populations, as has occurred in the Philippines and Cambodia.

Facebook remains a threat to public health. Users get addicted. They get jealous when friends show off their beautiful lives. They get stuck in filter bubbles and, in some cases, preference bubbles. Facebook helps them get into these states, but it cannot get them out. Preference bubbles redefine identity. To break through them will almost certainly require human intervention, not technology. And Facebook is not alone when it comes to harming public health. YouTube, Instagram, Snapchat, texting, and some video games do it every day.

Facebook remains a threat to privacy. The company’s commitment to surveillance would make an intelligence agency proud, but not so its handling of data. Facebook stands accused of having shared private data with a range of third parties, using it as a bargaining chip. There is some debate about the letter of the Federal Trade Commission’s consent decree, but there’s little doubt that Facebook violated its spirit. Increasing integration with Instagram and changes to WhatsApp’s business model signal that Facebook has not changed course despite widespread pressure to do so. Relative to privacy, Google is also a serious offender. Both Google and Facebook subvert the intent of privacy efforts like Europe’s GDPR with option-dialogue boxes designed to prevent users from taking advantage of their new rights.

Facebook remains a threat to innovation. The company enjoys all the privileges of a monopoly. It has network effects on top of network effects, protective moats outside of protective moats, with scale advantages that make life miserable for Snapchat, to say nothing of every startup that wants to innovate in social. Regulation can influence Facebook’s behavior, but the problems are features of Facebook’s business model and probably beyond the reach of all but the most onerous regulation. Google and Amazon also enjoy monopoly power, though with different symptoms than Facebook. Even in a perfect world, regulations to level the economic playing field would require years to implement. One of the really important steps is to require the option of a filter bubble–free view of Facebook News Feed and Google search results. What I have in mind is a button on every page that enables users to toggle between views. Relative to data, I want users to own their data and have absolute control over how it gets used. Users should have a right to know the name of every organization and person who has their data. This would apply not just to the platforms but also to the third parties that gain access to their data. Companies that hold consumer data must act as fiduciaries, prioritizing the interests of consumers. Another important regulatory opportunity is data portability, such that users can port their social graph from one platform to another. This would enable startups to overcome an otherwise insurmountable barrier to adoption. I would also require platforms to be transparent to users, advertisers, and regulators. In terms of economic policy, I want to set limits on the markets in which monopoly-class players like Facebook, Google, and Amazon can operate. The economy would benefit from breaking them up. A first step would be to prevent acquisitions, as well as cross subsidies and data sharing among products within each platform. I favor regulation and believe it can address a portion of the threat posed by Google and Amazon. Unfortunately, relative to Facebook, there is no preexisting model of regulation to address the heart of the problem, which relates to the platform’s design and business model.

The time has come to accept that in its current mode of operation, Facebook’s flaws outweigh its considerable benefits. Belgium and Sri Lanka had the right idea when the former imposed daily fines for privacy violations relative to non-users and the latter suspended Facebook over hate speech. Such aggressive tactics appear to be the only way to get Facebook to take action. Unfortunately, Facebook continues to prioritize its business model over its civic responsibilities. Zuck and the team at Facebook know that people are criticizing them, and while they do not like it, they are convinced the critics do not understand. They believe connecting 2.2 billion people in a single network is so obviously a good thing that we should allow them to get back to work without further discussion. They cannot see that connecting so many people on a single network drives tribalism and, in the absence of effective circuit breakers and containment strategies, has provided dangerous power to bad actors. The corners Facebook has cut have enabled great harm and will continue to do so. The business model pushes responsibility for identifying harm to users, which means Facebook’s response is almost always too little, too late.

From a technology perspective, the most promising path forward is through innovation, something over which the platforms have too much influence today. To get around them, I propose that Silicon Valley embrace human-driven technology as the Next Big Thing. In America, if you want to solve a problem, it helps to incorporate the profit motive, which we can do by shifting the focus of technology from exploiting the weakest links in human psychology to a commitment to serving the most important needs of users. Working together, Silicon Valley and users have the power to make technology a bicycle for the mind once again. Human-driven technology would serve the needs of its users, not just in terms of providing answers or stimulation but also with respect to their mental and physical well-being, privacy, and rights as citizens. Let’s take a page from renewable energy, where we are addressing a man-made catastrophe by creating new industries around solar and wind, among other things.

What would human-driven technology as the Next Big Thing look like? There are opportunities as far as the eye can see. Human-driven social networks would enable sharing with friends, but without massive surveillance, filter bubbles, and data insecurity. They would require a different business model, perhaps based on subscriptions. Given the ubiquity of social media and the threats posed by Facebook and Instagram, I think it is worth considering more aggressive strategies, including government subsidies. The government already subsidizes energy exploration, agriculture, and other economic activities that the country considers to be a priority, and it is not crazy to imagine that civically responsible social media may be very important to the future of the country. The subsidies might come in the form of research funding, capital for startups, tax breaks, and the like.

The Next Big Thing offers opportunities to rethink the architecture of the internet, pushing more processing and data storage out of the cloud and onto devices at the edge of the network. For example, I would like to address privacy with a new model of authentication for website access. Today, users need to have a unique, well-protected password for every site they visit. Password managers like 1Password can take some of the pain out of the security process, but they are time-consuming to create and use. They also store all the passwords in a central server, which makes them attractive targets for hackers. Too many users rely on Facebook Connect or insecure passwords as a more convenient alternative. A better idea would be to mandate that every site and every browser support a private authentication option. It would work like a password manager, but with a couple of important distinctions: it would go beyond storing passwords to performing log-ins, and it would store private data on the device, not in the cloud. My private log-in proposal would pass along only the minimum information required to prove identity, which might not even include names or other personal data. For example, the service could enable logins to a media site that confirmed that the user was a subscriber, without revealing identity. The app could offer a range of log-in services from “anonymous,” as might be appropriate for a content site, up to something with significant data attached, which would enable financial transactions. How would the anonymous log-in work? One possibility is to use a random number generator, coordinated at both ends, which changes with every transaction. The goal is to make privacy the default and give users total control over any data transfer. It may even be possible to integrate payments—Apple Pay, PayPal, or a credit card—with the same benefits: data would go only to the people who actually need to have it. Platforms and merchants will be unhappy to lose access to data from users who choose private log-in, but that is their own fault. They should not have abused the trust of users.

The Next Big Thing would also include smartphones that are less addictive and do not share private data, devices in the Internet of Things that are respectful of data privacy, and applications that are useful and/or fun without causing harm. One way to think about the opportunity for human-driven technology is in terms of decentralization. If antitrust action creates room for competition, the Next Big Thing could see the pendulum of innovation swing back from centralized cloud systems to devices at the edge. There is a human-driven alternative to every product in the market today, as well as many that do not exist yet. The market opportunities are huge. The technology is within reach. All we need is the will to pursue it.

Unfortunately, technology can take us only part of the way to a solution. We are a polarized country with really poor civic engagement. At least a third of the US population identifies with ideas that are demonstrably untrue, and a far larger number have no regular interaction with people who disagree with them or have a radically different life experience. I do not see how technology can fix that. Somehow we have to change our culture to make civic engagement a priority. If Black Lives Matter, the Women’s March, Indivisible, and the March for Our Lives are any indication, the process has already begun. Unfortunately, these important efforts in activism address only a portion of the political spectrum, and their success to date has hardened resistance on the other side.

—

WHEN THE TECH INDUSTRY finally had enough processing, storage, memory, and bandwidth to deliver seamless, real-time video, audio, and texts, it transformed the nature of digital experiences. Everything worked instantly, delivering surprise and delight in equal measure. Technology platforms integrated with the real world so effectively that users soon came to depend on them in ways that had previously been unimaginable. The new functions were so convenient that traditional barriers to adoption evaporated. At the same time, the balance of power between platforms and users shifted dramatically in favor of platforms. They were able to create massive artificial intelligence engines and feed them with endless streams of data to predict user behavior. Clever implementation of persuasive technology created the illusion of user choice, making the user complicit in a wide range of activities that exist only for the benefit of the platforms. Some platforms—like Facebook—make it possible for third parties to exploit users almost at will, sometimes to the point of manipulation.

This book has focused on Facebook because that company played the biggest role in the Russian interference in the 2016 election, and by chance I tripped over that story early on. In the context of US elections, I still worry more about Facebook and its subsidiary Instagram than other platforms. The Russian playbook from 2016 is out there. Anyone anywhere can run it in any election at any level. The Cambridge Analytica data set and possibly others like it are out there. Anyone can buy access to them on the dark web. But you don’t have to go to the dark web to get detailed data about American voters. Huge amounts of data are available. Campaigns can buy a list of two hundred million voting-age Americans with fifteen hundred data points per person from a legitimate data broker for seventy-five thousand dollars. Commercial users have to pay more, but not that much more. Think about that. Commercial data brokers do not sell lists that have been paired with voter files, so it would take some effort to replicate the data set created by Cambridge Analytica, but it can definitely be done by any sufficiently motivated party. A data set that includes Facebook user IDs gets access to the latest user data every time it is used inside Facebook.

The platforms have made changes aimed at protecting elections, but they address only a portion of the problem. Interfering in elections does not cost much in comparison to the value received. We should not assume that the playbook will stay the same. It will evolve in response to changes in the platforms, as well as experience from past elections. For example, Instagram’s market share among millennials makes the platform ideal for voter suppression of that demographic. Clint Watts, the national security consultant for the FBI, framed it this way in an email to me: “Many will project the past onto the future, expecting Russian disinformation to again seek to influence US elections. The Kremlin, rather than being the dominant social media manipulator globally, will be one of many seeking to surreptitiously move audiences to their preferred position using social media influence. Future political manipulators will copy the Kremlin’s information warfare art but apply an advanced level of technology, artificial intelligence, to sway audiences through rapid social media assaults. The danger to democracy will not be just authoritarians, but all political campaigns and public relations firms employing social media influence to drive audiences apart online and drive constituencies apart at the ballot box.”

Zeynep Tufekci, the UNC scholar who is one of the world’s foremost experts on the impact of emerging technology in politics, has observed that internet platforms enable the powerful to affect a new kind of censorship. Instead of denying access to communications and information, bad actors can now use internet platforms to confuse a population, drowning them in nonsense. In her book, Twitter and Tear Gas, she asserts that “inundating audiences with information, producing distractions to dilute their attention and focus, delegitimizing media that provide accurate information (whether credible mass media or online media), deliberately sowing confusion, fear, and doubt by aggressively questioning credibility (with or without evidence, since what matters is creating doubt, not proving a point), creating or claiming hoaxes, or generating harassment campaigns designed to make it harder for credible conduits of information to operate, especially on social media which tends to be harder for a government to control like mass media.” Use of internet platforms in this manner undermines democracy in a way that cannot be fixed by moderators searching for fake news or hate speech.

Elections are just one part of the problem created by smartphones and internet platforms. Public health issues such as addiction, data privacy, and the suppression of competition and innovation are the other parts, and the four problems interrelate. They touch both internet platforms and smartphone makers. Silicon Valley has profited from network effects but ignored knock-on effects. Internet platforms pursued unlimited scale without understanding, much less preparing for, unintended consequences. The handful of companies that won that game generated unfathomable wealth, but at a huge cost to society, which is left with a mess to clean up, a mess that cannot be fixed by technology alone.

Google collects more data than anyone else. They get your data from search results, Gmail, Google Maps, YouTube, and every other app they offer. They acquire your credit card data, as well as data from other offline sources. They use artificial intelligence to create a filter bubble in your search results of things you like. They use their sea of data to crush competitors. Google’s most glaring problems are in YouTube, which offers a triple-header of harm: the Kids channel, the promotion of disinformation, and the recruiting/training of extremists. For whatever reason, Google has not been able to fix any of these problems. Were it not for Facebook, we would be having this conversation about Google and YouTube. Twitter is constantly exploited by trolls, Russian and otherwise. This matters because of Twitter’s disproportionate influence in news, politics, and popular culture. Snapchat offers Streaks, which encourages a synthetic metric of friendship and is a powerful delivery vehicle for fear of missing out. Instagram, which is owned by Facebook, promotes addiction, enables FOMO, and is the weapon of choice for bullies who body shame preteens. Instagram pretends to be independent but shares data with Facebook, using terms of service that are functionally the same as Facebook’s. Facebook Messenger Kids is designed to introduce elementary school kids to texting. The product offers an obvious benefit to Facebook but none to the user. Each time video game technology improves, more players get addicted. Texting has also demonstrated addictive powers and undermines personal relationships by enabling emotional interaction without immediate, face-to-face feedback.

In my search for solutions, I prioritize two things: fair elections and protecting children.

A growing percentage of children prefer the hyperstimulation of virtual experiences to the real world. It’s hard to know how this will turn out, but medical researchers have raised alarms, noting that we have allowed unsupervised psychological experiments on millions of people. Medical research bolsters the case for regulation, in the form of limits on the ages at which children may use screens like smartphones and tablets, the amount of time anyone should spend on internet platforms, and functionality of the platforms themselves. Relative to today’s standards, the recommendations are extreme, but there may be no other way to protect children, adults, democracy, and the economy.

These are not conclusions to which I came easily. Silicon Valley is my world. Technology has been my life’s work. Professionally, I spent thirty-four years being a technology optimist. Then came the 2016 election. Suddenly, I saw things that were incompatible with my historically rosy view of technology. The more I learned, the worse it looked, until I finally realized that internet platforms had forgotten the prime directive of technology: to serve the needs of humans. Having been launched at the moment when the constraints on technology disappeared, the platforms confused easy success with merit, good intentions with virtue, rapid advances with value, and wealth with wisdom. They never considered the possibility of failure and made no preparations for it. The consequences have been profound. For the Rohingya in Myanmar and the Muslims in Sri Lanka, they can be deadly. For the citizens of the United States and the United Kingdom, the impact has been most apparent in elections, but social media permeates the national culture and may pose a developmental threat for kids. It is hard to accept that great harm can come from products we love—and on which we have come to depend—but that is where we are. Our parents and grandparents had a similar day of reckoning with tobacco. Now it’s our turn, this time with internet platforms and smartphones.

Internet platforms insinuated themselves into our lives—and into the public square—through a combination of compelling value and clever appeals to the weakest elements of user psychology. In less than a generation, these platforms have made themselves indispensable, but with unintended consequences so serious and so pervasive that policy makers and the public around the world have taken notice and seek answers. The issues go beyond internet platforms to include smartphones, texting, video games, and other products that replace human interaction with virtual alternatives. As much as we would like an easy fix, there is none that allows us to coexist with these products in their current form.

We put tech on a pedestal. That was a mistake. We let the industry make and enforce its own rules. That was also a mistake. We trusted them not to hurt users or democracy. That was a disastrous mistake that we have not yet corrected. Without a change in incentives, we should expect the platforms to introduce new technologies that enhance their already-pervasive surveillance capabilities. Those new technologies will offer convenience and perhaps other benefits to users, but recent experience suggests we should not assume that they will be benign. As technology advances, we should expect risk and potentially harm to increase as well.

The problem has metastasized to the point where Facebook alone cannot fix it. With a shocking percentage of the country’s population stuck in preference bubbles that blind them to fact, we need to think about ways to reconnect people in the real world, to encourage handshakes and eye contact with people who live differently and hold different views. But we should not let the platforms off the hook. They played a huge role in undermining public health and democracy. If they want to be pariahs, all they have to do is keep doing what they have been doing. If they want to regain the trust of users and policy makers, they should start by rethinking their approach, their entire mission. They need to understand the impact they have on societies around the world, and they need to do whatever is necessary to end the harm. They need to align with governments, universities, and users in long-term programs designed to promote a healthy relationship with technology, as well as technology that supports the best in humanity, rather than the worst.

Thinking long-term might allow the platforms to anticipate the change to come and foster trust by getting ahead of it. Where Facebook has chosen to create the illusion of compliance while resisting actual change, the smart move would be to adopt behaviors satisfactory to all constituencies, demonstrate genuine sensitivity to the needs of users, and restore the trust that has been lost in the wake of the 2016 election. So long as Facebook insists on prioritizing growth, preserving features that enable bad actors, and not implementing circuit breakers to protect against emotional wildfires, it will remain on the wrong side of history. If there is any justice in the world, the days of policy makers and citizens treating the business models of internet platforms as sacrosanct will end soon. In some ways, the internet platforms face a choice similar to a country contemplating war. Historically, the people who started wars generally overestimated the benefits while underestimating the costs. Had they known the outcome in advance, many would have chosen a peaceful alternative. In the case of the platforms, a second incentive might also be available. Given the damage to democracies in Europe and North America that resulted from the exploitation of their platforms, Facebook, Twitter, and Google might also consider how long they want to undermine the country in which they live.

At the heart of the threats facing users are the ones that affect public health. All the public health threats of internet platforms derive from design choices. Technology has the power to persuade, and the financial incentives of advertising business models guarantee that persuasion will always be the default goal of every design. The engineers are experts at using technology to persuade. Every pixel on every screen of every internet app has been tuned for maximum persuasion. Not every user can be persuaded all the time, but nearly all users can be persuaded some of the time. In the most extreme cases, users develop behavioral addictions that can lower their quality of life and that of family members, coworkers, and close friends. We don’t know the prevalence of behavioral addictions to technology, but anecdotally they seem widespread. Millions of people check their phone first thing in the morning. For most, the big question is whether they do so before they pee or while they are peeing. Far too many people report difficulty sleeping because they cannot stop using their phone or tablet. It’s not crazy to imagine that half of Facebook’s daily users have some level of behavioral addiction. The problem with addiction is that it deprives the victim of agency. Even when an addict understands the potential for harm, he or she cannot help but continue the activity. To change that will require more than regulation. It will require an investment in research and public health services to counter internet addiction.

One reason that democracy is vulnerable to threats via internet platforms is that other forces have already weakened the foundation. Years of underinvestment in public education in the United States have spawned at least one generation of voters with little understanding of our government and how it is supposed to work. Even if Facebook were to change its business model to discourage new filter bubbles, what could it do about the ones that already exist? What can Facebook do about the fact that humans prefer disinformation to information? What can it do about the sorry state of civics education? It cannot solve all these problems, but it can reduce their impact. We as a country need to address these problems the old-fashioned way, by talking to one another and finding common ground.

Technology will continue to evolve, as will the tactics used by bad actors to exploit it. In particular, I worry about the spread of disinformation videos, including deep fakes. I worry about voter suppression of millennials over Instagram. The concern is magnified by the widespread misperception among users that Instagram is not vulnerable to political interference.

The people at Facebook are really smart, and I would like to think that if they applied themselves, they would come up with ways to improve our democratic processes instead of undermining them. Revealing the sponsors for political ads was an important first step, and Facebook took it. Facebook then removed disinformation pages that appear to have been sponsored by Russia and Iran. It hired security experts. But so far Facebook has resisted fundamental change. The company must do heavy lifting at the algorithm level to ensure that disinformation and fake news do not dominate the information sphere as they did in 2016. It owes the world its best effort to prioritize facts over disinformation and to pierce filter bubbles of nonsense. This is not a capricious request. Facebook’s inattention to its potential impact on democracy enabled unprecedented interference in the United States and possibly the United Kingdom. No country should tolerate election interference via Facebook in the future, and the company should not assume any will.

Data privacy has been on the radar for a couple of decades, but only in an abstract way that few people understand. Press coverage of computer hacks of major websites generally emphasizes the number of identities that have been compromised—a number sometimes in the millions—but it always seems to be other people’s identity. But the privacy issues at Facebook go far beyond data security. The data gets used to persuade, to manipulate, to strip agency from users. The misuse of data has been so pervasive that the effects can be felt even by people whose data has not been compromised, as in the case of election interference. It’s not clear how much impact Cambridge Analytica will have on consumer attitudes toward data security in the long run, but the impact on governments may be significant. If policy makers insist on change, the decisive factor may be that Cambridge Analytica was not a hack. Cambridge Analytica was able to harvest nearly eighty-seven million Facebook profiles without user permission because Facebook encouraged third-party app vendors to do this. Harvesting was good for Facebook’s business.

The US Constitution does not guarantee a right to privacy, but the European Union has stepped into the breach with the Global Data Protection Regulation, which inverts the data relationship between platforms and users. It guarantees EU citizens and residents ownership of their own data and requires opt-in for a wide range of uses of user data. The regulation protects EU citizens no matter where they are in the world, including in the United States. The most valid criticism of GDPR relates to its impact on startups, which may be considerable. Given their relative economic advantage and likely benefits in terms of user trust, you might expect the major platforms to embrace GDPR. Instead, they are doing what they can to minimize the reach of GDPR, as Facebook did when it moved 1.5 billion user profiles from its processing center in Ireland—which is part of the EU—to the United States, where most would be beyond the reach of the regulation. Both Facebook and Google have used their design skills to craft dialogue boxes that minimize the number of users who opt in for GDPR protection.

If I were running Google, I would embrace GDPR like a religion. I would escape the lifeboat Google has been sharing with Facebook and create as much distance as possible. As the largest internet platform, Google would enjoy a huge relative advantage in terms of the cost of compliance. It would also radically improve its relative standing with regulators around the world. I believe that enthusiastic compliance with the spirit of GDPR would lead to an increase in user trust, which would almost certainly pay dividends in the future. I would spin off YouTube to shareholders, as that would create a more powerful incentive to reduce the threat from disinformation and extremism. Google does not seem to understand that the primary reason its users and policy makers are not up in arms is because Facebook is worse. If Facebook gets its act together before Google, the shoe will be on the other foot. At this writing, Google finds itself in a regulatory spotlight, not only with the EU, but also various constituencies in the United States.

The challenge is made more difficult by the rapid evolution of the artificial intelligence engines that power the platform giants. As deployed by internet platforms, AI offers incremental convenience to users at an exceptionally high cost. AI does not have to be harmful, but there is every reason for alarm at the early results of AI on internet platforms. By focusing only on the creation of economic value for themselves, the platforms have made choices that conflict with the best interests of their users and society as a whole. There are important policy questions about AI that should be addressed before the technology develops further. Behavioral-prediction models are increasingly functional. Their data sets gain new value and use cases with each new data set they acquire. Some of the value comes from activities that users never contemplated in the original transaction with the platform and over which they have no control. When platforms can anticipate users’ thoughts, there will be opportunities to add value but also to cause harm. Will the platforms give users any say? Users should have the decisive voice with respect to the use of their data.

Extending the fiduciary rule to data providers seems like a sensible step. Users have quietly accepted that platforms use their sensitive personal information in ways they never approved, but they deserve better. Data-intensive companies of all kinds should have a legal requirement to safeguard their users’ personal data, just as doctors and lawyers do. It is no different than if a priest were to profit from information provided in the confessional. For users, the key benefit of the fiduciary rule would be the right to bring a legal case if their data gets compromised.

The final category of issues with internet platforms relates to their impact on the entrepreneurial economy. Google, Amazon, and Facebook have followed the monopolist’s playbook and built “no go” zones around their core operations. Their success has raised the bar for startups, narrowing the opportunities for outsized success and forcing entrepreneurs to sell out early or pursue opportunities with less potential. They have built additional walls through acquisitions. Both Google and Facebook have acquired startups that might have posed a competitive threat. For Google, the most important acquisition was YouTube. For Facebook, the big ones were Instagram, WhatsApp, and Oculus. Google has built many of its businesses from scratch, including Gmail. It has a very large venture capital fund with two billion dollars under management and a huge portfolio. Google provides business services to its portfolio companies, ensuring a bird’s-eye view of their operations. One reason it matters is that the biggest product in the history of technology—the smartphone—is now mature, and we have entered the zone for developing the Next Big Thing. What will it be? Virtual reality? Facebook bought the early leader in VR platforms, choking off the supply of capital that might have funded alternative startup platforms. There has been progress at Oculus, but a mass market product still appears to be years away.

Will the Next Big Thing be artificial intelligence? There are startups in AI, as well as giants like IBM and Microsoft, but Google and Facebook assert to the government that they are the standard-bearers. The nature of AI is such that the lead that Google and Facebook have built in behavior modification may be insurmountable. The question I struggle with is whether AI is one thing or a category with several niches. If the latter, there may still be hope for startups.

Will the Next Big Thing be the next generation of wireless technology, the standard known as 5G? The magic of 5G is not going to be more bandwidth to phones; it will be in enabling pervasive 4G-level bandwidth at one-tenth the cost. It will power the Internet of Things. The standard has been set, and we should anticipate lots of startup activity. However, IoT already exists, and the early products pose a range of issues that demand attention, including data privacy and security. Critics have expressed alarm about the ability of Amazon’s Alexa and Google Home to snoop on users. With 5G, internet platforms will no longer be confined to PCs and smartphones. They will have access to and possibly control of a range of devices, appliances, and cars, surrounding users and immersing them. There is no reason to believe IoT will be benign unless users and policy makers demand it. The first generation of devices—flat-screen TVs, for example—has been plagued by data privacy issues. No one knows what the vendors are doing with the data they collect. We are aware of the data privacy and security issues with IoT and the range of issues from internet platforms; there is no excuse for not taking steps in advance to limit harm when IoT and platforms converge.

The US economy has historically depended on startups far more than other economies, especially in technology. If my hypothesis is correct, the country has begun an experiment in depending on monopolists for innovation, economic growth, and job creation. If I consider Google, Amazon, and Facebook purely in investment terms, I cannot help but be impressed by the brilliant way they have executed their business plans. The problem is unintended consequences, which are more numerous and severe than I imagined. These companies do not need to choke off startup activities to be successful, but they cannot help themselves. That is what monopolists do. Does the country want to take that risk?

Faced with conclusive evidence that internet platforms have a dark side, the time has come to do something about it. As a capitalist, I would ordinarily favor letting markets settle such problems. In this case, I cannot do so because the market is not getting the job done. The internet platforms have disrupted many industries, including music, photos, video, and news. They have disrupted the world of tech startups, too. They have created massive wealth for their investors but little in the way of traditional economic value, normally measured in the form of jobs and infrastructure. I don’t want to penalize success, but if that is the only way to protect democracy and public health, so be it. Allowing the internet platforms to disrupt every sector in the economy may not be in the national interest. People need jobs, and internet platforms don’t create enough of those. Worse still, too many of the current generation of technology companies derive their value from reducing employment elsewhere in the economy. I would like to think that Silicon Valley can earn a living without killing millions of jobs in other industries. In the mid-seventies and eighties, when the US first restructured its economy around information technology, tech enabled companies to eliminate layers of middle management, but the affected people were rapidly absorbed in more attractive sectors of the economy. That is no longer the case. The economy is creating part-time jobs with no benefits and no security—driving for Uber or Lyft, for example—but not creating jobs that support a middle-class lifestyle, in part because that has not been a priority. One opportunity for the government is to create tax incentives for tech businesses (and others) to retrain and create jobs for workers threatened by recent changes in the economy. Teaching everyone to code is not the answer, as coding will likely be an early target for automation through artificial intelligence.

I see no easy solution to the problems posed by Facebook and the other internet platforms. They are deeply entrenched. Users trust them, despite an abusive relationship. To contain the problem somewhere near current levels, the first step should be a combination of antitrust enforcement and new regulations to protect privacy and to limit the scope of data collection and artificial intelligence. I would favor aggressive antitrust action, including breaking up Facebook and Google, because I believe more, smaller entities will increase competition, producing the most economic value for the largest number of people. Users should always own all their own data and metadata. No one should be able to use a user’s data in any way without explicit, prior consent. Portability of users’ social graphs from any site will transfer power to users and promote competition. Third-party audits of algorithms, comparable to what exists now for financial statements, would create the transparency necessary to limit undesirable consequences. There should be limits on what kind of data can be collected, such that users can limit data collection or choose privacy. This needs to be done immediately, before the Internet of Things reaches mass adoption. IoT is currently an untamed frontier of data, with the potential for massive abuse. Lastly, I would like to see limits placed on artificial intelligence and automated bots to ensure that they serve humans, rather than exploiting them. This could be accomplished through an equivalent to the Food and Drug Administration (FDA) for technology. All of these changes depend on government intervention, which will not happen until the public insists on it. We need to create a political movement.

I hope the government will use its influence to promote human-driven technology as an alternative to extractive technology. At the same time, the government should take steps to repair the damage caused by internet platforms. Even if we figure out how to fix Facebook, that will not be enough to repair democracy. It may not even be enough to address the damage to public health and privacy. For those problems, we need real world solutions, not more code.

Some of the platforms take pride in their hacker roots, but the time has come for the largest ones to recognize that outsized success brings with it great responsibility. The business models and algorithms that create so much profit remain vulnerable to bad actors. New evidence emerges every day. Attempting to limit harm through regulation will be difficult, but regulation—even the threat of regulation—remains an effective incentive for change. The best solution would be for the platforms to fix themselves, but I fear they lack the will, the judgment, and perhaps even the ability. Google has announced that it will implement humane design principles in new smartphones, and Facebook has taken steps to limit foreign actors from placing political advertisements. Facebook and Twitter have banned a number of “inauthentic” accounts. Those changes are cosmetic. No platform has committed itself to the difficult steps that would be necessary to protect democracy, public health, user privacy, or the entrepreneurial economy. The most extreme failures, such as Facebook’s enablement of what has been described by the United Nations as a “textbook example” of ethnic cleansing in Myanmar, have not produced the kind of pushback from employees that would be necessary to effect change from within. Inertia keeps employees in line and drives platforms to exploit the psychological weaknesses of users. Perhaps the big drop in Facebook’s stock price that occurred in July 2018 will cause some employees to speak out. If not, economic incentives will encourage perpetuation of the status quo unless incentives change. Shareholders and third-party developers favor the status quo, so they are unlikely to be the drivers of change. Only a very public, concerted effort by top management will change the behavior of these companies, and that will only happen if policy makers and users insist on it.

14

The Future of You

The future is already here—it’s just not evenly distributed. —WILLIAM GIBSON

A dystopian technology future overran our lives before we were ready. As a result, we now face issues for which there are no easy answers without much time to act. We embraced the smartphone as a body part without understanding that there would be a downside. We trusted internet platforms to be benign. We reacted too slowly to warning signs. In the eighties and nineties, the philosopher Neil Postman warned us that television had ushered in Aldous Huxley’s Brave New World. Where Orwell worried about the burning of books, Huxley argued that the greater risk would be citizens no longer wanting to read. Postman predicted that television would entertain us to death. He did not live to see the smartphone prove his argument with an exclamation point.

Technology vendors have too many advantages over users. We cannot resist the allure of smartphones. Internet platforms apply their networks, design skills, artificial intelligence, and machine learning to capture our attention and hold it. They exploit the weakest links in human psychology to create dependence and behavioral addiction. Heavy doses of fun and dopamine keep us hooked and make us vulnerable. It happens to toddlers, grade schoolers, preteens, teens, and adults. Not everyone who is online is addicted. Not everyone has been manipulated. But no one can escape the consequences of these addictions and manipulations, as they affect enough people to undermine even the most successful countries. If we are to be a functioning democracy, we cannot allow the present situation to continue. If we want our kids to grow up to be functioning adults, we must force change. If we adults want to preserve agency over our lives, we have to stand up. Next-generation technology from the Internet of Things and artificial intelligence will compound the current problems if we do not take action now.

As users, we have more power than we realize. Internet platforms need us. They need our attention. When we give it, they have enormous—sometimes decisive—influence on our lives. Today the platforms’ reach is mostly limited to smartphones. Amazon’s Alexa and Google Home are expanding the footprint, followed by cars, TVs, refrigerators, toys, and other devices. We will increasingly be surrounded by devices that listen, watch, and record everything we do. The resulting data will then be processed by artificial intelligence and algorithms that will manipulate our attention and behavior in ways that create economic value for platform owners. Today we have some control over the degree to which IoT devices influence our life because most of us are not yet using them. Take the time to consider the dark side of any new technology before embracing its convenience. Our voice and our choices will be decisive. We can go along like sheep, or we can insist on a new model: human-driven technology. Individually, we struggle to resist, but collectively, we have great power. To exercise that power, we must leave our digital cocoon to interact with friends, neighbors, and total strangers.

Engaging with a wide range of opinions is essential for democracy. The US has forgotten the essential value of compromise, which starts with listening to and acknowledging the legitimacy of different points of view. If we are to break out of filter bubbles and preference bubbles—whether online or off—we need to invest the time necessary to be better informed. We need to be appropriately skeptical about what we read, watch, and hear, applying critical thinking to content from all sources, seeking out different perspectives, and validating content before we share it. The bibliographic essay at the end of this book includes sources you can use to investigate the quality of publishers and validity of content.

Forcing Silicon Valley to embrace human-driven technology would offer giant benefits to society but may require an effort analogous to the long campaign against smoking. We hate to think about the harm internet platforms are inflicting on us. Making the changes necessary to stop internet addiction, election interference, and privacy invasions will be hard work. It would be so much more pleasant to play another round of Candy Crush or check Instagram. I get it. My own journey from cheerleader to activist has been a struggle. I have had to face unpleasant facts about platforms in which I have been an investor and advisor, as well as about my own usage of technology. It has not made me popular in Silicon Valley, but it had to be done. There are times that require each of us do the right thing, no matter the cost. For me, this is one of those times.

How about you? Are you concerned about children getting addicted to texting or video games? Do you worry about all the kids who cannot put down their smartphones or videogames? Have you known a preteen girl who has been body shamed online or a teen who has suffered from fear of missing out? Do you worry about the consequences of foreign countries interfering in our elections? Do you wonder about the moral implications of American products being used to promote ethnic cleansing in other countries? Do you have trepidation about constant surveillance? Are you concerned about being manipulated by artificial intelligence? These are not hypothetical questions.

Here is some good news: internet platforms respond to pressure. We know this from recent experience. We collectively stimulated enough pressure that Facebook implemented much better rules for election advertising and Google announced humane design features in its new smartphone. These first steps never would have happened in the absence of public pressure. And each of us can exert at least two forms of pressure: we can change our behavior online and we can demand that politicians take action.

Consider your own usage patterns on Facebook and other platforms. What kinds of things do you post? How often? Is any of it inflammatory? Do you try to convince people? Have you joined Groups dedicated to political issues? Do you get into fights over ideas on social media? Are there people whose posts consistently provoke you? Have you ever blocked people with whom you disagree? Do not feel bad if the answer to any of these questions is yes. The evidence is that most users of Facebook have done these things at one time or another because the algorithms are designed to promote that kind of activity. Now that we know what is going on, what are we going to do about it?

Changing behavior starts with reconsidering your relationship to the internet platforms. That is what I did, especially for Facebook and Google. I still use Facebook and Twitter, but I have changed my behavior, especially on Facebook. I no longer allow Facebook to press my emotional buttons. I wish it were not necessary, but I no longer post anything political or react to any political posts. It took six months, but my feed is now dominated by the music side of my life, birthdays, and puppies. It might work for you, too. In addition, I erased most of my Facebook History. Facebook seems to have a built-in bias in favor of disinformation and fake news, so I am really careful about the sources of information on Facebook and elsewhere on the web. To protect my privacy, I do not use Facebook Connect to log in to other sites or press Like buttons I find around the web. I don’t use Instagram or WhatsApp because of my concern about what Facebook is doing to those platforms. I avoid using Google wherever possible because of its data-collection policies. Avoiding Google is inconvenient, so I have turned it into a game. I use DuckDuckGo as my search engine because it does not collect search data. I use Signal for texting. I don’t use Gmail or Google Maps. I use a tracking blocker called Ghostery so that Google, Facebook, and others cannot follow me around the web. I am far from invisible on the web, but my shadow is smaller.

I also have made changes relative to my devices. I use Apple products because that company respects the privacy of my data, while Android does not. I still check my phone way too often, but I have turned off notifications for practically everything. I only allow notifications for texts, and even then only vibrations. I read books on my iPad, so I keep it in Night Shift mode, which takes all the blues out of the display, reducing eye strain and making it much easier to fall asleep at night. I often put my iPhone in monochrome mode to reduce the visual intensity of the device and, therefore, the dopamine hit. I do not recharge my devices in the bedroom.

I bought an Amazon Alexa smart speaker on the first day. About an hour after I installed the device in the kitchen, an ad for Alexa came on the TV, and my Alexa responded. I realized immediately that Alexa would always be listening and that no one should trust it to respect privacy. My brand new Alexa went into a storage container, never to return. Unfortunately, the entire world of connected televisions, appliances, and other devices—the Internet of Things—shares Alexa’s snoopiness. Unscrupulous vendors can use IoT devices for surveillance. Incompetent vendors may leave customers vulnerable to hacking by bad actors. All vendors will collect masses of data; no one knows what they will do with it. My advice is to avoid IoT devices, or at least avoid putting them on your network, until vendors commit to strong protection.

Data privacy is sufficiently abstract that few people take steps to protect it. I recommend using a password manager such as 1Password to ensure secure access to websites. Despite the many hacks of data from servers and the harvesting of friends data from Facebook, few of us have experienced much harm, or at least not that we can perceive. Too few among us realize that our data is being used to build artificial intelligence systems that predict our behavior. When you combine that predictive AI with manipulative technology of internet platforms, bad things will happen. What starts out as creepy can easily become unhealthy, if not dangerous. Until the internet platforms and IoT hardware companies demonstrate a commitment to safeguarding users, it makes no sense to trust them with your data or anything else.

If you are a parent of a child eighteen or younger, think about whether you are a good digital role model. How often do you check your devices in the presence of your kids? How much do you know about your children’s online activity? What is the ratio of online activity to outdoor play in your family? How often do you go online together with your kids? To what degree does your children’s school employ computers and tablets? At what age did that start? How often do your children’s classes engage in traditional group learning, where the students are encouraged to participate with classmates, as opposed to one-on-one activity?

To understand how addiction to screens, games, and internet platforms affects us, I recommend Irresistible: The Rise of Addictive Technology and the Business of Keeping Us Hooked by New York University professor Adam Alter. For a really thoughtful explanation of the addictive properties of technology relative to children, check out Nicholas Kardaras’s Glow Kids: How Screen Addiction Is Hijacking Our Kids—And How to Break the Trance. Online resources include the websites of the Center for Humane Technology and Common Sense Media.

The medical profession has a message for parents: smartphones, tablets, and the apps that run on them are not good for children. When it comes to protecting children, there is mounting evidence that the only thing kids should do on smartphones is make calls. Just about everything else kids do on smartphones poses a threat of one kind or another. We used to think that kids were safer playing with technology than playing outdoors. We were wrong.

At the margin, research suggests that less exposure to devices and apps is better at all ages but essential for younger children. The American Academy of Pediatrics suggests that parents not allow any screen exposure for children under two. There is a growing body of research indicating that parents should limit the screen time of kids under twelve to much less than current averages. The rationale for early exposure—preparing kids for life in a digital world—has been negated by evidence that screen time impedes childhood development to a far greater degree.

Given how deeply smartphones, tablets, and PCs have penetrated everyday life, cutting screen time is much easier said than done. For example, many schools insist on using PCs or tablets in the classroom, despite evidence that computers and tablets may be counterproductive in that setting, both because of the negative effects of dopamine stimulation and a reduction in social interaction. It may not take much screen time to trigger an excess of dopamine in kids. Doctors have observed that kids with too much screen time suffer from a variety of developmental issues, including an inability to pay attention and depression. With preteens and teens, overproduction of dopamine remains an issue, but the exploitation of social media by bullies is also a problem. Even kids in their teens are unprepared to cope with the addictive powers of internet platforms on mobile devices.

Parents face a daunting challenge. Even if they control technology at home, how do they protect their children elsewhere? There are devices everywhere, and too many people willing to share them, unaware of the danger. One possible first step is to organize small groups of parents in a format equivalent to a book club. The goal would be to share ideas, organize device-free play dates, and provide mutual support towards a goal that requires collective action. Small groups can be an effective first step in a long campaign to change the cultural zeitgeist.

Adults are less vulnerable to technology than kids, but not enough so to be safe. Smartphones and internet platforms are designed to grab your attention and hold it. Facebook, YouTube, and other platforms are filled with conspiracy theories, disinformation, and fake news disguised as fact. Facebook and YouTube profit from outrage, and their algorithms are good at promoting it. Even if the outrage triggers do not work on you, they work on tens of millions of people whose actions affect you. Elections are an example. Facebook in particular has profited from giving each user his or her own reality, which contributes to political polarization. Facebook has managed to connect 2.2 billion people and drive them apart at the same time.

One way we can defend ourselves is to change the way we use technology. There is evidence that internet platforms produce happiness for the first ten minutes or so of use, but beyond that, continued use leads to progressively greater dissatisfaction. The persuasive technologies embedded in the platforms keep users engaged. We cannot help but scroll down just a bit farther, in the hope of something really wonderful. We did not understand the dark side of internet platforms before we got hooked, but we can modify our behavior now. We can track our usage with apps like Moment and create device-free time periods or locations in our day. We can decide not to embrace new technologies that do not respect us. We can even delete some applications.

I would like to think that the people who make smartphones and internet platforms will devote themselves to eliminating the harmful aspects. They have taken steps, but they have a lot of hard work to do. Policy makers in Washington and the states can create incentives for the internet giants to do right by their users. Executives in Silicon Valley should reassess their business plans in light of what we now know. Unfortunately, Silicon Valley is like a club. It is hard for anyone, even the CEOs of major tech companies, to speak out against companies as powerful as the internet platforms.

The platforms act as though users will be too preoccupied to look out for their own self-interest, to insist on dramatic change. Let’s prove them wrong. Parents, users, and concerned citizens can make their voices heard. We live at a time when citizens are coming together to bring about change. The effective collective action by Black Lives Matter, the March for Our Lives, the Women’s March, and Indivisible should inspire us. All of them use Facebook to organize events, which would be poetic justice in this case. Bringing people together in the real world is the perfect remedy for addiction to internet platforms. If we can do that, the world will be a better place.

Epilogue

We have to take our democracy back. We cannot leave it to Facebook or Snapchat or anyone else. We have to take democracy back and renew it. Society is about people and not technology. —MARGRETHE VESTAGER

Freedom is a fragile thing and never more than one generation away from extinction. —RONALD REAGAN

Nearly three years have passed since I first observed bad actors exploiting Facebook’s algorithms and business model to harm innocent people. I could not have imagined then the damage to democracy, public health, privacy, and competition that would be enabled by internet platforms I loved to use. If you live in the United States, United Kingdom, or Brazil, your country’s politics have been transformed in ways that may persist for generations. In Myanmar or Sri Lanka, your life may have been threatened. In every country with internet access, platforms have transformed society for the worse. We are running an uncontrolled evolutionary experiment, and the results so far are terrifying.

As people, and as citizens, we were not prepared for the social turmoil and political tumult unleashed by internet platforms. They emerged so quickly, and their influence over both people and commerce spread so rapidly, that they overwhelmed cultural, political, and legal institutions. Some will be tempted to relax now that the 2018 midterm elections have come and gone without obvious foreign interference. Conscientious citizens may stop worrying, comfortable that policymakers are now on the case. Instead, I hope they will see that foreign meddling in campaigns is merely one symptom of a much larger problem, a problem for which the internet platforms themselves—and nobody else, in or out of government—must be called to account.

In his brilliant book The Road to Unfreedom, Yale professor Timothy Snyder makes a convincing case that the world is sleepwalking into an authoritarian age. Having forgotten the lessons of the twentieth century, liberal democracies and emerging countries alike are surrendering to autocratic appeals to fear and anger. Facebook, Google, and Twitter did not cause the current transformation of global politics, but they have enabled it, sped it up, and ensured that it would reach every corner of the globe simultaneously. Design choices they made in the pursuit of global influence and massive profits have undermined democracy and civil rights.

Let me be clear. I do not believe the employees at Google, Facebook, or Twitter ever imagined their products would harm democracy in the United States or anywhere else. But the systems they built are doing just that. By manipulating attention, isolating users in filter and preference bubbles, and leaving them vulnerable to invasions of privacy, loss of agency, and even behavior modification, internet platforms inadvertently created a weapon for those who would impose their will on the powerless. Facebook’s impact on the 2016 U.S. presidential election and on the fate of the Rohingya in Myanmar are not isolated events. They are glaring examples of a global problem for which we lack a solution. The same can be said for the spread of conspiracy theories and enabling of extremism on YouTube. The single-minded pursuit of growth by corporations that do not believe they should be held accountable for the consequences of their actions will always produce undesirable side effects. At the scale of Facebook and Google, those side effects can transform politics and public health for the worse.

It is no exaggeration to say that the greatest threat to the global order in my life time has been enabled by internet platforms. If we want to avoid an authoritarian future, we need to reduce the influence of the platforms that enable authoritarians to impose their will. Whatever good comes from Facebook, Google, and their subsidiaries cannot justify harm to billions of people and destabilizing important institutions—the press, electoral systems, and international systems of governance—that protect the innocent. Playing nice with the internet platforms has not worked. It is time to get serious. As home to the internet platforms, the United States has a responsibility to rein them in. It will not be easy, but there are at least two paths.

The most effective path would be for users to force change. Users have leverage because internet platforms cannot survive without their attention. In a perfect world, users would escape filter bubbles, not allow technology to mediate their relationships, and commit to active citizenship. The midterm elections provided evidence that an increasing number of users in the United States are prepared to make these changes. But the midterms also demonstrated that democracy cannot be restored in a single election cycle. A large minority of Americans remain comfortable in an alternative reality enabled by internet platforms.

The second path is government intervention. Normally I would approach regulation with extreme reluctance, but the ongoing damage to democracy, public health, privacy, and competition justifies extraordinary measures. The first step would be to address the design and business model failures that make internet platforms vulnerable to exploitation. Government intervention should also address all the known harms from the use of internet platforms. Immersed in technology, kids do not develop normal social skills. Teenagers use social media technology to bully one another. Adults seek out the warm embrace of filter bubbles that erode critical-thinking skills. Seduced by convenience, users surrender personal data for ever less benefit. The platforms themselves have failed to safeguard personal data or provide reasonable privacy and security to their users. Consumers have no comparable alternative to Facebook and Google, which use their extraordinary market power to eliminate competition while also undermining the business model of journalistic voices that might threaten them. More than two years after I first shared my concerns with Zuck and Sheryl, Facebook has issued apologies and promises to do better. To date, the company has made few substantive changes.

As much as I would like to protect what I like about internet platforms, I am prepared to give up the good to eliminate the harm. We must use any and every tool available to us. Policy makers, who have been hesitant to take action against companies that were universally loved as recently as 2016, are beginning to step up. They must use every tool in the regulatory tool kit. We do not have much time.

Facebook and Google have failed at self-regulation. Hardly a day passes without a new revelation. Facebook reported that hackers had penetrated its system and stolen identity tokens from twenty-nine million users, gathering extensive personal information on fourteen million of them. The hackers gained the ability to impersonate those users on other internet platforms without detection, making this by far the worst security failure by Facebook yet revealed. Facebook reported that the hackers may have been scammers, which would represent an escalation of that threat. Facebook’s WhatsApp subsidiary was blamed for hate speech and election interference in many countries, and may have played an outsized role in Brazil’s election of a right-wing presidential candidate who promised to end democracy. The Washington Post reported that a firm called GIPEC had uncovered numerous posts for illegal drugs on Instagram. Then, in a moment of Olympic-class tone deafness, Facebook introduced Portal, a video-messaging device for the home. Incorporating Amazon’s Alexa voice technology and other surveillance tools that will be used to target advertising, Portal will test buyers’ trust in Facebook.

In the two months before the midterms, Facebook ramped up its efforts to limit the impact of foreign interference, disinformation, and other forms of subterfuge. The company opened a “war room” to demonstrate its commitment and introduced tools to protect political campaigns and their staffs from hacking. These actions demonstrate an acknowledgment of the corporation’s responsibility to protect democracy. Regrettably, Facebook appears to have compiled a list of past failures, which it is addressing in sequence, rather than going after the root causes of its vulnerability—its business model and algorithms—or anticipating new threats. Facebook faces a really hard problem—a variant of the game Whac-a-Mole—but it has no one but itself to blame. The proof of this came in October, when Vice attempted to place ads in the names of all one hundred U.S. senators, the vice president, and ISIS . . . and Facebook approved them all.

The sad truth is that even if Facebook can limit overt political manipulation on its platform, it would still pose a threat to democracy. Filter and preference bubbles will continue to undermine basic democratic processes like deliberation and compromise until something comes along to break users out of them. In addition, behavioral addiction, bullying, and other public health issues would remain. We would also be wrestling with pervasive loss of privacy and online security. The economy would still suffer from the anticompetitive behavior of monopolists.

While Facebook has made some concessions in response to political pressure, Google largely remains defiant. The company missed several opportunities to cooperate with authorities in Europe, leading to a series of ever-larger penalties, the most recent of which is a proposal to change policy on copyrights in a way that might all but destroy YouTube. By taking the position that it is not accountable to European authorities, Google forced them to keep raising the stakes. In September, Google’s CEO refused to participate in a U.S. Senate hearing on foreign interference in elections, a hearing in which Google would have looked relatively clean in comparison to Facebook and Twitter. The empty chair at the hearing spoke volumes about Google’s arrogance. The blowback appeared to trigger a new approach by Google, which soon thereafter announced it would cooperate with the second European antitrust judgment, the one that called for unbundling Google’s software services from the Android operating system.

Things got really ugly for Google in October 2018, when the company announced it would shut down its failed social network, Google+. It turns out there had been a massive hack of Google+ data, which the company covered up for months. Then, The New York Times reported that Google had paid a $90 million severance to Andy Rubin, the cofounder of Android, despite credible evidence of sexual impropriety. This and the news that other male Google executives had escaped punishment for inappropriate sexual behavior triggered a walkout by an estimated 20,000 employees worldwide. On the heels of smaller protests against Google bids on defense contracts, the walkout offers some hope that employees at internet platforms may eventually seize the opportunity they have to force change.

I believe a strong case can be made that Facebook and Google pose a threat to national security, but no one is making it in Washington, DC. In an era where citizens favored collective action, as in the decades following World War II, it is quite possible that the country would have viewed a threat like the one posed by internet platforms through the lens of national security. Technology that undermined democracy, public health, privacy, and competition would certainly have attracted aggressive regulation, if not something more severe.

Given my conviction that self-regulation has failed, I have shifted my focus from building awareness to facilitating government intervention. Within our team, I have the best background for economic policy, so that is my priority. Project number one is the question of how antitrust law might be applied to internet platforms.

The accumulation of harm from Facebook, Google, and, for different reasons, Amazon has changed the politics of regulation in the United States, with an increasing number of policy makers expressing a willingness to take action. In a perfect world, policy makers would implement regulations to protect public health, democracy, privacy, and competition. In this imperfect world, antitrust looks like the best place to start. I spent late September and early October 2018 introducing a new framework for antitrust regulation to policy makers, including the key players in the Trump Administration.

One challenge for policy makers is that Facebook and Google created a new kind of marketplace, consisting of users, content creators, and advertisers. By trading convenient online services to users in exchange for data, they aggregated the vast majority of users, forcing both content creators and advertisers to do business with them on their terms. Those terms were exceptionally favorable to Facebook and Google.

Content vendors, whether in news, music, or video, have struggled with deteriorating business models for more than a generation. Facebook, Google, and Twitter took advantage, offering massive distribution along with vague promises of economic opportunity. Lacking alternatives, content vendors embraced internet platforms, hoping they would add value to content and expand the economic pie. They did neither. Instead, Facebook and Google shifted content consumption to their platforms, causing advertising dollars to follow, and then they retained the lion’s share of the benefits. Content companies that embraced Facebook tools like Instant Stories and video came away much worse for the experience. In economic terms, Facebook and Google exploited their economic power to harm suppliers.

Like content vendors, advertisers must go where the audience is. In the early days of Google, AdWords advertisers only paid for users who clicked on their ads, a fair deal. The explosive growth in users on Facebook and YouTube enabled them to revive the traditional broadcast model of paying for audience, rather than for actions. In the context of Facebook, that model has produced disappointing results for many advertisers. Initially the problem was bad targeting. Targeting improved when Facebook integrated metadata from user activity on the web, but other problems emerged. In contrast to radio and television, internet platforms neither guaranteed audience sizes nor provided a satisfactory accounting for reach. Accusations from advertisers of overstated reach and engagement led to lawsuits and distrust. Thanks to their control of the largest audiences, Facebook and Google could not be held accountable. In economic terms, Facebook and Google exploited their economic power to harm advertisers.

Would-be competitors to the internet platforms face a nearly hopeless task. Facebook, Google, and Amazon have constructed protective moats around their businesses, exploiting network effects and intellectual property to limit the ability of startups to access users and generate value from advertising. The platforms have also used a variety of techniques to limit would-be competitors’ access to capital. In economic terms, Facebook, Google, and Amazon exploited their economic power to reduce competition.

Regulators are reconsidering their hands-off policies. Past bragging by internet platforms—statements like “software is eating the world” and “data is the new oil”—has invited greater scrutiny. User data has value, even if users do not understand that to be the case. We know this because Facebook and Google are two of the most valuable companies ever created, and their businesses are based on monetizing user data. Harm is increasingly evident, and policy makers and regulators are taking notice. The challenge is to apply existing regulatory frameworks to a relatively new industry. Classifying internet platforms as media companies—with regulation by the Federal Communications Commission—seems like an obvious first step, but it would address only a small part of the problem.

The normal remedy for abuses of economic power is antitrust law, but as described in chapter 7, the Chicago School redefined antitrust, using a single metric of consumer welfare: price. Under current practice, concentrated economic power is only considered a violation if it results in higher consumer prices. Internet platforms have been able to wield economic sledgehammers against suppliers, advertisers, and would-be competitors because the price to consumers is notionally free. A more accurate description would be that consumers do not pay for the services of internet platforms with currency. Rather, it is a barter transaction of services for data.

As I was contemplating antitrust remedies, Barry Lynn of the Open Markets Institute reminded me that we would need to find a way to reflect the true cost of “free” internet services to users. The answer was staring us in the face: Data is the currency of the web. If we view data as a currency, how does value flow between internet platforms and users? My mind went immediately to the Google example I cited in chapter 3, where a user in 2003 searched for a hammer, clicked through an AdWords ad, and bought the hammer. The vendor made a sale and Google got paid for the ad. Everyone won, but Google won more because it asserted ownership of the user data it collected, and built a data set of purchase intent signals. When Google introduced Gmail, it built a data set of identity. Combining the two data sets created a geometric increase in value, as future AdWords ads would have more value to the advertiser and, by extension, to Google. The same thing happened again with Google Maps, which enabled Google to tie identity and purchase intent to location. Each time Google introduced a new service, consumers got a step function increase in value, but nothing more. Each new search, email message, or map query generates approximately the same value to the user. Meanwhile, Google receives at least three forms of value: whatever value it can extract from that data point through advertising, the geometric increase in advertising value from combining data sets, and new use cases for user data made possible by combining data sets. One of the most valuable use cases that resulted from combining data sets was anticipation of future purchase intent based on a detailed history of past behavior. When users get ads for things they were just talking about, the key enabler is behavior prediction based on combined data sets.

The hypothesis that came to mind was this: Consumers are giving up more value in data than they receive in services. This appears to be true both in the moment and over time, even if consumers are neither aware of it nor troubled by it. If the hypothesis is valid, the price of internet platform services to users has been rising for more than a decade. In the context of anticompetitive behavior against suppliers, advertisers, and competitors, the Chicago School would find that situation to be in violation of its antitrust philosophy.

Does it matter that users are not complaining about the “price” of their data? Possibly, but not necessarily. Antitrust is a tool of economic policy designed to balance the interests of multiple constituencies, of which users are one. In the Microsoft antitrust case, for example, the Department of Justice acted to limit anticompetitive behavior without any pressure from users.

Shortly after my conversation with Barry, I visited the Federal Trade Commission and the Antitrust Division of the Department of Justice. Officials at both the FTC and the Antitrust Division expressed an openness to the hypothesis and encouraged me to develop it further. They asked that I engage with economists to create a formula that could be tested with data.

Once again, serendipity came to the rescue. By chance, I had previously scheduled a breakfast meeting with the president of Yale University to discuss the dark side of internet platforms. When I got around to the antitrust hypothesis, he offered to arrange meetings with the relevant economics professors at Yale. The department had considerable experience creating pricing models for transactions that did not involve currency. (A week later, a Yale economist would be awarded the Nobel Prize for pioneering work on carbon credits.) At Yale, I met with five economists, a political scientist, and a professor of law, all of whom had an interest. At this writing, the hard work has begun to create a model that represents the value transfer in the markets created by internet platforms, where one side is a barter transaction with no currency.

My hypothesis is a starting point for applying antitrust law to restrain—and ideally restructure—the major internet platforms. Left unchecked, the internet platforms will do what they do. The unintended side effects of their success will continue to harm more than two billion users every day, undermining society around the world. While we should pursue all avenues of regulation, antitrust may be the one with the fewest political obstacles.

The journey that led to this book continues. I have no idea how it will end. In my dreams, billions of users will rebel, changing their usage of internet platforms in ways that force massive change. Perhaps this book will help. In another dream, the employees of Facebook and Google will be the change agents. In real life, policy makers around the globe must accept responsibility for protecting their constituents. The stakes could not be higher.

ACKNOWLEDGMENTS

I wrote this book to further the cause for which Tristan Harris and I came together in April 2017. Since then, dozens of people have volunteered their time, energy, and reputation to bring the threat from internet platforms to public awareness. It started with my incredible wife, Ann, who encouraged me to reach out to Zuck and Sheryl before the 2016 election and supported the movement at every turn.

I want to thank Rana Foroohar of the Financial Times for suggesting that I write a book and for introducing me to my agent, Andrew Wylie. Andrew in turn introduced me to Ann Godoff and my editor, Scott Moyers, at Penguin Random House. The Penguin team has been amazing, especially Sarah Hutson, Matt Boyd, Elisabeth Calamari, Caitlin O’Shaughnessy, Christopher Richards, and Mia Council.

Many people offered valuable feedback on this manuscript. My appreciation goes to Ann McNamee, Judy Estrin, Carol Weston, Joanne Lipman, Barry Lynn, Gilad Edelman, Tristan Harris, Renée DiResta, Sandy Parakilas, Chris Kelly, Jon Lazarus, Kevin Delaney, Rana Foroohar, Diane Steinberg, Lizza Dwoskin, Andrew Shapiro, Franklin Foer, Jerry Jones, and James Jacoby.

Let me extend thanks and appreciation to the team that created the Center for Humane Technology: Tristan Harris, Renée DiResta, Lynn Fox, Sandy Parakilas, Tavis McGinn, Randima Fernando, Aza Raskin, Max Stossel, Guillaume Chaslot, Cathy O’Neil, Cailleach Dé Weingart-Ryan, Pam Miller, and Sam Perry. Your energy and commitment never cease to inspire me.

Special thanks to Judy Estrin, who, for the better part of a year, has spent several hours a week helping me organize the ideas at the foundation of this book. Buck’s of Woodside provided the setting for every one of those meetings, once again playing its role as a place where ideas become real. Thank you to Jamis MacNiven, proprietor.

Sheepish thanks go to two dear friends—Paul Kranhold and Lindsay Andrews—who fielded dozens of press contacts without compensation in late 2017 and early 2018 because I had forgotten to take their contact information off the Elevation website when the fund completed its successful journey.

Jonathan Taplin wrote the book that helped me understand the economic and political aspects of what I had seen in 2016. Andy Bast of 60 Minutes created the original interview with Tristan Harris. Brenda Rippee did Tristan’s makeup for 60 Minutes and Real Time with Bill Maher, introduced Tristan to Arianna Huffington, and then did my makeup for Real Time with Bill Maher. Bloomberg Tech, normally hosted by Emily Chang, brought Tristan and me together. Thank you, Candy Cheng, Arianna Huffington, Ben Wizner of the American Civil Liberties Union, and US Senate staffer Rafi Martina supported Tristan and me in the early days. Thank you. Chris Anderson and Cyndi Stivers of TED gave Tristan a platform and encouraged us. Eli Pariser provided both inspiration and material aid when we needed it. John Borthwick devoted many hours to helping Tristan and me explore the implications of our hypotheses.

Early on, two organizations committed themselves to our cause. Barry Lynn, Sarah Miller, Matt Stoller, and the team at the Open Markets Institute (OMI) guided us through the halls of Congress in the summer and fall of 2017, making many key introductions. Thanks also to the extended OMI family, especially Tim Wu, Franklin Foer, Zephyr Teachout, and Senator Al Franken. My old friend Jim Steyer founded Common Sense Media to help parents and children manage their media consumption, which led him to be an early critic of internet platforms. Jim and his colleagues provided the initial home to the Center for Humane Technology and organized the events that put it on the map. Common Sense also took the lead on privacy and anti-bot legislation in the California legislature. Bruce Reed’s guidance helped us succeed in Washington. Thanks also to Ellen Pack, Elizabeth Galicia, Lisa Cohen, Liz Hegarty, Colby Zintl, Jeff Gabriel, Tessa Lim, Liz Klein, Ariel Fox Johnson, and Jad Dunning.

Senator Mark Warner was the first member of Congress to embrace our concerns. We cannot thank him enough for his leadership in protecting democracy. Senator Elizabeth Warren was the first to support traditional antimonopoly regulation of the technology industry. Federal Trade Commissioner Terrell McSweeny helped us understand the FTC’s regulatory role.

My first public words about my Facebook concerns appeared in USA Today, thanks to a commission from the editor-in-chief, Joanne Lipman. USA Today published three of my op-eds over four months, helping me find my voice. CNBC’s Squawk Alley, where I am a regular contributor, reported on the first USA Today op-ed and has vigorously followed the story ever since. To Ben Thompson, Carl Quintanilla, Jon Fortt, Morgan Brennan, and the rest of the Squawk Alley team, thank you.

I first met Ali Velshi on the floor of the New York Stock Exchange in May 2017, when I was coming off an appearance on Squawk Alley. This was on the first trip that Tristan and I took to New York, and Ali was interested in what we thought was going on. Soon thereafter, Ali got his own show on MSNBC and started covering our story in October. He understands the issues, and his viewers benefit. Lily Corvo, Sarah Suminski, and the amazing makeup and production crews at MSNBC never cease to amaze. I gained insights every time I visited the green room at 30 Rock, thanks to an endless supply of smart, well-informed people. Thank you to Ari Melber, who brought his legal mind to the Facebook story, and to Lawrence O’Donnell for analyzing the story through the lens of his deep understanding of history, politics, and government. Katy Tur is an amazing journalist and was the first target of Trump’s attacks on the free press. She is also a serious fan of Phish, which is a plus in my book. Other guests on MSNBC shared important insights. In particular, I want to thank Clint Watts, Joyce Vance, and Eddie Glaude Jr. Thank you also to Chris Jansing, David Gura, Joanne Denyeau, Justin Oliver, and Michael Weiss.

This book would never have happened had it not been for Paul Glastris and Gilad Edelman, who commissioned an essay for the Washington Monthly, guided me through the process of writing it, and helped me realize that I was ready to write a book. That essay had far more impact than any of us imagined. Thank you, my friends.

Giant thanks go out to Jeff Orlowski, Lissa Rhodes, Laurie David, and Heather Reisman, who are creating a documentary about addiction to internet platforms and its consequences. My deep appreciation also goes to James Jacoby, Anya Bourg, Raney Aronson, Dana Priest, and the rest of the amazing team at Frontline for documenting the impact of social media on the 2016 election. In addition, I want to thank Geralyn White Dreyfous, Karim Armer, and their documentary team for digging deep into the Russian election interference.

Lucky accidents brought our team into the orbit of The Guardian and The Washington Post. In partnership with The Observer in the UK, The Guardian broke the Cambridge Analytica story. We worked with Paul Lewis, Olivia Solon, Julia Carrie Wong, and Amana Fontanella-Khan. Thank you all! At The Washington Post, we worked most closely with Elizabeth Dwoskin and Ruth Marcus. Thank you both! Thanks also to Betsy Morris for a wonderful profile in The Wall Street Journal.

On CBS This Morning, Gayle King, Norah O’Donnell, and John Dickerson jumped on the story and told it well to a huge audience. Thank you. Thanks also to Chitra Wadhwani. The team of Jo Ling Kent and Chiara Sottile broke important stories about Facebook on NBC. Thank you. Huge thanks to my longtime friend Maria Bartiromo and her booker Eric Spinato on Fox Business. Tucker Carlson on Fox zeroed in on the threat to kids and teens from social media. On Fox & Friends, Steve Doocy focused on privacy. Many thanks to Alexander McCaskill and Andrew Murray. Thank you to Hari Sreenivasan and the team at PBS NewsHour for giving me an opportunity to share the story with their audience. ITN’s Channel 4 in the United Kingdom broke giant stories about Cambridge Analytica and Facebook. Thank you to all the teams who produced those stories.

Huge thanks to all the radio programs that dug into the Facebook story. In particular, I want to thank CBC Radio in Canada, BBC Radio in the UK, NPR’s Morning Edition, NPR’s Weekend Edition, and Bloomberg Radio. Thank you also to Sarah Frier and Selina Wang at Bloomberg.

I tip my hat to David Kirkpatrick, whose interview of Zuck immediately after the 2016 election produced the “it’s crazy” response to the question of whether Facebook influenced the vote, for devoting a large portion of his conference a year later to the problems with internet platforms. David’s encouragement has meant the world to me.

Thank you to the many journalists and opinion writers whose work has informed my own. Special thanks to Zeynep Tufekci, Kara Swisher, Donie O’Sullivan, Charlie Wartzel, Casey Newton, April Glaser, Will Oremus, Franklin Foer, Tim Wu, Noam Cohen, Farhad Manjoo, Matt Rosenberg, Nick Bilton, Kurt Wagner, Dan Frommer, Julia Ioffe, Betsy Woodruff, Charles Pierce, Josh Marshall, Ben Smith, Brittany Kaiser, Niall Ferguson, Norm Eisen, and Fred Wertheimer (who also guided my approach to Washington).

On Capitol Hill, my appreciation goes out to every member and staffer who took a meeting with me. Thank you to Senators Richard Blumenthal, Cory Booker, Sherrod Brown, Al Franken, Orrin Hatch, Doug Jones, Tim Kaine, John Kennedy, Amy Klobuchar, Edward Markey, Jeff Merkley, Gary Peters, Tina Smith, Jon Tester, Mark Warner, and Elizabeth Warren. Thanks to staff members Elizabeth Falcone, Joel Kelsey, Sam Simon, Collin Anderson, Eric Feldman, Caitlyn Stephenson, Leslie Hylton, Bakari Middleton, Jeff Long, Joseph Wender, Stephanie Akpa, Brittany Sadler, Lauren Oppenheimer, and Laura Updegrove, among many others. Thank you also to the wonderful Diane Blagman.

Representatives Nancy Pelosi and Adam Schiff dug into the issues and have helped our team share its message broadly in the House. Thank you both! Thank you also to Representatives Kathy Castor, David Cicilline, Mike Doyle, Anna Eshoo, Brian Fitzgerald, Josh Gottheimer, Joe Kennedy, Ro Khanna, Barbara Lee, Zoe Lofgren, Seth Moulton, Frank Pallone, Jackie Speier, and Eric Swalwell. Staff members, including Kenneth DeGraff, Z. J. Hull, Linda Cohen, Thomas Eager, Maher Bitar, Angela Valles, and Slade Bond, have my undying gratitude. Luther Lowe helped me navigate Washington politics. Larry Irving and John Battelle contributed great ideas and helped me take the message to Procter & Gamble.

The former attorney general of New York State, Eric Schneiderman, was the first state AG to take a meeting with me and the first to recognize that internet platforms might be guilty of violating consumer protection laws. My thanks go to Noah Stein and his terrific colleagues.

Thank you to William Schultz and Andrew Goldfarb for great legal advice. Thank you to Erin McKean for helping me see how the changing perception of Facebook reveals itself in language.

I owe huge thanks to George and Tamiko Soros. George based a speech at the World Economic Forum’s Davos conference on my Washington Monthly essay and introduced me to an amazing set of ideas and people. Michael Vachon, in particular, has earned my thanks.

One of the most impressive people I met on this journey is Marietje Schaake, a member of the European Parliament from the Netherlands. Marietje is a global thought leader on balancing the needs of society with those of tech platforms. Andrew Rasiej and Micah Sifry of Civic Hall introduced me to Marietje and then guided me through the idealistic and deeply committed world of civic tech. Thank you.

Many people came out of nowhere to help me understand key issues: Ashkan Soltani, Wael Ghonim, Lawrence Lessig, Laurence Tribe, Larry Kramer, Michael Hawley, Jon Vein, Dr. Robert Lustig, Scott Galloway, Chris Hughes, Laura Rosenberger, Karen Kornbluh, Sally Hubbard, T Bone Burnett, Callie Khouri, Daniel Jones, Glenn Simpson, Justin Hendrix, Ryan Goodman, Siva Vaidhyanathan, B. J. Fogg, and Rob and Michele Reiner.

My deepest appreciation to Marc Benioff for supporting the cause early on. Thank you to Tim Berners-Lee for sharing my essay from Washington Monthly. Huge thanks to Gail Barnes for being my eyes and ears on social media. Thank you to Alex Knight, Bobby Goodlatte, David Cardinal, Charles Grinstead, Jon Luini, Michael Tchao, Bill Joy, Bill Atkinson, Garrett Gruener, and Andrew Shapiro for ideas, encouragement, and thought-provoking questions. Many thanks to Satya Nadella, Peggy Johnson, and Bill Gates for taking the issues seriously. Thank you to Tim Cook and all of Apple for their commitment to protecting the privacy and freedom of customers.

Bono provided invaluable counsel in the early stages of the work that led to this book.

My thanks go out to Herb Sandler, Angelo Carusone, Melissa Ryan, Rebecca Lenn, Eric Feinberg, and Gentry Lane.

Thank you to the Omidyar Network, the Knight Foundation, the Hewlett Foundation, and the Ford Foundation for their support of the Center for Humane Technology.

Thank you Moonalice—Barry Sless, Pete Sears, John Molo, and sometimes Jason Crosby and Katie Skene—for keeping me sane. Special thanks to our entire crew: Dan English, Jenna Lebowitz, Tim Stiegler, Derek Walls, Arthur Rosato, Patrick Spohrer, Joe Tang, Danny Schow, Chris Shaw, Alexandra Fischer, Nick Cernak, Bob Minkin, Rupert Coles, Jamie Soja, Michael Weinstein, and Gail Barnes. Let me also thank the wonderful fans of Moonalice. You know how important you are. Additional thanks to Lebo, Jay Lane, Melvin Seals, Lester Chambers, Dylan Chambers, Darby Gould, Lesley Grant, RonKat Spearman, James Nash, Greg Loiacono, Pete Lavezzoli, Stu Allen, Jeff Pehrson, Dawn Holliday, Grahame Lesh, Alex Jordan, Elliott Peck, Connor O’Sullivan, Bill and Lori Walton, Bob Weir, Mickey Hart, Jeff Chimenti, Rose Solomon, Scott Guberman, the Brothers Comatose, and Karin Conn.

Massive appreciation to Rory Lenny, Robin Gascon, Dawn Lafond, Gitte Dunn, Diarmuid Harrington, Peter McQuaid, Todd Shipley, Sixto Mendez, Bob Linzy, Fran Mottie, Nick Meriwether, Tim McQuaid, and Jeff Idelson.

My thanks go out to the Other World team, led by Ann McNamee, Hunter Bell, Jeff Bowen, Rebekah Tisch, and Sir Richard Taylor. Your unflagging support sustained me.

All these people and many more helped to bring this book to life. If I have forgotten anyone, I apologize. Any flaws in this book are my responsibility.

APPENDIX 1

MEMO TO ZUCK AND SHERYL: DRAFT OP-ED FOR RECODE

This is the essay I sent to Zuck and Sheryl prior to the election, in October 2016.

I am really sad about Facebook.

I got involved with the company more than a decade ago and have taken great pride and joy in the company’s success . . . until the past few months. Now I am disappointed. I am embarrassed. I am ashamed.

With more than 1.7 billion members, Facebook is among the most influential businesses in the world. Whether they like it or not—whether Facebook is a technology company or a media company—the company has a huge impact on politics and social welfare. Every decision that management makes can matter to the lives of real people. Management is responsible for every action. Just as they get credit for every success, they need to be held accountable for failures. Recently, Facebook has done some things that are truly horrible and I can no longer excuse its behavior.

Here is a sampling of recent actions that conspired to make me so unhappy with Facebook:

- Facebook offers advertisers the opportunity to target advertising by excluding demographic groups such as Blacks and Muslims. In categories such as residential real estate, it is not legal to discriminate on the basis of race. In politics, such a feature would empower racists.

- A 3rd party used Facebook’s public APIs to spy on Black Lives Matter. Management’s response was, “hey, they are public APIs; anybody can do that.” This response is disingenuous, ignoring the fact that Facebook sets the terms of service for every aspect of its site, including APIs, and could easily change the terms to prohibit spying.

- Facebook’s facial recognition software is being used to identify people who have not given permission. Given Facebook’s apparent willingness to let 3rd parties use its site to spy, the facial recognition raises Fourth Amendment issues of Orwellian proportions.

- Facebook’s algorithms have played a huge role in this election cycle by limiting each member’s news feed to “things they like,” which effectively prevents people from seeing posts that contradict their preconceptions. Trolls on both sides have exploited this bug to spread untruths and inflame emotions.

- Facebook removed human editors from its trending stories list—one of the few ways consumers on FB could be exposed to new stories—and the immediate effect was an explosion in spam stories.

- Facebook is one of many Silicon Valley companies whose employee base is overwhelmingly male and white. Despite having a woman president, Facebook has not made as much progress on diversity as some of its Silicon Valley peers.

- Facebook has publicly defended a board member who has written and spoken publicly against the 19th Amendment and diversity in the workplace.

Lest you think these mistakes were unconscious, consider the following:

- Facebook censors photos in a manner that could be described as puritanical. Recent censorship examples include the Pulitzer prize winning photo of the napalm girl in Vietnam and just about every photograph of breast feeding. Facebook has a prohibition against photographs of female nipples, but does not censor photographs of male nipples.

- Facebook does not allow medical marijuana dispensaries in California to maintain pages, even when they operate in compliance with state laws.

- Facebook has prohibited some promoted posts related to California’s Proposition 64–Adult Use of Marijuana Act—claiming that the ads promote something illegal, when in fact they are political ads for a proposition on this year’s ballot.

These examples are not equally significant, but as a list they reveal something important: Facebook is not laissez-faire about what happens on its site. Quite the contrary. The only content that stays up on the site is content consistent with Facebook’s policies. For a long time, Facebook’s policies did no harm, even when they were hard to justify. That is no longer the case. Facebook is enabling people to do harm. It has the power to stop the harm. What it currently lacks is an incentive to do so.

All of these actions took place against a backdrop of extraordinary growth in Facebook usage, revenues and profits. Facebook is among the best performing stocks on Wall Street and one of the most influential companies in the world, which gives many people an excuse to overlook mistakes and reduces the population of people willing to provide constructive criticism. I have reached out directly to management on some of these issues and to members of the press on others; most of my inquiries were ignored and the few responses were unsatisfactory.

It is with considerable reluctance that I am raising these issues through Recode. My goal is to persuade Facebook to acknowledge the mistakes it is making, accept responsibility and implement better business practices. Facebook can be successful without being socially irresponsible. We know this because Facebook has chosen to forego a huge economic opportunity in China out of concern for the welfare of the members it would have in that country.

What will it take for Facebook to change? Facebook’s executives are a team. In order to empower executives and encourage constructive dissent, they have a policy of sticking together, no matter what. This kind of teamwork has enabled Facebook to grow rapidly and achieve huge scale, but has an ugly side, too. At Facebook, individuals in the senior management team are not punished for mistakes, even big mistakes. As I was told when something disturbing happened several years ago, accountability at Facebook occurs at the team level. This model has produced amazing results—and made so many things better—but it effectively means there is no accountability unless a problem rises to the level where the board would be willing to replace the entire management team. I cannot imagine a realistic scenario where that would happen. So here we are, with increasingly disturbing revelations on what seems like a weekly basis. I want to find a way to encourage Facebook’s management to be more socially responsible.

The importance of Facebook’s role in our culture and politics cannot be overstated. On current course and speed, Facebook can do more damage in a few months than we can correct in a year. I am hoping to build a coalition of people who share my concern, are willing to engage with Facebook, help them understand our concerns, and work with them to address them. As individuals, we have no power to change Facebook’s behavior, but perhaps we can build a coalition large enough to make a difference.

APPENDIX 2

GEORGE SOROS’S DAVOS REMARKS: “THE CURRENT MOMENT IN HISTORY”

Davos, Switzerland, January 25, 2018

The Current Moment in History

Good evening. It has become something of an annual Davos tradition for me to give an overview of the current state of the world. I was planning half an hour for my remarks and half an hour for questions, but my speech has turned out to be closer to an hour. I attribute this to the severity of the problems confronting us. After I’ve finished, I’ll open it up for your comments and questions. So prepare yourselves.

I find the current moment in history rather painful. Open societies are in crisis, and various forms of dictatorships and mafia states, exemplified by Putin’s Russia, are on the rise. In the United States, President Trump would like to establish a mafia state but he can’t, because the Constitution, other institutions, and a vibrant civil society won’t allow it.

Whether we like it or not, my foundations, most of our grantees and myself personally are fighting an uphill battle, protecting the democratic achievements of the past. My foundations used to focus on the so-called developing world, but now that the open society is also endangered in the United States and Europe, we are spending more than half our budget closer to home because what is happening here is having a negative impact on the whole world.

But protecting the democratic achievements of the past is not enough; we must also safeguard the values of open society so that they will better withstand future onslaughts. Open society will always have its enemies, and each generation has to reaffirm its commitment to open society for it to survive.

The best defense is a principled counterattack. The enemies of open society feel victorious and this induces them to push their repressive efforts too far, this generates resentment and offers opportunities to push back. That is what is happening in places like Hungary today.

I used to define the goals of my foundations as “defending open societies from their enemies, making governments accountable and fostering a critical mode of thinking.” But the situation has deteriorated. Not only the survival of open society, but the survival of our entire civilization is at stake. The rise of leaders such as Kim Jong-Un in North Korea and Donald Trump in the US have much to do with this. Both seem willing to risk a nuclear war in order to keep themselves in power. But the root cause goes even deeper.

Mankind’s ability to harness the forces of nature, both for constructive and destructive purposes, continues to grow while our ability to govern ourselves properly fluctuates, and it is now at a low ebb.

The threat of nuclear war is so horrendous that we are inclined to ignore it. But it is real. Indeed, the United States is set on a course toward nuclear war by refusing to accept that North Korea has become a nuclear power. This creates a strong incentive for North Korea to develop its nuclear capacity with all possible speed, which in turn may induce the United States to use its nuclear superiority preemptively; in effect to start a nuclear war in order to prevent nuclear war—an obviously self-contradictory strategy.

The fact is, North Korea has become a nuclear power and there is no military action that can prevent what has already happened. The only sensible strategy is to accept reality, however unpleasant it is, and to come to terms with North Korea as a nuclear power. This requires the United States to cooperate with all the interested parties, China foremost among them. Beijing holds most of the levers of power against North Korea, but is reluctant to use them. If it came down on Pyongyang too hard, the regime could collapse and China would be flooded by North Korean refugees. What is more, Beijing is reluctant to do any favors for the United States, South Korea or Japan—against each of which it harbors a variety of grudges. Achieving cooperation will require extensive negotiations, but once it is attained, the alliance would be able to confront North Korea with both carrots and sticks. The sticks could be used to force it to enter into good faith negotiations and the carrots to reward it for verifiably suspending further development of nuclear weapons. The sooner a so-called freeze-for-freeze agreement can be reached, the more successful the policy will be. Success can be measured by the amount of time it would take for North Korea to make its nuclear arsenal fully operational. I’d like to draw your attention to two seminal reports just published by Crisis Group on the prospects of nuclear war in North Korea.

The other major threat to the survival of our civilization is climate change, which is also a growing cause of forced migration. I have dealt with the problems of migration at great length elsewhere, but I must emphasize how severe and intractable those problems are. I don’t want to go into details on climate change either because it is well known what needs to be done. We have the scientific knowledge; it is the political will that is missing, particularly in the Trump administration.

Clearly, I consider the Trump administration a danger to the world. But I regard it as a purely temporary phenomenon that will disappear in 2020, or even sooner. I give President Trump credit for motivating his core supporters brilliantly, but for every core supporter, he has created a greater number of core opponents who are equally strongly motivated. That is why I expect a Democratic landslide in 2018.

My personal goal in the United States is to help reestablish a functioning two-party system. This will require not only a landslide in 2018 but also a Democratic Party that will aim at non-partisan redistricting, the appointment of well-qualified judges, a properly conducted census and other measures that a functioning two-party system requires.

The IT Monopolies

I want to spend the bulk of my remaining time on another global problem: the rise and monopolistic behavior of the giant IT platform companies. These companies have often played an innovative and liberating role. But as Facebook and Google have grown into ever more powerful monopolies, they have become obstacles to innovation, and they have caused a variety of problems of which we are only now beginning to become aware.

Companies earn their profits by exploiting their environment. Mining and oil companies exploit the physical environment; social media companies exploit the social environment. This is particularly nefarious because social media companies influence how people think and behave without them even being aware of it. This has far-reaching adverse consequences on the functioning of democracy, particularly on the integrity of elections.

The distinguishing feature of internet platform companies is that they are networks and they enjoy rising marginal returns; that accounts for their phenomenal growth. The network effect is truly unprecedented and transformative, but it is also unsustainable. It took Facebook eight and a half years to reach a billion users and half that time to reach the second billion. At this rate, Facebook will run out of people to convert in less than three years.

Facebook and Google effectively control over half of all internet advertising revenue. To maintain their dominance, they need to expand their networks and increase their share of users’ attention. Currently they do this by providing users with a convenient platform. The more time users spend on the platform, the more valuable they become to the companies.

Content providers also contribute to the profitability of social media companies because they cannot avoid using the platforms and they have to accept whatever terms they are offered.

The exceptional profitability of these companies is largely a function of their avoiding responsibility for—and avoiding paying for—the content on their platforms.

They claim they are merely distributing information. But the fact that they are near-monopoly distributors makes them public utilities and should subject them to more stringent regulations, aimed at preserving competition, innovation, and fair and open universal access.

The business model of social media companies is based on advertising. Their true customers are the advertisers. But gradually a new business model is emerging, based not only on advertising but on selling products and services directly to users. They exploit the data they control, bundle the services they offer and use discriminatory pricing to keep for themselves more of the benefits that otherwise they would have to share with consumers. This enhances their profitability even further—but the bundling of services and discriminatory pricing undermine the efficiency of the market economy.

Social media companies deceive their users by manipulating their attention and directing it towards their own commercial purposes. They deliberately engineer addiction to the services they provide. This can be very harmful, particularly for adolescents. There is a similarity between internet platforms and gambling companies. Casinos have developed techniques to hook gamblers to the point where they gamble away all their money, even money they don’t have.

Something very harmful and maybe irreversible is happening to human attention in our digital age. Not just distraction or addiction; social media companies are inducing people to give up their autonomy. The power to shape people’s attention is increasingly concentrated in the hands of a few companies. It takes a real effort to assert and defend what John Stuart Mill called “the freedom of mind.” There is a possibility that once lost, people who grow up in the digital age will have difficulty in regaining it. This may have far-reaching political consequences. People without the freedom of mind can be easily manipulated. This danger does not loom only in the future; it already played an important role in the 2016 US presidential election.

But there is an even more alarming prospect on the horizon. There could be an alliance between authoritarian states and these large, data-rich IT monopolies that would bring together nascent systems of corporate surveillance with an already developed system of state-sponsored surveillance. This may well result in a web of totalitarian control the likes of which not even Aldous Huxley or George Orwell could have imagined.

The countries in which such unholy marriages are likely to occur first are Russia and China. The Chinese IT companies in particular are fully equal to the American ones. They also enjoy the full support and protection of the Xi Jingping regime. The government of China is strong enough to protect its national champions, at least within its borders.

US-based IT monopolies are already tempted to compromise themselves in order to gain entrance to these vast and fast-growing markets. The dictatorial leaders in these countries may be only too happy to collaborate with them since they want to improve their methods of control over their own populations and expand their power and influence in the United States and the rest of the world.

The owners of the platform giants consider themselves the masters of the universe, but in fact they are slaves to preserving their dominant position. It is only a matter of time before the global dominance of the US IT monopolies is broken. Davos is a good place to announce that their days are numbered. Regulation and taxation will be their undoing and EU Competition Commissioner Vestager will be their nemesis.

There is also a growing recognition of a connection between the dominance of the platform monopolies and the rising level of inequality. The concentration of share ownership in the hands of a few private individuals plays some role but the peculiar position occupied by the IT giants is even more important. They have achieved monopoly power, but at the same time they are also competing against each other. They are big enough to swallow startups that could develop into competitors, but only the giants have the resources to invade each other’s territory. They are poised to dominate the new growth areas that artificial intelligence is opening up, like driverless cars.

The impact of innovations on unemployment depends on government policies. The European Union and particularly the Nordic countries are much more farsighted in their social policies than the United States. They protect the workers, not the jobs. They are willing to pay for re-training or retiring displaced workers. This gives workers in Nordic countries a greater sense of security and makes them more supportive of technological innovations than workers in the US.

The internet monopolies have neither the will nor the inclination to protect society against the consequences of their actions. That turns them into a menace, and it falls to the regulatory authorities to protect society against them. In the United States, the regulators are not strong enough to stand up against their political influence. The European Union is better situated because it doesn’t have any platform giants of its own.

The EU uses a different definition of monopoly power from the United States. US law enforcement focuses primarily on monopolies created by acquisitions, whereas EU law prohibits the abuse of monopoly power irrespective of how it is achieved. Europe has much stronger privacy and data protection laws than America. Moreover, US law has adopted a strange doctrine: it measures harm as an increase in the price paid by customers for services received—and that is almost impossible to prove when most services are provided for free. This leaves out of consideration the valuable data platform companies collect from their users.

Commissioner Vestager is the champion of the European approach. It took the EU seven years to build a case against Google, but as a result of her success the process has been greatly accelerated. Due to her proselytizing, the European approach has begun to affect attitudes in the United States as well.

The Rise of Nationalism and How to Reverse It

I have mentioned several of the most pressing and important problems confronting us today. In conclusion, let me point out that we are living in a revolutionary period. All our established institutions are in a state of flux and in these circumstances both fallibility and reflexivity are operating at full force.

I lived through similar conditions in my life, most recently some thirty years ago. That’s when I set up my network of foundations in the former Soviet empire. The main difference between the two periods is that thirty years ago the dominant creed was international governance and cooperation. The European Union was the rising power and the Soviet Union the declining one. Today, however, the motivating force is nationalism. Russia is resurgent and the European Union is in danger of abandoning its values.

As you will recall, the previous experience didn’t turn out well for the Soviet Union. The Soviet empire collapsed and Russia has become a mafia state that has adopted a nationalist ideology. My foundations did quite well: the more advanced members of the Soviet empire joined the European Union.

Now our aim is to help save the European Union in order to radically reinvent it. The EU used to enjoy the enthusiastic support of the people of my generation, but that changed after the financial crisis of 2008. The EU lost its way because it was governed by outdated treaties and a mistaken belief in austerity policies. What had been a voluntary association of equal states was converted into a relationship between creditors and debtors where the debtors couldn’t meet their obligations and the creditors set the conditions that the debtors had to meet. That association was neither voluntary nor equal.

As a consequence, a large proportion of the current generation has come to regard the European Union as its enemy. One important country, Britain, is in the process of leaving the EU and at least two countries, Poland and Hungary, are ruled by governments that are adamantly opposed to the values on which the European Union is based. They are in acute conflict with various European institutions and those institutions are trying to discipline them. In several other countries anti-European parties are on the rise. In Austria, they are in the governing coalition, and the fate of Italy will be decided by the elections in March.

How can we prevent the European Union from abandoning its values? We need to reform it at every level: at the level of the Union itself, at the level of the member states and the level of the electorate. We are in a revolutionary period; everything is subject to change. The decisions taken now will determine the shape of the future.

At the Union level, the main question is what to do about the euro. Should every member state be required to eventually adopt the euro, or should the current situation be allowed to continue indefinitely? The Maastricht Treaty prescribed the first alternative but the euro has developed some defects that the Maastricht Treaty didn’t foresee and still await resolution.

Should the problems of the euro be allowed to endanger the future of the European Union? I would strongly argue against it. The fact is that the countries that don’t qualify are eager to join the euro, but those that do have decided against it, with the exception of Bulgaria. In addition, I should like to see Britain remain a member of the EU or eventually rejoin it, and that couldn’t happen if it meant adopting the euro.

The choice confronting the EU could be better formulated as one between a multispeed and a multitrack approach. In a multispeed approach, member states have to agree in advance on the ultimate outcome; in a multitrack approach, member states are free to form coalitions of the willing to pursue particular goals on which they agree. The multitrack approach is obviously more flexible but the European bureaucracy favored the multispeed approach. That was an important contributor to the rigidity of the EU’s structure.

At the level of the member states, their political parties are largely outdated. The old distinction between left and right is overshadowed by being either pro- or anti-European. This manifests itself differently in different countries.

In Germany, the Siamese twin arrangement between the CDU and the CSU has been rendered unsustainable by the results of the recent elections. There is another party, the AfD further to the right than the CSU in Bavaria. This has forced the CSU to move further to the right in anticipation of next year’s local elections in Bavaria so that the gap between the CSU and the CDU has become too great. This has rendered the German party system largely dysfunctional until the CDU and CSU break up.

In Britain, the Conservatives are clearly the party of the right and Labor the party of the left, but each party is internally divided in its attitude toward Brexit. This complicates the Brexit negotiations immensely, and makes it extremely difficult for Britain as a country to decide and modify its position towards Europe.

Other European countries can be expected to undergo similar realignments with the exception of France, which has already undergone its internal revolution.

At the level of the electorate, the top-down initiative started by a small group of visionaries led by Jean Monnet carried the process of integration a long way, but it has lost its momentum. Now we need a combination of the top-down approach of the European authorities with the bottom-up initiatives started by an engaged electorate. Fortunately, there are many such bottom-up initiatives; it remains to be seen how the authorities will respond to them. So far, President Macron has shown himself most responsive. He campaigned for the French presidency on a pro-European platform, and his current strategy focuses on the elections for the European Parliament in 2019, and that requires engaging the electorate.

While I have analyzed Europe in greater detail, from a historical perspective what happens in Asia is ultimately much more important. China is the rising power. There were many fervent believers in the open society in China who were sent to be reeducated in rural areas during Mao’s Revolution. Those who survived returned to occupy positions of power in the government. So the future direction of China used to be open-ended, but no more.

The promoters of open society have reached retirement age, and Xi Jinping, who has more in common with Putin than with the so-called West, has begun to establish a new system of party patronage. I’m afraid that the outlook for the next twenty years is rather bleak. Nevertheless, it’s important to embed China in institutions of global governance. This may help to avoid a world war that would destroy our entire civilization.

That leaves the local battlegrounds in Africa, the Middle East, and Central Asia. My foundations are actively engaged in all of them. We are particularly focused on Africa, where would-be dictators in Kenya, Zimbabwe, and the Democratic Republic of Congo have perpetrated electoral fraud on an unprecedented scale, and citizens are literally risking their lives to resist the slide into dictatorship. Our goal is to empower local people to deal with their own problems, assist the disadvantaged and reduce human suffering to the greatest extent possible. This will leave us plenty to do well beyond my lifetime.

BIBLIOGRAPHIC ESSAY

Normally I prefer to read novels. In the two years since I first realized there was a problem at Facebook, I have read several novels and many nonfiction volumes that helped me understand that problem. In this essay, I want to share my intellectual journey but also point to books and other media that shed light on the people, business practices, and culture that enabled it.

My education about the dark side of social media began in 2011 with Eli Pariser’s groundbreaking TED Talk on filter bubbles. I recommend the video of that talk, as well as Eli’s book, The Filter Bubble: What the Internet Is Hiding from You (New York: Penguin Press, 2012).

The book that energized me in early 2017 was Move Fast and Break Things: How Facebook, Google, and Amazon Cornered Culture and Undermined Democracy, by Jonathan Taplin (New York: Little, Brown and Company, 2017). Taplin had brilliant careers in rock ’n’ roll and Hollywood before moving to academia. He describes how internet platforms exploited a legal safe harbor to take over American culture, in the process causing serious damage to democracy. Tim Wu’s The Attention Merchants: The Epic Scramble to Get Inside Our Heads (New York: Alfred A. Knopf, 2016) explains the history of persuasion for profit from tabloid newspapers through social media. It is essential reading. World Without Mind: The Existential Threat of Big Tech, by Franklin Foer (New York: Penguin Press, 2017), sharpens the argument against unconstrained capitalism on the internet. Both Taplin and Foer pine for the past in media, when everything was more genteel and the public square remained vibrant, but that does not prevent them from contributing to the critical discussion about what needs to be done.

Relative to Facebook, the place to start is with The Facebook Effect: The Inside Story of the Company That Is Connecting the World, by David Kirkpatrick (New York: Simon & Schuster, 2010). Written early in Facebook’s history, this book exudes the optimism that I and so many others felt about Facebook’s future, but Kirkpatrick also manages to foreshadow almost every problem triggered by Facebook’s success. As a companion, I recommend Antisocial Media: How Facebook Disconnects Us and Undermines Democracy, by Siva Vaidhyanathan (New York: Oxford University Press, 2018). Antisocial Media pulls back the curtain on Facebook’s technology and what it really does to users. This is a must-read.

Zuck and others criticize the film The Social Network and the book on which it was based, The Accidental Billionaires: The Founding of Facebook: A Tale of Sex, Money, Genius, and Betrayal, by Ben Mezrich (New York: Anchor, Reprint edition 2010), as inaccurate to the point of being fiction. The sad thing is how consistent the personalities and behaviors depicted in these stories are with the Facebook people caught in the glare of election interference and Cambridge Analytica.

There are several good books about the culture in Silicon Valley. A good place to start is Brotopia: Breaking Up the Boys’ Club of Silicon Valley, by Emily Chang (New York: Portfolio, 2018). Chang is the host of Bloomberg Technology, the show on which I interviewed Tristan in April 2017, after his appearance on 60 Minutes. (Emily was on maternity leave that day!) The domination of Silicon Valley by young Asian and Caucasian men seems foundational to the culture that built Facebook, YouTube, and the others. Chang cuts to the heart of the matter.

Chaos Monkeys: Obscene Fortune and Random Failure in Silicon Valley, by Antonio García Martínez (New York: Harper, 2016), is the inside story of an engineer who started a company, ran out of money, got a gig in advertising technology at Facebook, and was there during the formative years of the business practices that enabled Cambridge Analytica. Through the lens of this book, you will get a clear view of the culture and internal practices of Facebook and other platforms.

Valley of Genius: The Uncensored History of Silicon Valley, by Adam Fisher (New York: Twelve, 2018), is a collection of interviews and quotes from participants at nearly every stage of Silicon Valley’s development. The book begins in the sixties, with Douglas Engelbart, and marches steadily to the present. The interview with Facebook founders and early employees is essential reading. There are also illuminating interviews with the early people at Google and Twitter.

There are two works of fiction that prepared me to recognize the disturbing signals I picked up from Facebook in 2016. The Circle, by Dave Eggers (New York: Alfred A. Knopf, 2013), describes a fictional company that combines the attributes of Facebook and Google. Written as science fiction, the issues it raises came to market only a few years after publication. After On, by Rob Reid (New York: Del Rey, 2017), imagines a next-generation social network whose AI becomes sentient. This is a long but incredibly funny novel that is worth every moment you spend with it. You will understand why technologists must be forced to prepare for unintended consequences. They always happen, and their impact is increasingly harmful.

HBO’s television series Silicon Valley lampoons the startup culture in a way that always rings true. The plots are exaggerated, but not by as much as you might think. The Valley culture is strange. When I first met the creative team, I asked the boss man, Mike Judge, to describe the gestalt of the show. He said, “There is a titanic struggle between the hippie culture espoused by people like Steve Jobs and the libertarian culture of Peter Thiel.” I responded, “And the libertarians are winning.” He smiled. I looked around the table and realized why I was there. “Because I’m one of the last hippies.” They all smiled. Full disclosure: I have been a technical consultant on Silicon Valley since season 2.

After I met Tristan Harris, I spent several months learning everything I could about persuasive technology, from the underlying psychology to the ways it can be implemented in software. I started with Tristan’s many interviews and blog posts before reading the textbook Persuasive Technology: Using Computers to Change What We Think and Do, by B. J. Fogg (San Francisco: Morgan Kaufmann, 2002), the Stanford University professor who taught Tristan and so many others. The textbook is well written, which made me realize how easy it would have been for students to grasp the techniques of persuasive technology and appreciate its power. The layman’s version of Fogg’s book is Hooked: How to Build Habit-Forming Products, by Nir Eyal (New York: Portfolio, 2016). Eyal is an unapologetic advocate for persuasive technology, an addiction-denier who has built a successful business teaching entrepreneurs and engineers how to exploit human psychology in software.

Once I understood how persuasive technology works, I consulted two fantastic books on the psychological impact of persuasive technology on smartphones, tablets, and computers. Irresistible: The Rise of Addictive Technology and the Business of Keeping Us Hooked, by Adam Alter (New York: Penguin Press, 2017), is comprehensive, well written, and easy to understand. It covers a wide range of harms across every age group. A must read. Glow Kids: How Screen Addiction Is Hijacking Our Kids—and How to Break the Trance, by Nicholas Kardaras (New York: St. Martin’s Press, 2016), focuses on kids. If you have young children, I predict this book will cause you to limit their exposure to screens and to protect them from a range of applications. Another important book is It’s Complicated: The Social Lives of Networked Teens, by danah boyd (New Haven: Yale University Press, 2014). This should be must reading for parents.

Social media has taken over the public square in almost every country where Facebook and other platforms operate. Twitter and Tear Gas: The Power and Fragility of Networked Protest, by Zeynep Tufekci (New Haven: Yale University Press, 2017), probes the use of social media by protesters and the counterattacks of the powerful. Tufekci writes a monthly opinion piece in The New York Times that smartens me up every time. This book helped me understand what really happened in the Arab Spring and why the internet platforms’ current incentives always favor those in power. Messing with the Enemy: Surviving in a Social Media World of Hackers, Terrorists, Russians, and Fake News, by Clint Watts (New York: Harper, 2018), is the best book I found on the use of social media by bad actors, and it’s great! Clint was an agent at the FBI who now spends his time monitoring hostile activity on social media. I have met Clint a few times around MSNBC; his insights profoundly improved this book. The Square and the Tower: Networks and Power, from the Freemasons to Facebook, by Niall Ferguson (New York: Penguin Press, 2018), puts the power of Facebook and Google into historical context. Scary.

Ten Arguments for Deleting Your Social Media Accounts Right Now, by Jaron Lanier (New York: Henry Holt and Co., 2018), is short and sweet. Lanier has been a thought leader in technology for three decades, with an early emphasis on virtual reality, but in this book he speaks as a concerned technologist who is also a philosopher about technology. This book did not need ten arguments, but I learned something from every one. One of Lanier’s major concerns—unrestricted development of artificial intelligence—is the subject of Machines of Loving Grace, by John Markoff (New York: Ecco, 2015). The book explains how artificial intelligence risks undermining humans, rather than leveraging them.

To understand the world of Big Data, and the challenges it poses to society, I recommend Cathy O’Neil’s Weapons of Math Destruction (New York: Crown, 2016), which has the best explanation of the good, the bad, and the ugly of algorithms that I have ever read. Yuval Harari’s 21 Lessons for the 21st Century (New York: Spiegel & Grau, 2018), explores the implication of a future where robots and artificial intelligence threaten the relevance of humans in the economy.

It is hard to appreciate fully the threat from internet platforms without understanding the business philosophy that gave rise to them. The Lean Startup: How Today’s Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses, by Eric Ries (New York: Currency, 2011), was the bible for entrepreneurs and venture capitalists from the time Ries first proposed it in 2008. Zero to One: Notes on Startups, or How to Build the Future, by Peter Thiel (New York: Crown Business, 2014), is a glimpse inside the mind of Facebook’s first outside investor. Libertarianism remains fashionable in Silicon Valley, though not everyone has embraced Thiel’s version of it. The Four: The Hidden DNA of Amazon, Apple, Facebook, and Google, by Scott Galloway (New York: Portfolio, 2017), is an unusually insightful business book. The former entrepreneur and current professor at the NYU Stern School of Business combines a deep understanding of economics and business with trenchant analyses of management and strategy.

There is more to the tech industry today than internet platforms. Companies founded before 1990 have fundamentally different cultures. The CEO of Microsoft, Satya Nadella, wrote about this vision for a better tech industry in Hit Refresh: The Quest to Rediscover Microsoft’s Soul and Imagine a Better Future for Everyone (New York: HarperBusiness, 2017). Sadly, the vision he recommends does not seem to appeal to the founders of internet platforms.

—

FEW PEOPLE REALIZE HOW much Silicon Valley has changed since 2000. Culturally, there is no comparison to the eighties or nineties. I think of Silicon Valley’s culture as having three distinct eras: Apollo, Hippie, and Libertarian. In the Apollo era, the engineers were white males in short-sleeve white shirts, with a tie and plastic pocket protector. The hippie era, which began with Atari, soon to be followed by Apple, created video games and personal computers. It faded in the nineties, before dying out when the internet bubble burst in 2000. The first two eras saw great inventions and huge growth, creating a giant reservoir of goodwill and trust with consumers and policy makers. The libertarian era that began just after 2000 transformed the value system, culture, and business models of Silicon Valley, enabling Google, Facebook, and Amazon to create unprecedented wealth by dominating the public square on a global basis. I liked the Apollo and hippie eras because their idealism was genuine, even when it was misdirected. There are some excellent books that will unlock the mysteries of Silicon Valley’s early and middle days. Please read them!

A good place to start is with semiconductors, the original business of Silicon Valley. I recommend The Man Behind the Microchip: Robert Noyce and the Invention of Silicon Valley, by Leslie Berlin (New York: Oxford University Press, 2005). Noyce is a thread from the transistor to the Intel microprocessor. The Dream Machine: J. C. R. Licklider and the Revolution That Made Computing Personal, by M. Mitchell Waldrop (New York: Viking, 2001), explains how the idea of personal computing came to be. Bootstrapping: Douglas Engelbart, Coevolution, and the Origins of Personal Computing, by Thierry Bardini (Palo Alto: Stanford University Press, 2000), tells the story of the genius who created the mouse, visualized a networked world of PCs, and gave the Mother of All Demos. Dealers of Lightning: Xerox PARC and the Dawn of the Computer Age, by Michael A. Hiltzik (New York: HarperBusiness, 1999), takes the reader inside the research center in Palo Alto where Steve Jobs saw the future. Troublemakers: Silicon Valley’s Coming of Age, by Leslie Berlin (New York: Simon & Schuster, 2017), tells the story of the men and women, some well known, others obscure, who helped to build Silicon Valley. The Innovators: How a Group of Hackers, Geniuses and Geeks Created the Digital Revolution, by Walter Isaacson (New York: Simon & Schuster, 2014), looks back on the key people whose work created Silicon Valley. What the Dormouse Said: How the 60s Counterculture Shaped the Personal Computer Industry, by John Markoff (New York: Viking, 2005), shows how hippie culture became the culture of the PC industry. Tom Wolfe’s The Electric Kool-Aid Acid Test (New York: Farrar Straus and Giroux, 1968) is a helpful introduction to the culture embraced by a core group in Silicon Valley at a critical time. Fire in the Valley: The Making of the Personal Computer, by Paul Freiberger and Michael Swaine (Berkeley: Osborne/McGraw-Hill, 1984), is the best book I know on the early days of the personal computer industry, from computer clubs to the start of Microsoft and Apple, to the battle that followed. The revised edition, which bears a different subtitle, follows the industry into its declining years. Hackers: Heroes of the Computer Revolution, by Steven Levy (New York: Anchor Press/Doubleday, 1984), investigates a key subculture in Silicon Valley. Levy wrote this as it was happening, which makes the book particularly helpful, as in the case of The Facebook Effect. Cyberpunk: Outlaws and Hackers on the Computer Frontier, by Katie Hafner and John Markoff (New York: Simon & Schuster, 1991), picks up the story of Hackers and carries it forward.

—

I RECOMMEND LEARNING ABOUT the origin stories of the other internet platforms. The Everything Store: Jeff Bezos and the Age of Amazon, by Brad Stone (New York: Little, Brown and Co., 2013), blew my mind. I remember the day Jeff Bezos first presented to my partners, the venture capital firm of Kleiner Perkins Caufield & Byers. There is a very strong argument that the success of Amazon represents the greatest accomplishment of any startup since 1990. Bezos is amazing. His relatively low profile masks the pervasive influence of his company.

Like The Facebook Effect, In the Plex: How Google Thinks, Works, and Shapes Our Lives, by Steven Levy (New York: Simon & Schuster, 2011), is exceptionally sympathetic to its subject. That is the price of getting access to a tech giant. As long as you remind yourself that Google adjusts search results based on what it perceives to be your interests and that YouTube’s algorithms promote conspiracy theories, you will get a great deal of value from this book. Hatching Twitter: A True Story of Money, Power, Friendship, and Betrayal, by Nick Bilton (New York, Portfolio, 2013), is worth reading because of Twitter’s outsized influence on journalists, an influence out of proportion with the skills of Twitter’s leadership.

No study of Silicon Valley would be complete without a focus on Steve Jobs. Walter Isaacson’s biography Steve Jobs (New York: Simon & Schuster, 2011) was a bestseller. I was lucky enough to know Steve Jobs. We were not close, but I knew Steve for a long time and had several opportunities to work with him. I experienced the best and the worst. Above all, I respect beyond measure all the amazing products created on Steve’s watch.

This bibliographic essay includes only the books that helped me prepare to write Zucked. There are other fine books on these topics.

ABCDEFGHIJKLMNOPQRSTUVWXYZ

INDEX

The page numbers in this index refer to the printed version of this book. The link provided will take you to the beginning of that print page. You may need to scroll forward from that location to find the corresponding reference on your e-reader.

Accel Partners, 54, 58

Acxiom, 226

addiction, 100–101, 106–7, 162, 206, 240, 246, 250, 253, 254, 257, 268, 269, 281

advertising, 17, 47, 68–69, 85–86, 105, 120, 125, 257, 283–84

Facebook and, 11–12, 47, 59–61, 63, 68–77, 85, 103, 119, 128–29, 130, 132, 143, 148, 173, 184, 185, 202, 207–9, 211, 217–19, 237–38, 258, 265, 270, 281

Google and, 47, 67–69, 86, 104, 173, 283–86

political, microtargeting in, 237–38

YouTube and, 103, 283–84

Albright, Jonathan, 125

Alcorn, Al, 34

algorithms, 66, 94, 98, 122, 128, 129, 169, 264

extreme views and, 92

of Facebook, 4, 9, 11, 66, 74, 76, 81, 87, 91, 128–29, 143, 166, 232, 235, 243, 270, 274, 277, 281

of Google, 66, 235

of YouTube, 92–93, 139, 274

Allen, Paul, 25

Altair, 34

Altavista, 42

Alter, Adam, 272

Amanpour, Christiane, 147

Amazon, 16, 27, 36, 38, 68, 137, 224, 262, 283

Alexa, 137, 262, 268, 271, 281

Echo, 236

market power of, 46

monopoly power and antitrust issues, 47–48, 136–40, 225–26, 246, 247, 261, 262, 284

Web Services, 40, 41, 137, 138

words associated with, 231

American Academy of Pediatrics, 273

Anderson, Chris, 109

Anderson, Fred, 14

Andreessen, Marc, 27, 36, 37, 43, 58

Android, 138, 204, 271, 282

angel investors, 48

anonymity, 37, 55, 92, 101, 123

antitrust and monopoly issues, 46–48, 136–41, 162, 220, 223, 224, 227, 234, 238, 246, 247, 250, 261–63, 277, 279, 281–83, 285–87

Amazon and, 47–48, 136–40, 225–26, 246, 247, 261, 262, 284

AT&T and, 224–25

Facebook and, 47–48, 100, 136–41, 162, 225–26, 234, 246, 247, 261, 263, 284

Google and, 47–48, 136–40, 162, 225–26, 234, 246, 247, 261–63, 282, 284

Microsoft and, 46–47, 154–55, 286

Apache, 40

Apple, 14, 25, 29–30, 34, 35, 38, 49, 50, 83, 118, 249

iPhone, 38, 84, 100, 105–6, 271

Jones and Infowars and, 228–29

market power of, 46

Onavo and, 140

privacy and, 38, 158, 271

Silver Lake and, 29–30

words associated with, 231

approval, need for, 98

Apture, 107

Arab Spring, 64, 243

ARPANET, 34–35

artificial intelligence (AI), 69, 84–85, 88, 98, 128, 151, 158, 219–20, 223, 236, 252, 260, 261, 263, 264, 267–69, 272

of Facebook, 10, 11, 69, 85, 87, 91, 95, 108, 203, 219–20, 230, 261

of Google, 108, 219–20, 253, 261

Associated Press, 124

AT&T, 224–25

Atari, 34

Atlantic, 195, 231

Attention Merchants, The (Wu), 120

attorneys general, 120, 172, 227

authoritarianism, 278, 279

automobiles, 158, 223

banks, 231–32

Bannon, Steve, 181, 182, 197, 199

Bast, Andy, 109

Belgium, 247

Bell Labs, 225

Berners-Lee, Tim, 36, 161

Bezos, Jeff, 27

Black Lives Matter, 8, 243, 250, 275

Blacktivist, 131

Bloomberg, 50

Blumenthal, Richard, 128

Bodnick, Marc, 14, 18, 59

Bogost, Ian, 195–96

Bolton, Tamiko, 161–62

Bono, 13, 18, 28–29, 30, 59–61, 159

Booker, Cory, 128

Bosworth, Andrew “Boz,” 160, 165

memo of, 204–6

bots, 90, 116, 124, 126, 174, 177, 227

bottomless bowl, 97

Box, 41

brain, 88

brain hacking, 81–82, 118, 141, 148

Brand, Stewart, 177

Brazil, 280

Brexit, 8–9, 96, 180, 196, 198, 244

Breyer, Jim, 58

Bricklin, Dan, 34

Brin, Sergey, 27

bro and hipster cultures, 49–50

Brotopia (Chang), 50

bullying, 87, 101–2, 205, 253, 269, 273, 280, 281

Bushnell, Nolan, 34

Business Insider, 141

BuzzFeed, 204

California, 227–28

environmental regulations in, 201

secession movement, 114, 115

Cambodia, 215, 246

Cambridge Analytica, 78, 180–98, 199, 202–4, 207, 208, 210, 213, 216–18, 251, 259

Cambridge University, 181

Candy Crush, 191, 269

capitalism, 200, 201, 220, 238, 262

Castor, Kathy, 210–11

cell phones, 36, 225

see also smartphones

censorship, 252

Center for Humane Technology (CHT), 157, 166–67, 173, 188, 272

Chancellor, Joseph, 181, 186

Chang, Emily, 50

Chaos Monkeys (García Martínez), 71, 72, 73

Chaslot, Guillaume, 92

Chicago School antitrust philosophy, 137–39, 285, 286

children, 214, 240, 253–54

technology and, 106, 156, 166, 237, 255, 268, 269, 272–73, 279–80

China, 162, 205, 215–16

Cisco, 46

CityVille, 191

Clayton Act, 136

Clinton, Bill, 60

Clinton, Chelsea, 167

Clinton, Hillary, 5, 11, 117, 121, 124, 125, 130, 166

Facebook Groups and, 7–8

Clinton Foundation, 130

cloud, 38, 40, 41, 104, 249, 250

Amazon Web Services, 40, 41, 137, 138

CNBC, 118, 161

CNN, 130–31, 147, 161, 193, 229, 231

Coca-Cola, 141

Cohen, Michael, 209–10

Cold War, 32

Columbia University, 54

Common Sense Media, 119, 156–57, 167, 227, 272

Compaq Computer, 27, 35, 152

competition:

lack of alteratives to Facebook and Google, 92, 100, 141, 223, 280

see also antitrust and monopoly issues

computers, computing, 22, 25, 31–36, 108, 225

in classrooms, 273

cloud, see cloud

minicomputers, 33, 46

PCs, 17, 22, 25, 29, 33–36, 40, 42, 45, 46, 273

Congress, 121–33, 135–36, 152, 154, 163, 200, 208, 222, 226, 238

House Energy and Commerce Committee, 209–10, 227

House Intelligence Committee, 123, 127–28, 132, 133, 167, 227

Senate Commerce Committee, 209

Senate Intelligence Committee, 12, 111–12, 127, 132

Senate Judiciary Committee, 128, 131, 132, 136, 209

Zuckerberg’s testimony before, 209–12, 216, 217

Conservative Political Action Conference (CPAC), 174

conspiracy theories, 92–95, 115, 119, 121, 214, 228, 229, 234, 242, 243, 274

Pizzagate, 124–26, 130

Constitution, 12, 259

Fourth Amendment to, 201

content vendors, 283

Conway, Ron, 48

Cooper, Anderson, 81

copyrights, 281

Cosgrave, Paddy, 108–9

Cow Clicker, 195–96

Cox, Chris, 144

Cox, Joseph, 229–30

Cruz, Ted, 185

Currier, James, 47

Cyprus, 125

Czech Republic, 125

Dalai Lama, 31

dark patterns, 96

data and data privacy, 155, 158, 159, 203, 217, 220, 234–36, 238, 253, 258–59, 263–65, 269, 271–72, 277–84

Apple and, 38, 158, 271

Big Data, 158

browsing history, 218–19

Cambridge Analytica and, 78, 180–98, 199, 202–4, 207, 208, 210, 213, 216–18, 251, 259

combined sets of, 68, 285–86

and data as currency, 285

data ownership, 222, 237, 247, 259, 264

data portability, 247

Facebook’s banning of data brokers, 208

Facebook’s continuing threat to, 246

Facebook user data, 4–5, 9, 62, 72, 75–76, 78, 87, 131–32, 141–42, 174, 180–98, 202–4, 210–11, 216–19, 223, 258–59

Facebook user privacy settings, 97

fiduciary rule and, 226–27, 247, 260–61

Global Data Protection Regulation, 221, 222, 224, 259–60

and Internet of Things, 262, 268, 271

and internet as barter transaction, 285

internet privacy bill of rights, 221–24, 226–27

metadata, 68–69, 211, 217–20, 264

passwords and log-ins, 249–50, 271

“price” of data, 285–86

regulations and, 201

and value of data vs. services, 286

Zuckerberg’s attitudes regarding, 4–5, 55–56, 60, 141–42

Data for Democracy, 90, 122, 127

Dead & Company, 74

Defense, U.S. Department of, 32, 34

Delaney, John, 167

Dell, 35, 152

democracy, 2, 3, 10–12, 17, 37, 84, 85, 93, 103, 112, 117, 122, 126–27, 129, 133, 136, 159, 162, 200, 203, 204, 217, 220, 233–35, 238, 239, 242, 253–57, 263–65, 258, 268–69, 277–83

Facebook’s threat to, 242–45, 258, 280, 281

four pillars of, 243–45

see also elections

Democratic Congressional Campaign Committee (DCCC), 11, 111, 114, 116

Democratic National Committee (DNC), 11, 111, 114, 116, 124, 125

Democratic Party, Democrats, 121, 130–33, 167, 197, 210, 212, 227

Pizzagate and, 124–26, 130

Depression, Great, 43

developing countries, 179–80, 233

Diamond, Larry, 243

Diana, Elisabeth, 231–32

Digital Equipment, 46, 152

DiResta, Renée, 92–93, 121–23, 127, 128, 146, 242

disinformation and fake news, 94–96, 117, 123, 173, 229, 233, 234, 237, 253, 257–58, 260, 274

on Facebook, 89, 94–96, 119, 159, 165, 166, 208–9, 228, 243, 245, 258, 270, 281

Free Basics and, 180

Pizzagate, 124–26, 130

Russia and, 121–24, 174; see also Russia

on Twitter, 177

on YouTube, 177–78

see also conspiracy theories

Disney Company, 143–44, 193

Doerr, John, 26–27, 61

dopamine, 86, 88, 107, 147, 258, 271, 273

Dorsey, Jack, 229

dot-com bubble, 27, 38–40, 48, 49

Doubleclick, 65, 138–39

Doyle, Mike, 210

Dropbox, 41

Drummond, Jamie, 159

DuckDuckGo, 271

Dwoskin, Elizabeth, 168

eBay, 36, 38

economy, economics, 43–48, 82, 155, 162–63, 201, 220, 225, 235, 238, 254, 262–63, 281

Edelman, Gilad, 155

Edelman, Joe, 108

Edge, 28–29

education, 257

Egypt, 243

8chan, 102, 123

Einstein, Albert, ix, 53

elections, 82, 122, 129, 141, 156, 159, 208, 215, 216, 227, 238, 243, 244, 251–55, 258–59, 269, 274, 280, 282

microtargeting and, 237–38

2016 presidential, see presidential election of 2016

of 2018 and 2020, 12, 111, 119, 127, 153, 220, 235, 278, 279, 281

Electronic Arts, 14, 26

Elevation Partners, 13–14, 17–18, 30, 61, 72, 147

EMC, 152

emerging economies, 179–80, 233

emotions, 69, 81, 126

contagion of, 88–89, 92, 103, 233, 234

Facebook and, 9, 11, 68, 69, 75, 233, 270

Facebook study on, 88–89

“lizard brain,” 9, 88

energy, renewable, 248

Engelbart, Douglas, 33, 34

entrepreneurs, 224, 238, 261, 265

see also startups

Equifax, 226

Estrin, Judy, 220, 233

European Union (EU), 162

Brexit and, 8–9, 96, 180, 196, 198, 244

Global Data Protection Regulation in, 221, 222, 224, 259–60

Google and, 138, 260, 281–82

Excite, 42

extreme views, 91–93, 102, 119, 173, 214, 232, 253, 260, 279

Facebook, 47–51, 53–79, 110, 139–40, 156, 163, 202–12, 213–20, 223, 224, 232–35, 238–40, 241–48, 251, 255, 256, 258, 262–64, 274, 275, 278, 279, 282, 283, 287

addiction to, 63, 281

advertising and, 11–12, 47, 59–61, 63, 68–77, 85, 103, 119, 128–29, 130, 132, 143, 148, 173, 184, 185, 202, 207–9, 211, 217–19, 237–28, 258, 265, 270, 281, 283–84

algorithms of, 4, 9, 11, 66, 74, 76, 81, 87, 91, 128–29, 143, 166, 232, 235, 243, 270, 274, 277, 281

Android and, 204

artificial intelligence of, 10, 11, 69, 85, 87, 91, 95, 108, 203, 219–20, 230, 261

banks and, 231–32

Beacon, 60, 62, 64, 142

behavior modification and, 63, 278

Black Lives Matter and, 8, 243

Bosworth memo and, 204–6

Cambridge Analytica and, 78, 180–98, 199, 202–4, 207, 208, 210, 213, 216–18, 251, 259

Center for Humane Technology and, 166–67

changing personal usage of, 270

Clear History, 218–19

community standards and, 103, 179, 228, 244–45

Congress and, 122, 127–33

Connect, 62, 63, 68, 72, 158, 218, 249, 270

Connectivity, 232

content moderation by, 229–30, 232, 237

content suppliers harmed by, 283

criticisms of, and responses, 3, 65, 95–96, 141, 143, 146, 147–49, 151–53, 158–61, 169, 174–75, 178–80, 192–93, 207, 216, 217, 230, 247–48, 280, 281

Custom Audiences, 76–77

data brokers banned by, 208

dating service, 207, 218

deactivating account, 99

decision making and organization of, 144–45, 154, 155, 160

democracy threatened by, 242–45, 258, 278, 280, 281

disinformation on, 89, 94–96, 119, 159, 165, 166, 208–9, 228, 243, 245, 258, 270, 281

early days of, 16–17

earnings in 2018, 216–17, 228

Elevation and, 17–18, 72

emotional contagion study of, 88–89

emotions and, 9, 11, 68, 69, 75, 233, 270

F8 conference, 217–18

fake accounts deleted by, 229, 230, 265

FarmVille, 184, 195, 196

filter bubbles and, 78, 87, 90, 96, 116–19, 124–27, 141, 166, 209, 215, 245, 257, 258

financial value of, 9, 284

Free Basics, 179–80, 232, 245

FriendFeed and, 63

FTC and, 182–84, 188–90

games, 184, 191, 195, 196

Global Data Protection Regulation and, 221, 259

Goldman’s tweet and, 169–73

Groups, 7–8, 51, 78, 89–92, 94–96, 115–17, 119, 124, 126, 130–32, 165–66, 207–8, 270

Growth group at, 76, 84, 148

hackers and, 280

hate speech and, 178–79, 203, 204, 215, 216, 228, 230, 245, 280

History, 270

housing discrimination and, 11, 129, 245

influence power of, 10–11, 141, 204, 215

innovation threatened by, 246–47

Instagram and, 70, 139, 140, 144, 223, 261, 270–71

IPO (initial public offering) of, 70–75, 78, 145, 169, 184, 190

Jones and Infowars and, 228–29

lack of alternative to, 92, 100, 141, 223, 280

Like button, 63, 68, 72, 98

Live, 74

Lookalike Audiences, 76, 77, 115

marketing messages sent by, 174

market power of, 46

McGinn’s departure from, 167–69, 172

McNamee’s investment in, 1, 17–18, 59

Messenger, 67, 70, 85, 139, 140, 207, 232

Messenger Kids, 254

metrics of, 76–78, 206, 216

Microsoft and, 14, 15, 59–60, 65

mobile platforms and, 106, 228

monopoly power and antitrust issues, 47–48, 100, 136–41, 162, 225–26, 234, 246, 247, 261–63, 284

Moonalice and, 73–75

motto and philosophy of, 41, 51, 72–73, 142–43, 193

as national security threat, 282

network effects and, 47, 246

new kind of marketplace created by, 283

News Feed, 59, 60, 68, 70, 74, 75, 88, 89, 90–91, 97, 165–66, 208–9, 243, 244, 247

as news source, 10

nondisclosure agreement for employees of, 169, 172

Oculus and, 139, 144, 223, 261

Onavo and, 139–40

Open Graph, 70, 71, 74

persuasive technology used by, 17

photo tagging on, 59, 63, 68, 98–99

Platform, 188, 190–91

Portal, 281

presidential election and, 183, 190, 232, 278; see also Cambridge Analytica; Russia

privacy settings of, 97

privacy threatened by, 246

public health threatened by, 246

regulation and, 112, 280

Russian interference and, 90, 115–17, 119, 124, 126, 130–32, 145–46, 149, 152–54, 166, 168–72, 187, 193–94, 203, 207–8, 217, 228, 244, 245, 251

Sandberg’s joining of, 5, 16, 60, 61, 64

self-regulation of, 280

smartphones and, 59

Snapchat and, 140, 246

Social Graph, 70

Sponsored Stories, 71

state attorneys general and, 120, 172, 227

stock price in 2018, 228, 265

team philosophy of, 145

and technology as value neutral, 129

terms of service of, 97, 178, 182, 211, 253–54

Trending Stories, 166

Truth About Tech conference and, 166, 167

user browsing history and, 218–19

user data and, 4–5, 9, 62, 72, 75–76, 78, 87, 131–32, 141–42, 174, 180–98, 202–4, 210–11, 216–19, 223, 258–59

user engagement and, 9

user growth and numbers, 62–63, 65, 71–72, 77, 78, 84, 128, 140–41, 143, 151, 184, 187, 215, 228, 233, 234

user trust and, 2, 7

“war room” opened by, 281

WhatsApp and, 139, 140, 144, 223, 261, 270–71, 280

words associated with, 231

work environment at, 45

Yahoo and, 14–16, 56, 57

Zuckerberg considers selling, 13–16

Zuckerberg’s launch of, 4, 39, 42, 50–51, 35–56, 104, 141, 189, 203, 241

Zuckerberg’s plan for addressing problems with, 158–59

Facemash, 53, 60

fact-checking, 103, 178, 179

Fair Housing Act, 11, 245

fake news, see disinformation and fake news

FarmVille, 184, 195, 196

Fast Company, 53

FBI, 209, 252

fear of missing out (FOMO), 98, 99, 253, 269

Federal Communications Commission, 136

Federal Trade Commission (FTC), 113–14, 136, 182–84, 188–90, 200, 286

Feinstein, Dianne, 132

Fernando, Randima, 167

Ferrell, Will, 156

filter bubbles, 66–67, 87, 94, 109, 125–27, 157–58, 246, 269, 278–81

extreme views and, 91, 93

Facebook and, 78, 87, 90, 96, 116–19, 124–27, 141, 166, 209, 215, 245, 257, 258

polarization and, 89–90, 274

Financial Times, 224–25

FireEye, 229

Fisher, Adam, 55

5G wireless technology, 261–62

Foer, Franklin, 167

Fogg, B. J., 83–84, 86, 96–98, 101, 103, 106–7, 173

4chan, 102, 123, 125

Fourth Amendment, 201

Fowler, Susan, 148

Fox, Lynn, 146

France, 20

Franken, Al, 128, 136

Frankston, Bob, 34

free products, 105

free speech, 92, 101, 123

Friendster, 55

Garcia, Jerry, 23, 28

García Martínez, Antonio, 71, 72, 73

Gates, Bill, 154–55, 173

Gates Foundation, 172

Ghostery, 271

Gibson, William, 267

GIPEC, 280

Glaser, April, 186

Glastris, Paul, 155

Global Data Protection Regulation (GDPR), 221, 222, 224, 259–60

Glow Kids (Kardaras), 106, 272

Goldman, Ron, 169–73

Google, 2, 10, 14, 16, 17, 27, 38–39, 42, 45–50, 60, 65–66, 81, 82–85, 103–4, 100, 138–39, 154, 156, 163, 172, 214, 220, 223, 224, 232–35, 241–47, 253, 256, 262, 265, 270, 271, 278, 279, 283–85, 287

advertising and, 47, 67–69, 86, 104, 173, 283–86

AdWords, 61, 67, 138

algorithms of, 66, 235

Android, 138, 204, 271, 282

apps, 39

Apture and, 107

artificial intelligence of, 108, 219–20, 253, 261

combined data sets and, 68, 285–86

Congress and, 122, 129–33

consumer purchases and, 67–68

content moderation and, 237

content suppliers harmed by, 283

DoubleClick and, 138–39

European Union and, 138, 260, 281–82

filter bubbles and, 87, 90

Global Data Protection Regulation and, 221, 259–60

Gmail, 39, 68, 253, 261, 271, 285

Google+, 67, 69

Home, 108, 236, 262, 268

lack of alternative to, 92, 280

Maps, 68, 253, 271, 285

market power of, 46

mission statement of, 241

monopoly power and antitrust issues, 47–48, 136–40, 162, 225–26, 234, 246, 247, 261–63, 282, 284

as national security threat, 282

new kind of marketplace created by, 283

regulation and, 112

Sandberg at, 61, 144

self-regulation of, 280

Senate hearing and, 282

sexual impropriety by executives at, 282

Truth About Tech conference and, 166, 167

words associated with, 231

YouTube and, 104, 139, 253, 261

Graham, Don, 58

grassroots campaigns, 64

Grateful Dead, 20, 22, 28, 74, 167

growth hacking, 76, 84

Guardian, 78, 129, 178–81, 183, 185–86, 190, 192, 196–98, 210

Guff, 22

guns, 115, 123

Hamilton 68, 121–22

harassment, 101–2

Harris, Tristan, 81–83, 88, 95–97, 100–101, 103, 107–10, 113–20, 127, 133, 136, 146, 148, 149, 153, 156–57, 161, 167, 172–73, 187, 219, 232, 239, 242

HarvardConnection.com, 53

Harvard University, 50, 53–54, 57, 141–42, 154, 189, 193

Hastings, Reed, 105

Hatch, Orrin, 209

hate speech, 92, 102, 103, 119, 141, 178–79, 203, 204, 206, 215, 216, 228–30, 233–35, 237, 245, 253, 280

Hawking, Stephen, 151

health, see public health

Hewlett-Packard, 35, 49

hipster and bro cultures, 49–50

Hit Refresh (Nadella), 173

Hoffman, Reid, 38, 48

Honest Ads Act, 207

Honest Data, 172

House of Representatives, U.S., 227

Committee on Energy and Commerce, 209–10, 227

Permanent Select Committee on Intelligence, 123, 127–28, 132, 133, 167, 227

housing discrimination, 11, 129, 245

Hughes, Chris, 112, 166, 196, 197

human-driven technology and humane design, 107–8, 153, 157–58, 173, 239, 264, 265, 268–70

Center for Humane Technology, 157, 166–67, 173, 188, 272

as Next Big Thing, 248–50

Huxley, Aldous, 121, 267

IBM, 22, 32, 33, 35, 46–47, 140, 141, 152, 225, 261

immigration, 115, 117, 123

Indivisible, 243, 250, 275

Infowars, 125, 177, 228–29

innovation, 10, 35, 46, 112, 136, 222, 223, 226, 248, 250, 253, 262

Facebook’s threat to, 246–47

Instagram, 41, 77, 97–99, 102, 110, 128, 130, 156, 169, 171, 178, 214, 228, 229, 232, 235, 238–39, 251–54, 258, 269, 280

Facebook and, 70, 139, 140, 144, 223, 261, 270–71

Integral Capital Partners, 27–28, 61

Intel, 32, 34, 35, 46, 152

Intercept, 186

internet, 27, 33–39, 101, 225, 277–80, 282, 286–87

as barter transaction, 285, 287

net neutrality, 37, 120

paths for change in, 279–80

price of services, 285–86

regulation of platforms on, 201, 279–80, 282–84, 287

utopian view of, 37, 39

Web 2.0, 38, 40, 41, 43, 104

World Wide Web, 36–39, 101, 218

Internet of Things (IoT), 158, 262, 264, 268, 271, 272

Internet Research Agency, 192, 228

iPhone, 38, 84, 100, 105–6, 271

see also smartphones

Iran, 229, 258

Irresistible (Alter), 272

Jobs, Steve, 29, 30, 108, 157

Johnson, Lyndon, 18

Johnson, Peggy, 173

Johnson & Johnson, 7, 148

Jones, Alex, 92, 228–29, 242

journalism, 124, 139, 166, 180, 204, 243

JP Morgan Chase, 231

Juicero, 224

Justice, U.S. Department of, 200

Kaiser, Brittany, 196–98

Kaiser Family Foundation, 106

Kardaras, Nicholas, 106, 272

Kelly, Chris, 13, 18, 146, 160

Kennedy, Joe, 211, 219

Kennedy, John, 131, 133, 135–36, 222

Kennedy, John F., 18

Khan, Lina, 136

Khanna, Ro, 226–27

Kleiner Perkins Caufield & Byers, 26, 27

Klobuchar, Amy, 128, 207, 222

Koebler, Jason, 229–30

Kogan, Aleksandr, 181–87, 189, 190, 197

Kranzberg, Melvin, ix

Labor, U.S. Department of, 200

Lange, Christian Lous, 1

Lanier, Jaron, 69, 129, 135

Lee, Yanghee, 179

Levchin, Max, 48

libertarianism, 43–45, 49, 102, 123

Licklider, J. C. R., 33

LinkedIn, 38, 48, 98, 104, 110, 173

local area networks (LANs), 35

Lofgren, Zoe, 221–27

Lotus Development, 27

Luján, Ben, 211

Lustig, Robert, 167

Lyft, 50, 263

Lynn, Barry, 155, 285–86

Macedonia, 125

magic, 82–83, 101

Maher, Katherine, 178

Makeoutclub, 55

March for Our Lives, 243, 250, 275

Marinelli, Louis, 114

Markey, Edward, 167

Match.com, 218

Mayfield Fund, 147

McCain, John, 207

McGinn, Tavis, 167–69, 172, 174

McGovern, George, 20

McKean, Erin, 230–31

McNamee, Ann, 5–6, 23, 159

McNamee, George, 22

McNamee, Roger, 18–30

as advisor to Zuckerberg, 1, 5, 13–16, 57–60, 64, 78

childhood of, 18–19

Elevation Partners firm of, 13–14, 17–18, 30, 61, 72, 147

email to Zuckerberg and Sandberg, 4–6, 149, 152, 160–61, 280, 297–300

heart surgery of, 29

at Integral Capital Partners, 27–28, 61

as investor in Facebook, 1, 17–18, 59

as investor in technology, 1, 7, 21, 24–30, 56–57

music career of, 8, 19, 22, 23, 25

op-ed for Recode, 5–7, 297–300

op-ed for USA Today, 118

parents of, 18–21

and Sandberg’s joining of Facebook, 5, 16, 60, 61

at Silver Lake Partners, 28–30

strokes suffered by, 29

at T. Rowe Price, 24–27

Washington Monthly essay of, 155, 159–62

Washington trips of, 111–20, 121

McSweeney, Terrell, 113–14

Médecins Sans Frontières, 178

media, 6, 17, 68, 69, 81, 105, 106, 153, 162

Medium, 47, 84

menu choices, 96

Mercer, Robert, 180–82, 197, 199

meritocracy, 44–45

Messenger, 67, 70, 85, 139, 140, 207, 232

Kids, 254

Messing with the Enemy (Watts), 94

Metcalfe’s Law, 32, 33, 36, 38

metrics, 73, 76–78, 126, 145, 206, 216

Microsoft, 25, 35, 42, 152, 154, 172–73, 261

antitrust case against, 46–47, 154–55, 286

Facebook and, 14, 15, 59–60, 65

words associated with, 231

Milk, Harvey, 22

MIT, 177

MIT Technology Review, 102

Mohan, Neal, 93

monopolies, see antitrust and monopoly issues

Moonalice, 8

Facebook and, 73–75

Moore’s Law, 32, 33, 36

Morgan, Jonathon, 90

Morgan Stanley, 27, 28

Mosaic, 36, 38

Mosseri, Adam, 179

Motherboard, 229–30

Motorola, 34

MoveOn, 60, 66

Mozilla, 40

MSNBC, 133, 161

Mueller, Robert, 119, 169, 171–75

Musk, Elon, 48

Muslims, 90, 91, 126, 131, 178, 215, 254

Myanmar, 178–80, 204, 213, 215, 232, 239, 245, 254, 265, 277, 278

MySpace, 42, 55, 152

Nadella, Satya, 173

Napster, 38, 54

Narendra, Divya, 53–54

NASA, 32

Nasdaq, 71

National Venture Capital Association, 46

neoliberalism, 45, 137

Netflix, 41, 97, 105

net neutrality, 37, 120

Netscape, 27, 38, 58, 152

network effects, 47, 162, 246, 253, 284

New Knowledge, 121

news feeds, 97

Facebook, 59, 60, 68, 70, 74, 75, 88, 89, 90–91, 97, 165–66, 208–9, 243, 244, 247

News on the Web (NOW), 231

newspapers, 93, 102

Newton, Casey, 167

New York Sun, 106

New York Times, 146, 166, 180, 193, 226, 229, 282

Nielsen, 65–66

Nix, Alexander, 182, 197

notifications, 97–99, 107, 271

Nunes, Devin, 132

Obama, Barack, 90, 112, 117, 130, 166, 196, 197

Observer, 180, 181

Oculus, 139, 144, 223, 261

Onavo, 139–40

ONE campaign, 159

One Laptop per Child, 188

OpenID Connect, 158

Open Markets Institute, 136, 155, 285

open source community, 37–38, 40

Oracle, 46, 152

Orwell, George, 267

Oxford Dictionary of American English, 230–31

Page, Larry, 27

Palihapitiya, Chamath, 146–49, 152, 160

Pallone, Frank, 210

Parakilas, Sandy, 146, 161, 187–89, 191, 192, 242

Pariser, Eli, 66–67, 109

Parkland school shooting, 174

passwords and log-ins, 249–50, 271

PayPal, 48, 249

PayPal Mafia, 48

Parker, Sean, 38, 54, 55, 64, 147–49

Pearlman, Bret, 14

Pelosi, Nancy, 167, 227

personalization, 105

persuasive techniques, 17, 83–84, 96–99, 101, 106, 207, 233, 251, 257, 274

Persuasive Technology (Fogg), 83–84; see also Fogg, B. J.

Pet Society, 195

Philippines, 215, 246

Pincus, Mark, 38

Pizzagate, 124–26, 130

Plaxo, 38

polarization, 89–90, 274

Politico, 211

populism, 117

pornography, 55, 228

Postman, Neil, 267

Powell, John, 25, 27, 61

power, 3

preference bubbles, 93–96, 127, 246, 255, 269, 278, 281

presidential election of 2016, 6, 11, 12, 17, 96, 125, 156, 159, 162, 165, 185, 254, 256

Facebook and, 183, 190, 232, 278; see also Cambridge Analytica; Russia

and McNamee’s email to Zuckerberg and Sandberg, 4–6, 149, 152, 160–61

Russian interference with, 1, 5, 12, 62, 94, 111, 114–19, 121–33, 135, 145–46, 149, 152–54, 166, 168–72, 187, 193–94, 203, 207–8, 213, 217, 228, 244, 245, 251

price, 285

Prince, 165

privacy, see data and data privacy

Procter & Gamble, 173

ProPublica, 11, 245

psychographics, 181–82, 185

public health, 82, 83, 86, 155, 156, 203, 217, 220, 227, 234, 235, 238, 253, 256, 257, 263–65, 277, 279, 281–83

behavioral addiction, 100–101, 106–7, 162, 206, 240, 246, 250, 253, 254, 257, 268, 269, 281

Facebook’s threat to, 246

Radius, 26

Reagan, Ronald, 45, 46, 137, 277

Rear Window, 1–2, 11

reciprocity, desire for, 98–99

Recode, 193

McNamee’s op-ed for, 5–7

Reddit, 102, 123

Refghi, Matt, 99

regulation, 45, 47–48, 199–203, 247, 264

antitrust, see antitrust and monopoly issues

environmental, 201

of internet platforms, 201, 279–80, 282–84, 287

privacy and, 201

of technology, 47–48, 112–14, 130, 173, 201, 206, 208, 220–21, 238, 282–83

Republican Party, Republicans, 116, 117, 132, 197

Reuters, 215

Riccitiello, John, 14

Road Ahead, The (Gates), 154

Road to Unfreedom, The (Gates), 154

Robinson, Jackie, 18

Rohingya minority, 178–80, 215, 245, 254, 278

Roosevelt, Franklin, 18

Rose, Dan, 1, 6–7, 11, 152

Rubin, Andy, 282

Russia, 78, 252, 258

Facebook and, 90, 115–17, 119, 124, 126, 130–32, 145–46, 149, 152–54, 166, 168–72, 187, 193–94, 203, 207–8, 217, 228, 244, 245, 251

and hacks of Democrats’ servers, 11

and presidential election of 2016, 1, 5, 12, 62, 94, 111, 114–19, 121–33, 135, 145–46, 149, 152–54, 166, 168–72, 187, 193–94, 203, 207–8, 213, 217, 228, 244, 245, 251

secession movements and, 114–15

Trump and, 12, 111, 117

Twitter and, 122–24, 131, 169, 174

Sandberg, Sheryl, 3, 17, 28, 60–61, 67, 72, 73, 78, 144, 145, 191, 193–94, 239

Cambridge Analytica scandal and, 193–94

and criticisms of Facebook, 3, 89, 141, 146, 149, 160–61, 169, 230

and Facebook decision making and organization, 144–45, 154, 160

Facebook joined by, 5, 16, 60, 61, 64

and Facebook study on emotional contagion, 89

at Google, 61, 144

management philosophy of, 145

McGinn as personal pollster for, 167–69, 172

McNamee’s email to Zuckerberg and, 4–6, 149, 152, 160–61, 280, 297–300

Sanders, Bernie, 125, 196

Facebook Groups and, 7–8, 116

San Francisco, Calif., 20–22, 49–50

Schiff, Adam, 123, 132

Schmidt, Eric, 112

Schneiderman, Eric, 119–20

Schrage, Elliot, 144, 191

Science, 177

SCL Group, 180–82, 187

Senate, U.S.:

Committee on Commerce, Science, and Transportation, 209

Google and, 282

Judiciary Committee, 128, 131, 132, 136, 209

Select Committee on Intelligence, 12, 111–12, 127, 132

Sherman Antitrust Act, 136

Signal, 271

Silicon Valley, 3, 5, 10, 15, 16, 26, 31–51, 83, 84, 104, 110, 112, 118, 130, 147, 151–52, 157, 173, 194, 197, 206, 225, 248, 253, 254, 263, 269, 274

diversity and, 45

libertarianism and, 44–45, 49

women in, 49–50

see also technology

Silver Lake Partners, 28–30

Sinclair, Upton, 110

Siri, 43

SixDegrees.com, 54–55

60 Minutes, 81, 109, 161

Skype, 70

Slack, 41

Slate, 179, 186, 231

smartphones, 17, 59, 81, 84, 101, 105–8, 158, 225, 233, 250, 253, 255, 261, 265, 267, 269, 272–74

Android, 138, 204, 271, 282

checking of, 86–87, 99, 100, 257, 271

iPhone, 38, 84, 100, 105–6, 271

social apps on, 106

Snapchat, 99, 110, 140, 156, 214, 246, 253

Snyder, Timothy, 278

social graphs, 55, 70, 224, 264

social media, 38, 41, 48, 54–56, 63, 69, 102–5, 147, 153, 155, 177, 213

extreme views and, 91

human-driven, 108

mobile platforms and, 106

Social Network, The, 65

social reciprocity, 98–99

Soros, George, 159–63

World Economic Forum speech of, 159–63, 301–12

Space-X, 48

Speak & Spell, 22

Squawk Alley, 118

Sri Lanka, 178, 180, 204, 232, 239, 245, 247, 254, 277

Stamos, Alex, 119, 174, 183–84, 191–92

Standard Oil, 47, 136, 137

Stanford University, 54, 83, 107, 146–48, 160

startups, 40–41, 43, 45, 48–50, 104, 223–25, 259, 261–63, 284

lean, 41–42, 46, 48

state attorneys general, 120, 172, 227

Stein, Gertrude, 213

Stewart, Martha, 27

Steyer, Jim, 119, 156

Stoppleman, Jeremy, 48

Stretch, Colin, 131–33

suicide, 213

Summers, Larry, 60

Sun Microsystems, 26, 152

Sunstein, Cass, 90

Sybase, 26

Taylor, Bob, 34

technology, ix, 1, 9–10, 13, 31–51, 104, 106, 121, 135, 165, 177, 206, 214, 235–36, 238, 250–51, 254–55, 257, 258, 267–75, 282

addiction to, 100–101, 106–7, 162, 206, 240, 246, 250, 253, 254, 257, 268, 269, 281

business shift in, 33

changing personal usage of, 274

children and, 106, 156, 166, 237, 255, 268, 269, 272–73, 279–80

government era of, 32–33

human-driven, see human-driven technology and humane design

McNamee’s investments in, 1, 7, 21, 24–30, 56–57

regulation of, 47–48, 112–14, 130, 173, 201, 206, 208, 220–21, 238, 282–83

society changed by, 10, 87

as value neutral, 129

see also Silicon Valley

TED Conference, 66–67, 109–10, 111

television, 10, 17, 68, 87, 105, 106, 125–26, 158, 267, 284

terms of service, 100, 102, 114, 159, 253–54

Facebook, 97, 178, 182, 211, 253–54

terrorism, 230

Tesla, 48

Texas secession movement, 114–15

texting, 254, 255, 269, 271

Thiel, Peter, 45, 48, 54, 58, 113

3Com, 32

time sharing, 33

Time Well Spent, 108, 157

Tinder, 207, 218

transistor, 225, 226

trolls, 90, 116, 124, 126, 253

T. Rowe Price, 24–27

Truman Show, The, 9, 126, 215, 245

Trump, Donald, 93–94, 113, 119, 125, 130, 154, 162, 174, 180–81, 183, 187, 199, 202, 209, 283

Russia and, 12, 111, 117; see also Russia

see also presidential election of 2016

Trump Tower, 12, 111

trust, 2, 7, 125–27, 207, 236, 242, 263

Truth About Tech conference, 166, 167

Tufekci, Zeynep, 102, 193, 252–53

Tunisia, 243

Twitter, 63, 95, 102, 106, 110, 125, 183–84, 195, 233–35, 238–39, 243–45, 253, 256, 270, 278, 282, 283

Congress and, 122, 127–33

disinformation on, 177

fake accounts on, 265

Goldman’s tweets, 169–73

Jones and Infowars and, 228–29

Russia and, 121–24, 131, 169, 174

words associated with, 231

Twitter and Tear Gas (Tufekci), 252–53

two-sided markets, 139

Tylenol, 7, 148

U2, 13, 28–29, 167

Uber, 50, 148, 263

Unilever, 173

United Kingdom, 258

Brexit and, 8–9, 96, 180, 196, 198, 244

Parliament, 209

United Muslims of America, 131

United Nations, 178, 215, 265

Universal Music Group, 30

USA Today, 118, 231

U.S. Bancorp, 231

Vachon, Michael, 159, 161–62

Vaidhyanathan, Siva, 241

Valley of Genius (Fisher), 55

Varney, Stuart, 21

Vassallo, Steve, 107

Velshi, Ali, 133

venture capital funding, 41–42, 46, 48, 104, 223, 261

Verge, 146–47, 167

Vestager, Margrethe, 277

Vice, 281

Vietnam, 125

Vietnam War, 20, 44

virtual private network (VPN), 140

virtual reality, 158, 223, 261

Oculus, 139, 144, 223, 261

VisiCalc, 34

Wall Street Journal, 61–62, 71, 231

Walt Disney Company, 143–44, 193

Warner, Mark, 111, 114, 116, 118, 121, 122, 128, 167, 207

Warzel, Charlie, 199

Washington Monthly, 155, 159–62

Washington Post, 58, 61, 168, 207, 217, 280

Watts, Clint, 93, 94, 252

Wehner, David, 144

Weiner, Anthony, 124

WELL, The, 98

Wells Fargo, 231

WhatsApp, 41, 110, 139, 140, 144, 178, 223, 261, 270–71, 280

white nationalism and supremacism, 91, 117, 123, 125

Whole Foods, 137

wide area networks (WANs), 35

WikiLeaks, 11, 114, 116

Wikipedia, 178

Winklevoss, Cameron, 53–54, 57, 65, 141

Winklevoss, Tyler, 53–54, 57, 65, 141

Wired, 92–93

women, 49–50, 58

Women’s March, 243, 250, 275

Wong, David, 13

Wordnik, 230

World Economic Forum, 159–63, 293–302

World War II, 43

World Wide Web, 36–39, 101, 104, 218

Web 2.0, 38, 40, 41, 43

Wortham, Jenna, ix, 37

Wu, Tim, 120, 136

Wylie, Christopher, 181, 182, 185–86, 196

Xbox, 173

Yahoo, 36, 38, 42, 152

email scanning and, 191–92

Facebook and, 14–16, 56, 57

Finance, 71

Yale University, 20–23, 54, 286–87

Yelp, 48

YouTube, 95, 97, 128, 156, 214, 223, 232, 235, 238–39, 242, 244, 260, 274, 279, 281

advertising and, 103, 283–84

algorithms of, 92–93, 139, 274

disinformation on, 177–78

Google and, 104, 139, 253, 261

Jones and Infowars and, 228–29

Zittrain, Jonathan, 226

Zuckerberg, Mark, 3, 16, 53–79, 141–49, 229, 233, 239

Andreessen and, 58

Cambridge Analytica and, 192–93, 216–18

congressional testimony of, 209–12, 216, 217

and criticisms of Facebook, 3, 65, 95–96, 141, 143, 146, 149, 158–61, 169, 192–93, 207, 230, 247–48

and Facebook decision making and organization, 144–45, 154, 155, 160, 168, 169, 207

Facebook F8 conference and, 217–18

Facebook launched by, 4, 39, 42, 50–51, 53–56, 104, 141, 189, 203, 241

Facebook sale considered by, 13–16

Facemash created by, 53, 60

at Harvard, 50, 53–54, 57, 141–42, 154, 189, 193

McGinn as personal pollster for, 167–69, 172

McNamee as advisor to, 1, 5, 13–16, 57–60, 64, 78

McNamee’s email to Sandberg and, 4–6, 149, 152, 160–61, 280, 297–300

mentors and advisors of, 58, 64

Messenger messages of, 207

New Year’s resolutions of, 158–59, 165, 174

plan for addressing Facebook problems, 158–59

and Russian interference in election, 118

Thiel and, 58

user data privacy and, 4–5, 55–56, 60, 141–42

Zynga, 38, 184

ABCDEFGHIJKLMNOPQRSTUVWXYZ

ABOUT THE AUTHOR

Roger McNamee has been a Silicon Valley investor for 35 years. He co-founded successful funds in venture, crossover and private equity. His most recent fund, Elevation, included U2's Bono as a co-founder. He holds a B.A. from Yale University and an M.B.A. from the Tuck School of Business at Dartmouth College. Roger plays bass and guitar in the bands Moonalice and Doobie Decibel System and is the author of The New Normal and The Moonalice Legend: Posters and Words, Volumes 1-9. He has served as a technical advisor for seasons two through five of HBO's "Silicon Valley" series and was also responsible for raising the money that created the Wikimedia Foundation.

What’s next on

your reading list?

Discover your next

great read!

Get personalized book picks and up-to-date news about this author.

Sign up now.

Table of Contents

Also by Roger McNamee

Title Page

Copyright

Dedication

Epigraph

Contents

Prologue

1. The Strangest Meeting Ever

2. Silicon Valley Before Facebook

3. Move Fast and Break Things

4. The Children of Fogg

5. Mr. Harris and Mr. McNamee Go to Washington

6. Congress Gets Serious

7. The Facebook Way

8. Facebook Digs in Its Heels

9. The Pollster

10. Cambridge Analytica Changes Everything

11. Days of Reckoning

12. Success?

13. The Future of Society

14. The Future of You

Epilogue

Acknowledgments

Appendix 1: Memo to Zuck and Sheryl: Draft Op-Ed for Recode

Appendix 2: George Soros’s Davos Remarks: “the Current Moment in History”

Bibliographic Essay

Index

About the Author