notes/Media/articles/The Company That Might End Privacy as We Know It.md
2023-08-06 21:42:41 +02:00

1014 lines
55 KiB
Markdown
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

---
author:
link: https://www.nytimes.com/2020/01/18/technology/clearview-privacy-facial-recognition.html
status: not-finished
date: August 1, 2023
image: Media/articles/images/19clearview-promo-sub-square640.png
---
# The Secretive Company That Might End Privacy as We Know It - The New York Times
#technology #privacy #surveillance #law-enforcement
![](Media/articles/images/19clearview-promo-sub-square640.png)
A little-known start-up helps law enforcement match photos of unknown people to their online images — and “might lead to a dystopian future or something,” a backer says.
- Published Jan. 18, 2020Updated Nov. 2, 2021
Until recently, Hoan Ton-Thats greatest hits included an obscure iPhone game and an app that let people put Donald Trumps distinctive yellow hair on their own photos.
Then Mr. Ton-That — an Australian techie and onetime model — did something momentous: He invented a tool that could end your ability to walk down the street anonymously, and provided it to hundreds of law enforcement agencies, ranging from local cops in Florida to the F.B.I. and the Department of Homeland Security.
His tiny company, [Clearview AI](https://www.nytimes.com/2021/03/18/technology/clearview-facial-recognition-ai.html), devised a groundbreaking [facial recognition](https://www.nytimes.com/2021/01/31/technology/facial-recognition-photo-tool.html) app. You take a picture of a person, upload it and get to see public photos of that person, along with links to where those photos appeared. The system — whose backbone is a database of more than three billion images that Clearview claims to have scraped from [Facebook](https://www.nytimes.com/2021/11/02/technology/facebook-facial-recognition.html), YouTube, Venmo and millions of other websites — goes far beyond anything ever constructed by the United States government or Silicon Valley giants.
Federal and state law enforcement officers said that while they had only limited knowledge of how Clearview works and who is behind it, they had used its app to help solve shoplifting, identity theft, credit card fraud, murder and child sexual exploitation cases.
Until now, technology that readily identifies everyone based on his or her face has been taboo because of its radical erosion of privacy. Tech companies capable of [releasing such a tool](https://www.cnet.com/news/facebook-built-a-facial-recognition-app-for-employees/) have refrained from doing so; in 2011, Googles chairman at the time [said](https://www.telegraph.co.uk/technology/google/8522574/Google-warns-against-facial-recognition-database.html) it was the one technology the company had held back because it could be used “[in a very bad way](https://webcache.googleusercontent.com/search?q=cache:MwDlXjKEg2oJ:https://www.huffpost.com/entry/facial-recognition-google_n_869583+&cd=3&hl=en&ct=clnk&gl=us).” Some large cities, including San Francisco, have barred police from using [facial recognition](https://www.nytimes.com/2021/11/02/technology/facebook-facial-recognition.html) technology.
But without public scrutiny, more than 600 law enforcement agencies have started using Clearview in the past year, according to the company, which declined to provide a list. The computer code underlying its app, analyzed by The New York Times, includes programming language to pair it with augmented-reality glasses; users would potentially be able to identify every person they saw. The tool could identify activists at a protest or an attractive stranger on the subway, revealing not just their names but where they lived, what they did and whom they knew.
And its not just law enforcement: Clearview has also licensed the app to at least a handful of companies for security purposes.
“The weaponization possibilities of this are endless,” said Eric Goldman, co-director of the High Tech Law Institute at Santa Clara University. “Imagine a rogue law enforcement officer who wants to stalk potential romantic partners, or a foreign government using this to dig up secrets about people to blackmail them or throw them in jail.”
Clearview has shrouded itself in secrecy, avoiding debate about its boundary-pushing technology. When I began looking into the company in November, its website was a bare page showing a nonexistent Manhattan address as its place of business. The companys one employee listed on LinkedIn, a sales manager named “John Good,” turned out to be Mr. Ton-That, using a fake name. For a month, people affiliated with the company would not return my emails or phone calls.
While the company was dodging me, it was also monitoring me. At my request, a number of police officers had run my photo through the Clearview app. They soon received phone calls from company representatives asking if they were talking to the media — a sign that Clearview has the ability and, in this case, the appetite to monitor whom law enforcement is searching for.
[Facial recognition](https://www.nytimes.com/2021/11/02/technology/facebook-facial-recognition.html) technology has always been controversial. It makes people nervous about Big Brother. It has a tendency to deliver false matches for certain groups, like people of color. And some [facial recognition](https://www.nytimes.com/2021/11/02/technology/facebook-facial-recognition.html) products used by the police — including Clearviews — havent been vetted by independent experts.
Clearviews app carries extra risks because law enforcement agencies are uploading sensitive photos to the servers of a company whose ability to protect its data is untested.
The company eventually started answering my questions, saying that its earlier silence was typical of an early-stage start-up in stealth mode. Mr. Ton-That acknowledged designing a prototype for use with augmented-reality glasses but said the company had no plans to release it. And he said my photo had rung alarm bells because the app “flags possible anomalous search behavior” in order to prevent users from conducting what it deemed “inappropriate searches.”
In addition to Mr. Ton-That, Clearview was founded by Richard Schwartz — who was an aide to Rudolph W. Giuliani when he was mayor of New York — and backed financially by Peter Thiel, a venture capitalist behind [Facebook](https://www.nytimes.com/2021/11/02/technology/facebook-facial-recognition.html) and Palantir.
Another early investor is a small firm called Kirenaga Partners. Its founder, David Scalzo, dismissed concerns about Clearview making the internet searchable by face, saying its a valuable crime-solving tool.
“Ive come to the conclusion that because information constantly increases, theres never going to be privacy,” Mr. Scalzo said. “Laws have to determine whats legal, but you cant ban technology. Sure, that might lead to a dystopian future or something, but you cant ban it.”
Image
![Hoan Ton-That, founder of Clearview AI, whose app matches faces to images it collects from across the internet.](https://static01.nyt.com/images/2020/01/25/business/18clearview-01/merlin_166989150_339af8f6-72dc-4344-8bea-138e3b8ba466-articleLarge.jpg?quality=75&auto=webp&disable=upscale)
Credit...Amr Alfiky for The New York Times
## Addicted to A.I.
Mr. Ton-That, 31, grew up a long way from Silicon Valley. In his native Australia, he was raised on tales of his royal ancestors in Vietnam. In 2007, he dropped out of college and moved to San Francisco. The iPhone had just arrived, and his goal was to get in early on what he expected would be a vibrant market for social media apps. But his early ventures never gained real traction.
In 2009, Mr. Ton-That created a site that let people share links to videos with all the contacts in their instant messengers. Mr. Ton-That shut it down after it was branded a “[phishing scam](https://bits.blogs.nytimes.com/2009/02/24/viddyho-phishing-scam-hits-gmail/).” In 2015, he spun up [Trump Hair](https://www.148apps.com/app/1040750174/), which added Mr. Trumps distinctive coif to people in a photo, and a photo-sharing program. Both fizzled.
Dispirited, Mr. Ton-That moved to New York in 2016. Tall and slender, with long black hair, he considered a modeling career, he said, but after one shoot he returned to trying to figure out the next big thing in tech. He started reading academic papers on artificial intelligence, image recognition and machine learning.
Mr. Schwartz and Mr. Ton-That met in 2016 at a book event at the Manhattan Institute, a conservative think tank. Mr. Schwartz, now 61, had amassed an impressive Rolodex working for Mr. Giuliani in the 1990s and serving as the editorial page editor of The New York Daily News in the early 2000s. The two soon decided to go into the facial recognition business together: Mr. Ton-That would build the app, and Mr. Schwartz would use his contacts to drum up commercial interest.
Police departments have had access to facial recognition tools for almost [20 years](https://www.nytimes.com/2020/01/12/technology/facial-recognition-police.html), but they have historically been limited to searching government-provided images, such as mug shots and drivers license photos. In recent years, facial recognition algorithms have improved in accuracy, and companies like Amazon offer products that can create a facial recognition program for any database of images.
Mr. Ton-That wanted to go way beyond that. He began in 2016 by recruiting a couple of engineers. One helped design a program that can automatically collect images of peoples faces from across the internet, such as employment sites, news sites, educational sites, and social networks including Facebook, YouTube, Twitter, Instagram and even Venmo. Representatives of those companies said their policies prohibit such scraping, and Twitter said it [explicitly banned](https://developer.twitter.com/en/developer-terms/more-on-restricted-use-cases) use of its data for facial recognition.
Another engineer was hired to perfect a facial recognition algorithm that was derived from academic papers. The result: a system that uses what Mr. Ton-That described as a “state-of-the-art neural net” to convert all the images into mathematical formulas, or vectors, based on facial geometry — like how far apart a persons eyes are. Clearview created a vast directory that clustered all the photos with similar vectors into “neighborhoods.” When a user uploads a photo of a face into Clearviews system, it converts the face into a vector and then shows all the scraped photos stored in that vectors neighborhood — along with the links to the sites from which those images came.
Mr. Schwartz paid for server costs and basic expenses, but the operation was bare bones; everyone worked from home. “I was living on credit card debt,” Mr. Ton-That said. “Plus, I was a Bitcoin believer, so I had some of those.”
Image
Credit...Amr Alfiky for The New York Times
## Going Viral With Law Enforcement
By the end of 2017, the company had a formidable facial recognition tool, which it called Smartcheckr. But Mr. Schwartz and Mr. Ton-That werent sure whom they were going to sell it to.
Maybe it could be used to vet babysitters or as an add-on feature for surveillance cameras. What about a tool for security guards in the lobbies of buildings or to help hotels greet guests by name? “We thought of every idea,” Mr. Ton-That said.
One of the odder pitches, in late 2017, was to Paul Nehlen — an anti-Semite and self-described “[pro-white](https://www.washingtonpost.com/news/powerpost/wp/2017/12/27/ryans-pro-white-primary-foe-denounced-by-breitbart-after-his-anti-semitic-tweets/)” Republican running for Congress in Wisconsin — to use “unconventional databases” for “extreme opposition research,” according to a document provided to Mr. Nehlen and later posted online. Mr. Ton-That said the company never actually offered such services.
The company soon changed its name to Clearview AI and began marketing to law enforcement. That was when the company got its first round of funding from outside investors: Mr. Thiel and Kirenaga Partners. Among other things, Mr. Thiel was famous for secretly financing Hulk Hogans lawsuit that bankrupted the popular website Gawker. Both Mr. Thiel and Mr. Ton-That had been the subject of negative articles by Gawker.
“In 2017, Peter gave a talented young founder $200,000, which two years later converted to equity in Clearview AI,” said Jeremiah Hall, Mr. Thiels spokesman. “That was Peters only contribution; he is not involved in the company.”
Even after a second funding round in 2019, Clearview remains tiny, having raised $7 million from investors, according to [Pitchbook](https://pitchbook.com/profiles/company/232177-96), a website that tracks investments in start-ups. The company declined to confirm the amount.
In February, the Indiana State Police started experimenting with Clearview. They solved a case within 20 minutes of using the app. Two men had gotten into a fight in a park, and it ended when one shot the other in the stomach. A bystander recorded the crime on a phone, so the police had a still of the gunmans face to run through Clearviews app.
They immediately got a match: The man appeared in a video that someone had posted on social media, and his name was included in a caption on the video. “He did not have a drivers license and hadnt been arrested as an adult, so he wasnt in government databases,” said Chuck Cohen, an Indiana State Police captain at the time.
The man was arrested and charged; Mr. Cohen said he probably wouldnt have been identified without the ability to search social media for his face. The Indiana State Police became Clearviews first paying customer, according to the company. (The police declined to comment beyond saying that they tested Clearviews app.)
Clearview deployed current and former Republican officials to approach police forces, offering free trials and annual licenses for as little as $2,000. Mr. Schwartz tapped his political connections to help make government officials aware of the tool, according to Mr. Ton-That. (“Im thrilled to have the opportunity to help Hoan build Clearview into a mission-driven organization thats helping law enforcement protect children and enhance the safety of communities across the country,” Mr. Schwartz said through a spokeswoman.)
The companys main contact for customers was Jessica Medeiros Garrison, who managed Luther Stranges Republican campaign for Alabama attorney general. Brandon Fricke, an N.F.L. agent engaged to the Fox Nation host Tomi Lahren, [said in a financial disclosure report](http://clerk.house.gov/public_disc/financial-pdfs/2019/10029687.pdf) during a [congressional campaign in California](https://splinternews.com/what-the-frick-e-is-this-1837985411) that he was a “growth consultant” for the company. (Clearview said that it was a brief, unpaid role, and that the company had enlisted Democrats to help market its product as well.)
The companys most effective sales technique was offering 30-day free trials to officers, who then encouraged their acquisition departments to sign up and praised the tool to officers from other police departments at conferences and online, according to the company and documents provided by police departments in response to public-record requests. Mr. Ton-That finally had his viral hit.
In July, a detective in Clifton, N.J., urged his captain in an email to buy the software because it was “able to identify a suspect in a matter of seconds.” During the departments free trial, Clearview had identified shoplifters, an Apple Store thief and a good Samaritan who had punched out a man threatening people with a knife.
Photos “could be covertly taken with telephoto lens and input into the software, without burning the surveillance operation,” the detective wrote in the [email](https://www.muckrock.com/foi/clifton-6861/clifton-nj-83767/), provided to The Times by two researchers, Beryl Lipton of MuckRock and Freddy Martinez of Open the Government. They [discovered Clearview](https://www.muckrock.com/news/archives/2020/jan/18/clearview-ai-facial-recogniton-records/) late last year while looking into how [local police departments are using facial recognition](https://www.muckrock.com/project/police-surveillance-facial-recognition-use-in-your-backyard-452/).
According to a Clearview sales presentation reviewed by The Times, the app helped identify a range of individuals: a person who was accused of sexually abusing a child whose face appeared in the mirror of someones else gym photo; the person behind a string of mailbox thefts in Atlanta; a John Doe found dead on an Alabama sidewalk; and suspects in multiple identity-fraud cases at banks.
![The Daily Poster](https://static01.nyt.com/images/2017/01/29/podcasts/the-daily-album-art/the-daily-album-art-articleInline-v2.jpg?quality=75&auto=webp&disable=upscale)
### Listen to The Daily: The End of Privacy as We Know It?
An unregulated facial recognition app can probably tell the police your name, and help them find out where you live and who your friends are.
transcript
transcript
## Listen to The Daily: The End of Privacy as We Know It?
### Hosted by Michael Barbaro; produced by Annie Brown and Daniel Guillemette; with help from Michael Simon Johnson; and edited by Paige Cowett and Larissa Anderson
#### An unregulated facial recognition app can probably tell the police your name, and help them find out where you live and who your friends are.
\[music\]
michael barbaro
From The New York Times, Im Michael Barbaro. This is “The Daily.”
Today: A secretive company promising the next generation of facial recognition software has compiled a database of images far bigger than anything ever constructed by the U.S. government. The Dailys Annie Brown speaks to reporter Kashmir Hill about whether the technology is a breakthrough for law enforcement or the end of privacy as we know it.
Its Monday, February 10.
annie brown
Kashmir, how did this story come to you?
kashmir hill
So I got an email. It was a Wednesday morning. I was checking my phone. And it was from a tipster who had gotten a bunch of documents from police departments. And one of the police departments had sent along this memo about a private company that was offering a radical new tool to solve crimes using facial recognition.
annie brown
And what would make a facial recognition tool radical?
kashmir hill
So law enforcement has for years had access to facial recognition tools. But what this company was offering was unlike any other facial recognition tools that police have been using, because they had scraped the open web of public photos — from Facebook, from Venmo, from Twitter, from education sites, employment sites — and had a massive database of billions of photos. So the pitch is that you can take a picture of a criminal suspect, put their face into this app and identify them in seconds.
annie brown
And when you read this memo, what do you make of what this company is offering?
kashmir hill
So Ive been covering privacy for 10 years, and I know that a technology like this in public hands is the nightmare scenario.
\[music\]
This has been a tool that was too taboo for Silicon Valley giants who were capable of building it. Google in 2011 said that they could release a tool like this, but it was the one technology they were holding back because it could be used in a very bad way.
annie brown
And why exactly is this kind of technology this line in the sand that no one will cross? What makes it so dangerous?
kashmir hill
So imagine this technology in public hands. It would mean that if you were at a bar and someone saw you and was interested in you, they could take your photo, run your face through the app, and then it pulls up all these photos of you from the internet. It probably takes them back to your Facebook page. So now they know your name, they know who youre friends with, they can Google your name, they can see where you live, where you work, maybe how much money you make. Lets say youre a parent and youre walking down the street with your three-year-old. Somebody can take a photo of you and know where the two of you live. Imagine youre a protester in the U.S. or in a more authoritarian regime. All of a sudden they know everything about you, and you can face repercussions for just trying to exercise your political opinions. If this app were made publicly available, it would be the end of being anonymous in public. You would have to assume anyone can know who you are any time theyre able to take a photo of your face.
annie brown
And so that technology is what this company is pitching these police departments?
kashmir hill
Exactly.
annie brown
And what do you know about this company at this point?
kashmir hill
So at this point, all I really know is that the company is called Clearview AI. And so the first thing I do is Google it. And I find their website, which is clearview.ai. And the website is pretty bare, but theres also an office address listed there, 145 West 41st Street, which happens to be just a couple of blocks from The New York Times office.
annie brown
Right.
kashmir hill
So I decided to walk over there, and there just is no 145 West 41st Street. So that was weird. So now I have this company thats offering this radical new tool —
annie brown
Its got a fake address.
kashmir hill
Its got a fake address, which is a huge red flag.
annie brown
So what you do next?
kashmir hill
I found the company on LinkedIn. It only had one employee listed, a sales manager named John Good, which —
annie brown
John Good.
kashmir hill
John Good. It seemed like it could also be fake. And I sent that person a LinkedIn message and never heard back. So one of the things I find online is a website called PitchBook that lists investments in start-ups. And so it says that this Clearview AI has received $7 million from a venture capital firm and from Peter Thiel — you know, a big name in Silicon Valley, invested in Facebook and Palantir. So I reach out to his spokesperson, and he says Ill get back to you. I never hear from him again. And then one day, I open up Facebook, and I have a message from a friend whose name I dont recognize. And he says, hey, I hear youre looking into Clearview AI. I know them. Theyre a great company. How can I help?
annie brown
And you dont know who this guy is?
kashmir hill
I dont. I mean, its a guy I met once 10 years ago. And somehow he knows that Im looking into this company. But Ill take it. You know, finally —
annie brown
Right!
kashmir hill
— somebody wants to talk to me about Clearview AI. And so I say, hey, can I give you a call? And then he doesnt respond, which Im getting used to.
annie brown
You just cant catch a break.
kashmir hill
I know. Im like, I cannot believe this is another dead end.
So phone and email are not working for me. So I just need to figure out another door to knock on to try to talk to a real human being. And one of the investors in the company is this venture capital firm that has an office in Bronxville, New York. So on a cold, rainy Tuesday, I got on the train and headed to Bronxville. I get to the companys address. Its just like in a retail space. And go inside. Theres this long, quiet hallway of office suites, and this venture capital firm is at the very end. And I knock on the door, and theres no one there. So I start trying to talk to their neighbors, and a woman who works next door says, oh yeah, theyre never here. So Im walking down the stairs to go back out of the building, and two guys walk through the door. Theyre both in dark suits with lavender and pink shirts underneath, and they just kind of look like V.C.s to me. So I say, hey, are you with this venture capital firm? And they say, we are. Who are you? And I was like, Im the New York Times reporter whos been trying to get in touch with you. And they said, the company has told us not to talk to you. And I said, well Ive come all the way out to Bronxville. Can we just chat for a little bit? And they say, O.K. If probably helps that Im very pregnant, and they offered me water. And they just start telling me everything.
\[music\]
annie brown
And what do they tell you?
kashmir hill
They confirm that theyve invested in Clearview AI and that Peter Thiel has also invested. They identified the genius coder behind the company, this guy named Hoan Ton-That. And they say hes Vietnamese royalty but hes from Australia. And they also tell me that Hoan is the one that was using the fake name John Good on LinkedIn.
annie brown
Hes John Good.
kashmir hill
Hes John Good.
And they confirm that law enforcement is already using the app. And that law enforcement loves it and that its spreading like wildfire.
annie brown
Wow.
kashmir hill
So Ive learned some stuff from these two investors, but no one from the company is talking to me still. So in the meantime, I am also reaching out to law enforcement, because I want to know if this app really works as well as the company claims. By this point, I had learned that over 600 law enforcement agencies had tried the app, including the Department of Homeland Security and the F.B.I.
annie brown
Wow. Its not just local police departments. This is being used by the federal government already.
kashmir hill
Yeah, I mean, I was just shocked to discover how easily government agencies can just try a new technology without apparently knowing much about the company that provides it. So I talked to a retired police chief from Indiana, who was actually one of the first departments to use the app. And they solved a case within 20 seconds, he said.
annie brown
A case they hadnt been able to solve?
kashmir hill
That they hadnt been able to solve. One of the officers told me that he went back through like 30 dead-end cases that hadnt had any hits on the government database, and he got a bunch of hits using the app. So they were really excited about it.
annie brown
This is way more effective than what they were using before.
kashmir hill
Exactly. With the government databases they were previously using, they had to have a photo that was just a direct full-face photo of a suspect — like mug shots and drivers license photos. But with Clearview, it could be a person wearing glasses, or a hat, or part of their face was covered, or they were in profile, and officers were still getting results on these photos.
annie brown
Wow.
kashmir hill
But the most astounding story I was told was that investigators had this child exploitation video, and there was an adult who was visible in the video just for a few seconds in the background. So they had this persons face. They had run it through their usual databases and not gotten anything back. But then they ran his face through Clearviews app, and he turned up in the background of someone elses gym selfie. You could see his face in the mirror. And so they figured out what gym this photo was taken out. They went to the gym. They asked the employees, do you know who this is? And the employee said, we cant tell you. We have to protect our members privacy. But then later, the detectives got a text from somebody who worked there identifying the person. And that — I mean, thats just something that would not have been possible without Clearviews app.
So because officers were telling me the tool works so well, I wanted to see it for myself, on myself. And I asked them if they would run my photo through the app. But every time I did this, things would get weird. The officers would tell me that they ran my photo and there were no results.
annie brown
No pictures of you?
kashmir hill
There were no pictures of me, which was really weird, because I have a lot of photos of myself online. And then officers would just stop responding to me or talking to me. And I had no idea what was going on until one officer was kind enough to explain to me.
\[phone ringing\]
officer
Hello, how are you.
kashmir hill
Hey. Its Kashmir.
officer
Yes, hi. Mm-hmm.
kashmir hill
Im keeping this officer anonymous because he could get in serious trouble for talking to me so openly about Clearview.
kashmir hill
If you could just describe yourself, to the extent that you can describe yourself.
officer
Im a police officer at a large metropolitan police department.
kashmir hill
So hes a cop who was doing a 30-day free trial of the app. And he was really impressed with it. So I asked him if he wouldnt mind running my photo.
annie brown
And what did he tell you happened when he sent your picture through?
officer
Yeah, nothing. I didnt get a response at all.
kashmir hill
No results?
officer
No results. And within a couple of minutes of me putting your photo up there — maybe five, less than 10 — I got a phone call from the Clearview company. They wanted to know why I was uploading a New York Times reporters photo.
kashmir hill
That is so wild. I dont know. \[LAUGHS\] It creeps me out as a reporter. I mean yeah, it just —
officer
It kind of creeped me out as a user.
kashmir hill
So this implied that Clearview flagged my face in their system such that they got an alert when a police officer ran my face. Which I found —
annie brown
Wow.
kashmir hill
— very alarming, because this is telling me for the first time that this company is able to monitor who law enforcement is looking for, and not just know who theyre looking for, but manipulate the results. And so then that made me go back to the earlier officers who had run my photo. And they all confirmed, yes, I got a call from the company, and they said, were not supposed to be talking to the media.
\[music\]
kashmir hill
So were you able to keep using the app after that?
officer
My account was deactivated.
kashmir hill
Did you ever get access back?
officer
I never did. But I have colleagues that have access. So if I were to need a picture searched, I could just email it to them and they can email me the results.
kashmir hill
And you think the trade-offs are worth it, in terms of what the company has access to?
officer
Do I think its worth it? So from a law enforcement perspective, its worth it. We get a lot of cases, and we dont usually have a lot of leads. And so anything that can — honestly, anything that can help us solve a crime is a win for us. From a privacy perspective, its rather frightening the amount of information that they were able to get and provide. As long as theyre doing it for the right reasons, then everything will work out. Lets put it that way.
\[music\]
kashmir hill
But the problem is we dont know anything about the company at this point. We dont know if theres any kind of oversight. We dont know who the people are that are operating this and what their intentions are with their product. The person in charge of the company wont talk to me. But then, its the end of December when I get a call from the companys spokeswoman. And she says that the founder, Hoan Ton-That, is ready to talk.
michael barbaro
Well be right back.
kashmir hill
Do you have a hard stop?
hoan ton-that
No I dont actually. 12:30.
lisa linden
12:00 noon.
hoan ton-that
Oh, 12:00 noon.
kashmir hill
I have no hard stop.
lisa linden
Oh.
kashmir hill
And I have lots of questions, so Ill take as much time as you can give me.
annie brown
So Kashmir, you finally got an interview with the founder of Clearview, this man named Hoan Ton-That. Where do you meet him?
kashmir hill
So we met in a WeWork in Chelsea. He came down to the lobby.
kashmir hill
You like New York, youre going to stay here?
hoan ton-that
Oh, yeah.
kashmir hill
And his appearance surprised me, because I had Googled him online and there are a lot of photos of him. And hes usually pretty eccentric — like a lot of paisley shirts, hes at Burning Man.
hoan ton-that
Lets go to the back room.
kashmir hill
But in person he was very conservative. He was in this dark blue navy suit with a white button-up and leather shoes. So he looked very much like the security start-up entrepreneur.
annie brown
He was looking the part.
kashmir hill
He was looking the part.
kashmir hill
When were you born? How old are you?
hoan ton-that
88, so Im 31.
kashmir hill
O.K.
annie brown
And what do you learn about him?
kashmir hill
So he is 31. He grew up in Australia, but you cant hear that in his voice.
hoan ton-that
I love computers, obviously.
kashmir hill
Yeah, so how did you get interested in technology?
hoan ton-that
We had a computer, of course, when I was four or five years old.
kashmir hill
So his family got a computer when he was three or four, and he was always tinkering with computers growing up.
hoan ton-that
We got the internet when I was 10, I think. And then you could discover all these things online. But Linux, I was like I have to get this thing. Its the nerdiest thing ever. I convinced my dad. We installed it, and I would spend the whole summer reinstalling and learning Linux stuff, staying home from high school and learning programming for fun. So thats — I just really liked it.
kashmir hill
He enrolled in college, decided to drop out like many technologists do, and moved to San Francisco when he was 19.
hoan ton-that
— 2007, before it was a big thing, right? It was kind of getting there, but it wasnt huge.
kashmir hill
This is 2007, and this is kind of a boom time. The iPhone has just come out.
hoan ton-that
Thats the Facebook app era. Remember that?
kashmir hill
Yeah.
kashmir hill
People are becoming millionaires by making Facebook games. And he wants to be the next big app guy.
hoan ton-that
Being there is a lot different from reading about it online. You absorb a lot more of how people get things done. And you learn a lot more secrets.
annie brown
What did he built?
kashmir hill
So the Facebook apps were like “would you rather” apps and kind of like romantic GIFs.
hoan ton-that
Did Some of the first iPhone games as well.
kashmir hill
One of his most recent apps was called Trump Hair, and it was an app for adding Trumps hair to your photos.
annie brown
Thats it?
kashmir hill
Thats it. The tagline was, “Its gonna be yuge!”
annie brown
O.K. \[LAUGHS\] So how do you move from a Donald Trump hair app to something that seems like it could revolutionize police work?
kashmir hill
Well, he moved to New York. And that seemed to be a big change for him. And he started meeting very different people. And one of the most important people he met was Richard Schwartz.
hoan ton-that
I ended up meeting Richard at a party.
kashmir hill
This 61-year-old guy who worked for Mayor Rudy Giuliani in the 1990s. He was just very politically connected.
hoan ton-that
I really loved that. He had a lot of stories. And then we talked for an hour about different ideas. Because I was like, this is what I do — technology. I can make anything. And it went from there.
kashmir hill
And the two of them decided, with Hoan Ton-Thats tech know-how and Richards Rolodex, that they want to try to start a facial recognition company together.
annie brown
And why facial recognition? Why did the two of them choose that?
kashmir hill
I think it was because Hoan had started reading a lot of papers about facial recognition and machine learning.
hoan ton-that
I had never really studied AI stuff before, but I could pick up a lot of it.
kashmir hill
And I think they realized they could make money doing it.
kashmir hill
What would you say, in terms of the range of ideas at first, what were you thinking?
hoan ton-that
A lot. I could go on, really crazy, but —
kashmir hill
Theres a lot of face recognition algorithms out there, and a lot that work pretty well. What was different about what Hoan Ton-That and Richard Schwartz were doing is they had been willing to scrape all of these photos from the internet. So they just had a huge database of photos.
annie brown
Right, the billions of photos.
kashmir hill
Exactly.
hoan ton-that
And then we had this point where we got to 99 percent accuracy. I remember that, it was just in the office. And he was like, wow, it works. Try that one again. Try that one again. And just every time, it would pick the right person out. And thats when we knew, this is crazy. This actually works.
annie brown
Is that legal? Can you just take photographs from anywhere on the internet and use them for this kind of thing?
kashmir hill
There was a ruling in a federal court this fall that said, yeah, this kind of public scraping seems to be legal.
annie brown
And what are they hoping to do with this software at this point?
kashmir hill
I mean, theyre just trying to figure out how they can make money off of the app. And so they eventually end up settling on law enforcement.
hoan ton-that
And they start solving cases from grainy A.T.M. photos, cases they wouldve never solved. So this spread to different departments, and then from one agency to other agencies.
annie brown
And do you ask him about that thing that happened with the officer who couldnt find your photos?
kashmir hill
Yeah, so that was one of my questions, and I wasnt entirely satisfied by his answer.
hoan ton-that
So —
kashmir hill
One thing that surprised me — some of the officers I talked to tried to run my photo through it, and they got no hits. And I tons of photos online.
hoan ton-that
\[LAUGHS\] It must have been a bug.
kashmir hill
Did you guys block me from like getting results?
hoan ton-that
I dont know about that.
kashmir hill
Because I was like, this doesnt make any sense.
kashmir hill
He said, oh yeah, that was a software bug. But he laughed.
kashmir hill
I was like, I have 1,000 photos online. This cant work as well as they say it works.
hoan ton-that
Yeah, well, it must have been a bug in the software or something.
kashmir hill
\[LAUGHS\] Why did you do that? It totally made me think that —
hoan ton-that
Hey, maybe it doesnt work. You never know, right? This could be the long con.
kashmir hill
Ah, O.K.
hoan ton-that
Im kidding, Im kidding. It works.
annie brown
What do you think that was about?
kashmir hill
\[LAUGHS\] I dont think it was a software bug.
hoan ton-that
Its a bug. I dont know. I —
kashmir hill
You have no idea, huh?
annie brown
Huh.
kashmir hill
Yeah. So he said the software bug is now fixed.
hoan ton-that
Oh yes, so Ill show you. This is the iPhone version.
kashmir hill
And he took a photo of me.
hoan ton-that
Oh, it does work.
kashmir hill
Oh, thats so surprising.
hoan ton-that
I know.
kashmir hill
And there, the results included a bunch of photos of me online.
kashmir hill
Oh my god, I totally forgot.
hoan ton-that
Well, we can take —
kashmir hill
Thats 10 years ago.
kashmir hill
Including some I had never seen before.
kashmir hill
Some of these photos I didnt know were online.
annie brown
So hes just brushing off this weird thing that happened to you. But do you get the sense that hes thinking at all about privacy?
kashmir hill
So I asked him, you know, this is a very powerful app. And I asked him what restrictions is he thinking about for it. And he said, one, that they were only selling it to law enforcement right now, though it does turn out that theyre also selling it to a few private companies for security purposes. But he said they wouldnt sell it to bad actors or bad governments.
hoan ton-that
— and our philosophy is basically, if its a U.S. based — or like a democracy or an ally of the U.S. — we will consider it. But like, no China, no Russia or anything that wouldnt be good. So if its a country where its just governed terribly or whatever, I dont know if wed feel comfortable selling to certain countries.
annie brown
So it doesnt sound like he has much of a rubric for deciding who to sell to. And it sounds like theres no one really overseeing how hes making these decisions.
kashmir hill
At this point, its just up to Clearview to decide who they want to sell the app to.
hoan ton-that
No pressure, but when we talk to some venture capitalists, theyre like, “Why dont you make this consumer? Law enforcement is such a small market. You wont make that much money.” And weve considered it, and were just like, whats the use case here? And right now, we catch, help catch pedophiles. What if a pedophile got access to this, goes around the street, runs —
kashmir hill
But when I was talking to one of their investors, he says, we want to dominate the law enforcement market, and then we want to move into other markets like hospitality, like real estate. And he predicted that one day, all consumers will have access to this app.
hoan ton-that
Um, and —
kashmir hill
I can tell you that one of your investors hopes that you guys are going to go into the consumer market.
hoan ton-that
Well, yeah. He talks too much. But like, were not — were not going to do that. I just dont —
annie brown
Hoan seems to be saying, yeah, theres pressure on us to sell to private consumers, but were not going to do that. And how reasonable is it to think that he has control or the company has control at this point over where this technology goes?
kashmir hill
I mean, one point that I made when I was talking to him is that oftentimes, the tools that law enforcement use end up in the hands of the public.
kashmir hill
I just — I personally feel like you guys have opened the door to now this becoming more normalized, just because a lot of tools that law enforcement have eventually make their way into public hands.
hoan ton-that
Not always. Not everyone has a gun. \[LAUGHS\] Right? That would be —
kashmir hill
Anyone who wants one can get one in the U.S. basically, but —
kashmir hill
His response was strange. He said, well, look at guns. Law enforcement has guns, but not everybody has a gun. And I dont know if thats because hes from Australia?
annie brown
Yeah, hes proving your point, in a way.
kashmir hill
\[LAUGHS\] It did seem like he was proving my point, rather than rebutting it.
\[music\]
Weve been building the technology to make this possible for years now. Facebook building this huge database of our photos with our names attached to it, advances in image recognition and search technologies, it all led us here. But theres been no accompanying regulation or rules around how the technology should be used. Theres no real law or regulation that makes this illegal. The scraping seems to be O.K. We dont have a big ban on facial recognition. We dont need to give consent for people to process our faces. And so in terms of holding this tool back, were just relying on the moral compasses of the companies that are making this technology and on the thoughtfulness of people like Hoan Tan-That.
kashmir hill
But yeah, what do you think about that? Do you think that this is too dangerous a tool for everybody to have?
hoan ton-that
I have to think about that and really get back to you on an answer, because its a good question.
kashmir hill
Yeah.
hoan ton-that
Ive thought about it a little bit.
kashmir hill
You havent thought about it? You have?
hoan ton-that
I have, I have. But I need to really come up with a good answer for that. Honestly like, yeah.
\[music\]
annie brown
Thanks, Kashmir.
kashmir hill
Thank you.
michael barbaro
Since Kashmir began reporting on Clearview AI, several major social media companies including Facebook, Twitter and Venmo have demanded that the company stop using photos scraped from their websites. But its unclear what, if any, power those social media companies have to force Clearview to comply. A few weeks ago, the state of New Jersey barred law enforcement from using Clearviews technology, but police remain free to do so in 49 other states.
Well be right back.
Heres what else you need to know today. President Trump has begun a campaign of retribution against witnesses in the impeachment inquiry, firing Gordon Sondland, his ambassador to the European Union, who called the presidents actions toward Ukraine a quid pro quo. And Lieutenant Colonel Alexander Vindman, a member of the National Security Council, who expressed alarm over the presidents phone call with the leader of Ukraine. The Times reports that several Republican senators urged Trump not to fire the witnesses, fearing it would send a dangerous message, but that the president ignored their advice. And the global death toll from the coronavirus has reached more than 800, surpassing that of the SARS epidemic, which killed 774 in 2003. The number of confirmed infections from the coronavirus now stands at more than 37,000. Finally, new polling in New Hampshire, which will hold its primary tomorrow, shows Mayor Pete Buttigieg neck-and-neck with Senator Bernie Sanders and former Vice President Joe Biden slipping into fourth place.
archived recording (george stephanopoulos)
Vice President Biden, the first question is for you. In the last few days, youve been saying that Democrats will be taking too big a risk if they nominate Senator Sanders or Mayor Buttigieg, but they came out on top in Iowa. What risks did the Iowa Democrats miss?
michael barbaro
The poll, conducted by The Boston Globe, WBZ and Suffolk University suggest Buttigieg is benefiting from a strong performance in the Iowa caucuses and that Biden may perform poorly for the second time in a row, a prediction Biden confirmed during Friday nights debate on ABC.
archived recording (joe biden)
Oh, they didnt miss anything. This is a long race. I took a hit in Iowa, and Ill probably take it here.
michael barbaro
Thats it for “The Daily.” Im Michael Barbaro. See you tomorrow.
Image
Credit...Charlotte Kesl for The New York Times
In Gainesville, Fla., Detective Sgt. Nick Ferrara heard about Clearview last summer when it advertised on CrimeDex, a list-serv for investigators who specialize in financial crimes. He said he had previously relied solely on a state-provided facial recognition tool, [FACES](https://www.nytimes.com/2020/01/12/technology/facial-recognition-police.html), which draws from more than 30 million Florida mug shots and Department of Motor Vehicle photos.
Sergeant Ferrara found Clearviews app superior, he said. Its nationwide database of images is much larger, and unlike FACES, Clearviews algorithm doesnt require photos of people looking straight at the camera.
“With Clearview, you can use photos that arent perfect,” Sergeant Ferrara said. “A person can be wearing a hat or glasses, or it can be a profile shot or partial view of their face.”
He uploaded his own photo to the system, and it brought up his Venmo page. He ran photos from old, dead-end cases and identified more than 30 suspects. In September, the Gainesville Police Department paid $10,000 for an annual Clearview license.
Federal law enforcement, including the F.B.I. and the Department of Homeland Security, are trying it, as are Canadian law enforcement authorities, according to the company and government officials.
Despite its growing popularity, Clearview avoided public mention [until the end of 2019](https://www.wftv.com/news/local/florida-law-enforcement-agencies-use-facial-recognition-identify-alleged-thief/SGHPUGB5W5CX3FYVSLU7P6EV7I/), when Florida prosecutors charged a woman with grand theft after two grills and a vacuum were stolen from an Ace Hardware store in Clermont. She was identified when the police ran a still from a surveillance video through Clearview, which led them to her Facebook page. A tattoo visible in the surveillance video and Facebook photos confirmed her identity, according to an affidavit in the case.
## Were All Screwed
Mr. Ton-That said the tool does not always work. Most of the photos in Clearviews database are taken at eye level. Much of the material that the police upload is from surveillance cameras mounted on ceilings or high on walls.
“They put surveillance cameras too high,” Mr. Ton-That lamented. “The angle is wrong for good face recognition.”
Despite that, the company said, its tool finds matches up to 75 percent of the time. But it is unclear how often the tool delivers false matches, because it has not been tested by an independent party such as the National Institute of Standards and Technology, a federal agency that [rates the performance](https://www.nist.gov/programs-projects/face-recognition-vendor-test-frvt-ongoing) of facial recognition algorithms.
“We have no data to suggest this tool is accurate,” said Clare Garvie, a researcher at Georgetown Universitys Center on Privacy and Technology, who has studied the [governments use of facial recognition](https://www.flawedfacedata.com/). “The larger the database, the larger the risk of misidentification because of the doppelgänger effect. Theyre talking about a massive database of random people theyve found on the internet.”
But current and former law enforcement officials say the app is effective. “For us, the testing was whether it worked or not,” said Mr. Cohen, the former Indiana State Police captain.
One reason that Clearview is catching on is that its service is unique. Thats because Facebook and other social media sites prohibit people from scraping users images — Clearview is violating the sites terms of service.
“A lot of people are doing it,” Mr. Ton-That shrugged. “Facebook knows.”
Jay Nancarrow, a Facebook spokesman, said the company was reviewing the situation with Clearview and “will take appropriate action if we find they are violating our rules.”
Mr. Thiel, the Clearview investor, sits on Facebooks board. Mr. Nancarrow declined to comment on Mr. Thiels personal investments.
Some law enforcement officials said they didnt realize the photos they uploaded were being sent to and stored on Clearviews servers. Clearview tries to pre-empt concerns with [an F.A.Q. document](https://int.nyt.com/data/documenthelper/6690-clearview-faq/c8b081a0bcca12e7903a/optimized/full.pdf#page=1) given to would-be clients that says its customer-support employees wont look at the photos that the police upload.
Clearview also hired Paul D. Clement, a United States solicitor general under President George W. Bush, to assuage concerns about the apps legality.
In [an August memo](https://int.nyt.com/data/documenthelper/6689-clearview-legal-memo/c8b081a0bcca12e7903a/optimized/full.pdf#page=1) that Clearview provided to potential customers, including the [Atlanta Police Department](https://www.muckrock.com/foi/atlanta-325/facial-recognition-atlanta-ga-76491) and the Pinellas County Sheriffs Office in Florida, Mr. Clement said law enforcement agencies “do not violate the federal Constitution or relevant existing state biometric and privacy laws when using Clearview for its intended purpose.”
Mr. Clement, now a partner at Kirkland & Ellis, wrote that the authorities dont have to tell defendants that they were identified via Clearview, as long as it isnt the sole basis for getting a warrant to arrest them. Mr. Clement did not respond to multiple requests for comment.
The memo appeared to be effective; the Atlanta police and Pinellas County Sheriffs Office soon started using Clearview.
Because the police upload photos of people theyre trying to identify, Clearview possesses a growing database of individuals who have attracted attention from law enforcement. The company also has the ability to manipulate the results that the police see. After the company realized I was asking officers to run my photo through the app, my face was flagged by Clearviews systems and for a while showed no matches. When asked about this, Mr. Ton-That laughed and called it a “software bug.”
“Its creepy what theyre doing, but there will be many more of these companies. There is no monopoly on math,” said Al Gidari, a privacy professor at Stanford Law School. “Absent a very strong federal privacy law, were all screwed.”
Mr. Ton-That said his company used only publicly available images. If you change a privacy setting in Facebook so that search engines cant link to your profile, your Facebook photos wont be included in the database, he said.
But if your profile has already been scraped, it is too late. The company keeps all the images it has scraped even if they are later deleted or taken down, though Mr. Ton-That said the company was working on a tool that would let people request that images be removed if they had been taken down from the website of origin.
Woodrow Hartzog, a professor of law and computer science at Northeastern University in Boston, sees Clearview as the latest proof that [facial recognition should be banned](https://www.nytimes.com/2019/10/17/opinion/facial-recognition-ban.html) in the United States.
“Weve relied on industry efforts to self-police and not embrace such a risky technology, but now those dams are breaking because there is so much money on the table,” Mr. Hartzog said. “I dont see a future where we harness the benefits of face recognition technology without the crippling abuse of the surveillance that comes with it. The only way to stop it is to ban it.”
## Where Everybody Knows Your Name
During a recent interview at Clearviews offices in a WeWork location in Manhattans Chelsea neighborhood, Mr. Ton-That demonstrated the app on himself. He took a selfie and uploaded it. The app pulled up 23 photos of him. In one, he is shirtless and lighting a cigarette while covered in what looks like blood.
Mr. Ton-That then took my photo with the app. The “software bug” had been fixed, and now my photo returned numerous results, dating back a decade, including photos of myself that I had never seen before. When I used my hand to cover my nose and the bottom of my face, the app still returned seven correct matches for me.
Police officers and Clearviews investors predict that its app will eventually be available to the public.
Mr. Ton-That said he was reluctant. “Theres always going to be a community of bad people who will misuse it,” he said.
Even if Clearview doesnt make its app publicly available, a copycat company might, now that the taboo is broken. Searching someone by face could become as easy as Googling a name. Strangers would be able to listen in on sensitive conversations, take photos of the participants and know personal secrets. Someone walking down the street would be immediately identifiable — and his or her home address would be only a few clicks away. It would herald the end of public anonymity.
Asked about the implications of bringing such a power into the world, Mr. Ton-That seemed taken aback.
“I have to think about that,” he said. “Our belief is that this is the best use of the technology.”
Jennifer Valentino-DeVries, Gabriel J.X. Dance and Aaron Krolik contributed reporting. Kitty Bennett contributed research.
[Kashmir Hill](https://www.nytimes.com/by/kashmir-hill) is a tech reporter based in New York. She writes about the unexpected and sometimes ominous ways technology is changing our lives, particularly when it comes to our privacy. [More about Kashmir Hill](https://www.nytimes.com/by/kashmir-hill)
A version of this article appears in print on  , Section
A
, Page
1
of the New York edition
with the headline:
Face Scan App Inches Toward End of Privacy. [Order Reprints](https://www.parsintl.com/publication/the-new-york-times/) | [Todays Paper](https://www.nytimes.com/section/todayspaper) | [Subscribe](https://www.nytimes.com/subscriptions/Multiproduct/lp8HYKU.html?campaignId=48JQY)
Advertisement
[SKIP ADVERTISEMENT](#after-bottom)