Who Gets to Interpret You? | The Machine-Readable Self

What happens when identity stops being something we declare and becomes something machines infer?

In this specially assembled edition of The Future of You, Tracey Follows returns to four conversations that reveal how the self is becoming machine-readable.

Artist and AI pioneer Holly Herndon explains why anything captured in media can become training data. Journalist Kashmir Hill traces the rise of searchable facial recognition and the danger of infrastructure built for security being used for exclusion. 

Biometrics entrepreneur Andrew Bud explains why the face is becoming the root of trust in the digital economy. Investigative journalist Byron Tau reveals the expanding world of data brokers and the invisible digital exhaust emitted by our devices.

Together, these conversations show how identity is becoming an ambient layer assembled from faces, voices, gestures, locations, transactions, relationships and inference.

The machine-readable self is not a future scenario. It is already here.

Tracey also connects these conversations to her work on the Database Self and the Database Brand, exploring how people and organisations are increasingly interpreted by systems.

The question is no longer simply: who are you?

It is: who, or what, gets to interpret you?

Contributors

Holly Herndon
Kashmir Hill
Andrew Bud
Byron Tau

Explore Tracey’s wider research and advisory work at futuremade.group.

Watch The Future of You: Reframed on YouTube @FutureofYou

Visit: 

→ Me:chine World and essays: me-chine.com

→ Podcast archive The Future of You

→ Audiobook series (weekly chapters) Introduction

Transcript

Who gets to interpret you?

Tracey Follows 0:19

What happens when your identity stops being something that you declare and starts becoming something that's inferred? Not by other people, but by machines. That's

Holly Herndon: when media becomes training data

Tracey Follows 0:30

what we're here to investigate in the machine readable self, a compilation episode of archive conversations from the last few years of The Future of You, the podcast. Here's Holly Herndon.

Holly Herndon: From machine-readable to searchable

Holly Herndon 0:45

As soon as something is captured in media, or as soon as you take a photograph or a video of anything, then it becomes machine legible, and then it can become part of a training canon, you know, to train a model that you may never even interact with.

Tracey Follows 1:00

Holly's point is deceptively simple. Once something is captured, it can be read by machines. A photograph, a voice, a gesture, a fragment of media. All of it becomes potential training data. So identity is no longer just what we say about ourselves, it's what the system can extract from us. But all this kind of digital phenotyping, treating us almost like patients, capturing some of the atmospheric or environmental data around us, the way we move. I was talking to somebody about, you know, motion prints in VR, for example, the way in which our gesture with our head and our hands, well, you know, it's so individual that it's like a fingerprint and they call it motion print.

Holly Herndon 1:39

I think it all depends on kind of where we end up in terms of who's using this data and for what purpose. I like to think of AI as us in aggregate, as a collective human accomplishment rather than a kind of like alien other that's here to just replace us.

Speaker 4 1:55

That is the first shift. The self becomes data. But once the self is readable, it can also

Kashmir Hill: facial recognition and exclusion

Speaker 4 2:02

become searchable. And that is where the consequences become much harder to contain. Here's Kashmir Hill.

Kashmir Hill 2:09

When I first discovered Clearview AI, what it was doing was a secret. It was not known by the general public. People found it really shocking that their photos had been collected by this random company. And honestly, people were upset. What Clearview is doing is, you know, they built this database. They wanted to make money off of it. They would end up selling it to police departments, law enforcement officials, thousands of agencies. And it was tried by police departments around the world, including in the UK. There is an events venue here called Madison Square Garden. It's a really iconic venue for concert shows. And they started using facial recognition technology, not Clearview AI, a different company a few years back to address security threats. But in the last year, the billionaire, James Dolan, who owns that venue, decided to ban lawyers that worked at firms that have sued his company. I went with a lawyer, I watched it happen. She got pulled aside. They said, You're not allowed in here. You work at a firm that's banned. And she said, I'm not on that case. You know, I'm not working on anything related to this. They said, it doesn't matter. You're banned until your firm drops its lawsuit against us. And so that is just, oh, you know, a very striking way that this technology can be used to discriminate against people in new ways, even based on the work that you do. The other risk is just that you get slippage, that it starts out with, we don't want you coming in here because you're a threat. But then you realize there's other ways you can wield the superpower. But once you get this infrastructure in place, it might be used in a way that wasn't originally envisioned.

Tracey Follows 3:57

Kashmir's example is so powerful because it shows how quickly a security technology becomes an identity technology. The face is no longer simply something that people recognize, it becomes an access point, a filter, a permission system, a way of deciding who gets in and who's kept out, and on what grounds. Here's Andrew Bud.

Andrew Bud 4:21

To me, a digital identity is a set of facts about me. But a person is not the same as a set of facts in a folder. So there comes a moment in the life of every digital identity when that folder has to be bound to a real life physical human being. And that's our job. So our job is to bind that buff folder full of facts about you to a genuinely present human being who is the owner of that folder. I'm sometimes asked, uh, you know, what's so special about a f about

Andrew Bud: the face as the root of trust

Andrew Bud 4:50

a face? You know, why not the iris? And the answer or the voice. And the answer is, well, frankly, when the government creates credentials of my identity, they don't put my iris into it. The only thing that binds this passport that I'm invisibly waving at you at this moment, Tracy, uh, that shows that it's mine is my face on page two. The face will continue to become a B, and it's the coarse root of trust in the digital economy, and assuring the genuine presence of that face will become fundamental to the disability of society.

Tracey Follows 5:22

Andrew gives us the other side of the problem. In an age of deep fakes, robots, and synthetic media, we do need ways to know that a real human being is present. So, the face becomes the root of trust. But the paradox is obvious. To prove we are human, we increasingly have to submit ourselves to machine reading. Here's Byron Tao.

Byron Tau 5:45

The first era is the traditional data broker, and these are companies who are kind of sort of household names if you pay attention to tech and to advertising. They're companies like Thomson Reuters, Axiom, credit bureaus like TransUnion eventually got into this kind of

Byron Tau: the invisible data trail

Byron Tau 6:01

market. And what they have historically done is gone out and taken either credit data from banks, commercial data from things like magazine subscriptions, public data from things like courthouses, marriage records, hunting licenses, driver's licenses, and created essentially lists of where people live in the world, what assets they own, and some basic demographic information, right? The second generation is social data brokers. So when social media became a big part of the way we communicate and the way we express ourselves in the early 2000s, there started to be these data brokers that began monitoring the social conversation. Governments also increasingly became interested in acquiring social media data and analyzing it and looking at people's connections with each other and who they talk to and what they say. Then there's location brokers. So these are brokers that started collecting information off of mobile phones. And then the weirdest kind of data I write about is what I call in the book gray data, you called it esoteric data, but you know, it is data that we do not normally associate with, we don't even really think about. It's this kind of weird digital exhaust. So I'm talking to you through a pair of Bluetooth headphones. Well, Bluetooth headphones are constantly pinging out a signal, and if you know how to collect that signal, uh you can say Byron's Bluetooth headphones were at this particular address. There's just all manner of data sets that you really need to be a technologist to understand, and governments are moving to collect that kind of data as well.

Tracey Follows 7:35

The machine readable self is not a future scenario, it is already here. Our faces, our voices, our movements, transactions, preferences, and behaviours are becoming part of a larger identity layer, one interpreted less by people and more by systems. This is the shift I've been exploring through my work on everything in the future of you through to the database self and the database brand. How people and organizations are increasingly understood through data, signals, relationships, and inference. The question now is not simply who are you? It is who or what gets to interpret you. Thanks for listening, and please do join us next time for another archive essay taken from the conversations we've had on the Future Review. And please do subscribe and like and share. Thanks for listening.