Getting 'Physical' And Emotional In Virtual Reality
If you think about virtual reality, you probably think of it as the place where gamers don an Oculus headset and go shoot up enemies in 3-D or travel space. Virtual reality is not a place people go to just hang out and socialize. Now, Silicon Valley is trying to change that.
NPR invited a few couples to meet up in a new virtual world. And it turns out things can get real — in a bad way. Feelings can get hurt.
Virtual Reality Feels Physical
Amy Jones and her boyfriend, Robert Gordon, are in their apartment in Oakland, Calif., each wearing a big 3-D headset — the kind that covers half the face, from forehead to nose. I'm miles away, in Redwood City, also wearing a headset.
We meet online, in a 3-D room that looks like a cartoon. It's a luxury loft with a fireplace. A startup called AltspaceVR built it.
Gordon is ready to explore and asks us, "You want to go check out the fantasy world over there?"
We check out some paintings in an art gallery, and then flip channels — teleporting ourselves to a desert oasis. There's a straw hut with a huge mirror. Now we can see our whole bodies — not just our arms and torsos. And, we're weird!
"You look like a very futuristic butler," Jones tells her boyfriend. She looks like Rosie from The Jetsons (if you're old enough to get the reference).
We're robots. But instead of legs we have bottoms shaped like an ice-cream cone. Gordon suggests we try to disco with our upper bodies.
In online games, like the original Second Life, you move your character with a keyboard or controller. You don't feel connected to the cursor.
Here, it's different. You tilt your real chest forward — and your robot leans in. There's a camera in front of you, tracking and translating your movement. This work of "rendering" images is very much a work in progress.
Still, as it stands today, the more I see my robot move when I move, the more it feels like it's me.
Jones says, "I don't usually dance like I'm trying to slowly push someone away from me." Gordon, who's trying to get closer, chides her: "Yes you do!"
Even As Low-Grade Robots, We Feel
The virtual world feels physical. I want to see if it's intimate, if we feel close (as robots).
Over by a virtual ocean, the waves gently breaking, I ask if I can try a little experiment. Jones volunteers. I tell her: "My fair warning is that it will require being a bit in your face." And by "face," I mean robot face: no nose or lips.
Again, in real life we're in different rooms miles away. I lean forward, so that my robot is right up against hers.
Jones doesn't like it. She grunts a bit and compares it to a crowded subway car, with other bodies too close for comfort. "It makes me want to back up a little bit, just because of that same subway impulse," she says.
To her boyfriend, who's standing a few virtual feet away, it looks like our robot heads are touching.
"I don't really want to, but I feel a little bit jealous," Gordon admits. "I already have this sensation like this body has Amy in it. And here's someone right up, head snuggling."
Jones doesn't like that he feels that way so she backs up.
Triggering 'Social Presence'
It might sound strange to be jealous of animated robots head snuggling — but turns out, it's not.
I ran this test — getting "physical" in the virtual world — with a few couples. In one instance, a woman perceived she was being physically assaulted. Her partner wanted to lunge forward to protect her.
A junior engineer who was recording these exchanges, John Shaughnessy, remembers another instance, when a man said his wife's eyes were glaring at him. "When he said that, he was projecting body language that didn't exist. There's no way that she could be glaring at him," he says.
"No way" because they didn't have eyes. They had buttons.
"You can do anything. There's no rules. There's no physics. But the brain treats these experiences as real," says psychologist Jeremy Bailenson. "It's a very strange social situation."
Bailenson heads the Virtual Human Interaction Lab at Stanford University and expects these kinds of emotive results.
The startup AltspaceVR is creating a platform where people alone on their couch can "sit close" and watch Netflix or YouTube together. Other Silicon Valley companies are racing to build other tactile virtual space.
Bailenson says only a handful of scientific experiments have studied how the human brain reacts when we feel this thing called "social presence."
He defines it as: "This magic feeling where all of a sudden: Wow! I know that person is an actual living, breathing human being on the other end, and it feels real. It's very difficult to quantify when it happens."
Bailenson did a study 12 years ago that found real people "flinch" when a virtual avatar invades their personal space. In another study, researchers found that having a realistic face is not a major contributor to social presence. The mere presence of any face has a greater effect than making sure it's granular like a photograph.
He says only a few thousand people on earth have experienced "social presence" — my couples and myself now among them. The technologists building this thing haven't written the code of conduct.
Copyright 2020 NPR. To see more, visit https://www.npr.org.