NASA's virtual reality journey uses same software hardware as gamers

Photo: Steve Gonzales, Houston Chronicle / Houston Chronicle

Image 1of/4

Caption

Eddie Paddock talks about the virtual reality at NASA Monday, Feb. 26, 2018, in Houston. ( Steve Gonzales / Houston Chronicle )

Photo: Steve Gonzales, Houston Chronicle / Houston Chronicle

Eddie Paddock talks about the virtual reality at NASA Monday, Feb. 26, 2018, in Houston. ( Steve Gonzales / Houston Chronicle )

Photo: Steve Gonzales, Houston Chronicle / Houston Chronicle

Eddie Paddock talks about the virtual reality at NASA Monday, Feb. 26, 2018, in Houston. ( Steve Gonzales / Houston Chronicle )

Photo: Steve Gonzales, Houston Chronicle / Houston Chronicle

This is the view of what astronauts see when they are in the virtual reality lab in NASA Johnson Space Center Monday, Feb. 26, 2018, in Houston. ( Steve Gonzales / Houston Chronicle )

Photo: Steve Gonzales, Houston Chronicle / Houston Chronicle

Standing on the end of the robotic arm outside the International Space Station, the Earth appears as a vast, azure expanse 250 miles below. Staring down, it feels as though you could easily, maybe even happily, fall into that glow. It’s intoxicating.

But look up, and the total blackness of space — dotted by stars and planets bright enough to overcome the reflected glare of sunlight off the space station — is even more overwhelming. Out here there is majesty above and below, and in the strata between is the technological marvel of the station itself, prickly with antennae, solar panels, puffy insulation, wiring and a docked Soyuz spacecraft, which is ultimately your ride back home.

The sight is beautiful, awe-inspiring, humbling and a hundred other joyful adjectives, none of which do the scene justice.

Too bad it’s not real.

Remove the virtual reality headset, and you’re back on Earth. Specifically, you’re in a small office in Building B9 on the NASA Johnson Space Center campus, surrounded high-tech hardware — sensors, cameras, large display monitors — and the mundane furnishings of government life: aging desks, beige walls, plywood dividers, fluorescent lighting. It’s a jarring comedown after frolicking in simulated orbit.

But this is one of many rooms at NASA where astronauts come to train for flights to the International Space Station and, maybe in the near future, to the moon and Mars. Here, NASA’s modern knights go over processes they’ll employ in spacewalks and ISS procedures. Some of what they learn here may save their lives.

For almost 30 years, NASA has been building a virtual reality universe behind these 1960s-era walls at Johnson Space Center, cobbling makeshift headsets and writing homegrown software to train astronauts for life in space long before they suit up. Those early efforts were crude and expensive, but kept the space agency on the cutting edge of virtual reality even as the technology seemed to vanish for a while for consumers.

$40K headset now $500

The technology is now enjoying a renaissance, and NASA is rushing to take advantage of it. VR headsets that gamers purchase for a few hundred bucks and connect to off-the-shelf personal computers are supplanting those that used to cost NASA tens of thousands of dollars to design and build.

And NASA’s VR software, which allows the stunning recreation of the ISS, the Earth below it and cosmos above, is slowly being nudged out by commercial and open-source 3D software that’s also used to build popular video games. Besides the cost savings, NASA can take advantage of advances in VR technology almost as fast as it comes to market.

“You can leverage all the work the commercial world is doing, instead of paying an expensive engineer to maintain complex software,” said Eddie Paddock, the manager of the VR effort at Johnson Space Center. The four employees and two interns who work with him are responsible for creating simulations and training astronauts with them.

Paddock’s lab is dotted with artifacts from VR’s earlier epoch. There are headsets that look like steampunk props from a Terry Gilliam movie, but they’re very real — NASA engineers built them by hand back in the day, at a cost of $30,000 to $40,000 each. Now, you can bring home from Fry’s or MicroCenter a consumer headset with dramatically better resolution and faster displays for less than $500.

The space agency’s interest in virtual reality dates to the early 1990s, though some old-timers say NASA was exploring the concept even before the term “virtual reality” was coined in the mid-1980s.

The VR lab, founded in the early 1990s by David Homan, was involved in training astronauts during the Space Shuttle era. Homan made his earliest mark by using VR to train the astronauts who were involved in the spacewalk to repair the Hubble Space Telescope.

One of the contraptions built for that mission is still used in the lab: Charlotte, a metal cube with handles on it that’s attached to a web of cables. It simulates the feel of an object that has no weight, due to the lack of gravity in space, but still has substantial mass. Astronauts who spacewalk to do work outside the space station spend time wearing VR headsets, pushing and pulling on Charlotte’s handholds, and in their VR headsets they might see a satellite or other mission hardware instead of a spartan metal cube — just as their predecessors did 25 years ago.

Paddock says astronauts who go through the training report back after they return home that they felt “as though they had already been there” thanks to this training. They can practice difficult and even risky procedures in the comfort of an air-conditioned office.

“Space is a dangerous place,” Paddock says. “The lab is an environment that is much less hazardous.”

Not just off-the-shelf

While a lot of the VR training happens on the ground, some of it needs to take place in space. Because astronauts spend months on the space station, Paddock says, their training needs to be refreshed periodically. Or, if a spacewalk is required to fix something outside the station, he and his team can put together a VR training routine and upload it to the ISS.

Right now, the VR gear used on the space station is a hack in the old-school NASA VR tradition. The headset used by the ISS crew is a full-sized Lenovo ThinkPad laptop mounted onto a headpiece with the screen fixed in front of the wearer’s face. What would be clumsy and awkward on Earth is not a burden in the microgravity of orbit. But still, it’s not the best setup, Paddock says.

So, in April, a SpaceX supply mission will bring the ISS residents some newer gear: Two VR headsets made by Oculus, the company credited with rebooting public interest in virtual reality, and a pair of faster HP ZBook laptops to power them.

The headset, a model called the Oculus Rift, sells for $399. The ZBook has a price tag on HP’s website of around $2,000.

One of the uses for the onboard VR system: Refreshing crew members on use of SAFER, a jetpack built into the suits used in spacewalks. SAFER, or Simplified Aid for EVA Rescue, allows an astronaut to return to the shuttle should she or he become untethered and float away. It’s a safety feature that’s never had to be used, and hopefully never will be, but astronauts need to keep up their training on the feature. The ISS crew dons their VR gear and regularly simulates having to activate SAFER.

“It’s a lot easier, and a lot safer, to do it in VR than to have them suit up and do it in a spacewalk,” Paddock said.

Two-way payoff

The software that has long been used to display the virtual worlds in NASA’s universe is called DOUG, which stands for Dynamic Onboard Ubiquitous Graphic. It both renders the spectacular images seen in NASA’s VR system, as well as handles the physical rules of how objects behave. It looks as good as any rendering engine found in commercial applications, such as computer games.

But it is expensive to update and maintain, and NASA is starting to turn to the same kind of graphics engines found in popular video games. The space agency is working with two in particular: the Unreal engine, developed by Epic Games, and Unity, an open-source engine that claims to be the most-used game renderer in the world.

In addition, NASA is using an Nvidia application called the Holodeck — named after the virtual reality playground in “Star Trek: The Next Generation” — to begin evaluating designs for the Deep Space Gateway, a space station that is planned to orbit the moon and ignite the agency’s manned exploration efforts in deep space.

NASA’s work with these technology companies pays off for them as well. They learn from NASA, and vice versa, Paddock said.

For example, during a recent visit to NASA, Oculus Chief Technical Officer John Carmack was interested in the tweaks Paddock’s team made so virtual reality software runs more smoothly on the HP ZBook laptop. Carmack was one of the co-founders of Dallas-based id Software, and wrote the graphics engines for the classic first-person shooters “Doom” and “Quake.” That could potentially help the gear made by Oculus, which is now owned by Facebook, run on home computers that are less powerful, and thus less expensive.

dwight.silverman@chron.com |twitter.com/dsilverman |houstonchronicle.com/techburger

Let's block ads!(Why?)

Read Again NASA's virtual reality journey uses same software, hardware as gamers : http://ift.tt/2HohKz7

Let's block ads! (Why?)