Wearable Computer Displays Provide Critical Information Anytime, Anywhere

August 2002

Wearable computer displays may one day become a standard piece of attire. MITRE is analyzing ways this technology can work compatibly in the real world and the cyberworld. 

It's hot, it's smoky, and lives may be in danger. When firefighters enter a building filled with blazing flames and sooty smoke, seconds count. What if sensors were available to allow these firefighters to more safely and efficiently navigate a blazing building and more easily locate injured occupants?

Now consider a soldier in the field—or the jungle, or the desert, or the mountains on some faraway foreign soil. Maybe he needs to locate members of his unit or identify enemy targets. Since laptop systems aren't practical in environments like this, a wearable computer display system would allow quick access to information on getting back to camp or "overlays"of buildings selected for missile targets.

Finally, think about how beneficial a wearable display could be to an air traffic controller in an airport tower—someone responsible for maintaining safety of flight and operational efficiency right at the airport. Without having to look at a wall-mounted computer display or touch a keyboard, a tower controller could learn volumes about incoming and outgoing planes—such as flight numbers and descent information—using a mobile display unit that overlays information right on the airplane the controller is looking at.

With a wearable computer display—a small, smart device that's connected to information from the outside world—firefighters, soldiers, air traffic controllers, or anybody in need of information anytime or anywhere could get data necessary to save money, save time, and save lives.

They've come a long way...

While cell phones have kept users connected to the outside world without a wire or modem hook-up for decades, the technology for mobile computing has grown in leaps and bounds only in the past few years. At MITRE, the Advanced Computer Information Systems division has been experimenting with a wireless computing capability that will allow employees to move throughout the corporation—to collaborate with other employees, for example—without having to plug their computer into the network everywhere they go. In addition, the company is experimenting with providing access to advanced PDAs (personal digital assistants), which will provide entry to e-mail without using Netscape or a secure ID card.

But, mobile computing is moving far beyond cell phones and even next-generation PDAs. Today, mobile display units are small enough and light enough to feel weightless in a pocket, on a hip, or even on your head. Under a MITRE sponsored research (MSR) effort, the company is examining and analyzing the usefulness of consumer off-the-shelf wearable display products in order to project future uses of these systems. This kind of MSR better positions MITRE to help customers make smart research and development investment decisions," explains Dave Lehman, vice president of the Center for Information and Technology. We're fulfilling our mission when our research activities provide guidance and leadership in determining how to develop a technology along a certain path—and identify limitations so commercial developers can fine-tune systems before large-scale investment is made. Also, when our staff has experience and hands-on familiarity with a technology like this, we can provide expertise when a future acquisition program includes wearables in its requirements."

In particular, the MSR team is evaluating the well-regarded Xybernaut computer. The system, which runs on Windows, is strapped onto the hip and includes a tiny screen that is worn over one eye. It provides information while you're walking around," says Dr. Mike Wingfield, lead software systems engineer, Air Force Center's Decision Support, Visualization, and Human Computer Interaction, and a member of the wearable display MSR team. With this kind of unit, you can be in the world and be augmented with computer information via a small screen."

Eyes Front, Shoulders Back Cadets focus on what the naked eye can't see MITRE has been very involved in not only the technology of wearable displays, but also the multitude of human factors that need to be evaluated when considering future utility. Last year, MITRE invited West Point freshmen cadets to participate in a heads-up, heads-down wearable system test. 'They walked around MITRE, and information flashed on their near-to-eye display screen," says Mike Wingfield. 'Overall, they found it hard to walk around in the world and operate the computer, too." But, it won't be long before doctors, firefighters, soldiers, and air traffic controllers consider wearables an essential part of their regular attire. Why? 'Wearable computer displays are getting more sophisticated every day," notes Wingfield. 'MITRE and many other organizations are looking at ways to make them work compatibly in the real world and the cyberworld. It won't be long now."

We're just beginning to take advantage of capabilities that personalize and filter information in the world, so they can provide only the necessary information to perform tasks that currently require support and resources from others. This convergence between computing and communications has enabled significant advances in mobile and wearable computing," he adds. These display units used to weigh 10 pounds. Who wants to put something like that on their head? Now, they're as light as eyeglasses and very powerful."

At the same time, there are huge challenges that MITRE and others are tackling. The design of an interface that is useful and not disruptive to other tasks—such as seeing, walking, talking, and thinking—is more than just a small hurdle," notes Wingfield. Human factors play an enormous role here."

As part of its research, MITRE is identifying and examining challenges such as understanding which way the user is looking when using a wearable, also known as eye tracking. "You can look at a lot of different things without ever moving your head," says Wingfield. 'How does the computer know what you're looking at at any moment in time? How do you put overlays on buildings (or enemy targets) and not confuse the user? These are tricky technical questions."

'Smart wearable displays will not just present information to users, but will figure out what they're looking at and know where the user's eyes are focused," adds Rob Tarakan, principal software systems engineer and project team leader, Center for Advanced Aviation System Development's Infrastructure and Adaptation department. Mixing people and computers is difficult. If the wearable display makes it more difficult for a user to understand and digest data, then it's not helpful. We want to make sure these systems are useful and functional from all perspectives."

Columbia University and the University of North Carolina have been doing research in this area, and MITRE is building on that work. The company's efforts include evaluating and analyzing wearable computers and displays for both military and aviation applications.

It's a bird, it's a plane!

In the world of aviation and wearable technology, the sky's the limit. The future applications of display technology could include air traffic control in which augmented reality technology could increase runway situational awareness to improve the safety and management of ground traffic. Also, near-to-eye display technology might provide the hardware elements for such a screen, which must be accurately registered with the controller's view of the actual aircraft on the runway and its surroundings. In this fashion, a controller could monitor and flawlessly direct aircraft and ground vehicles to avoid conflicts.

'Wearable displays might be a great addition to the tools already being used by controllers," says Tarakan. When you think about controllers in a tower, you know they see the tangible air traffic environment. Wearable display systems could help synthesize and integrate relevant abstract information to augment the controllers view of the physical world."

'Of course, we have to remember there's a person in the center of things," he adds. Wearable systems are a tool—with an ability to help solve problems like other computers. For instance, users can see the real world, but a wearable display adds more information—information that might make a difference in getting the job done."

—By Nadine Monaco

Solutions That Make a Difference.®
Copyright © 1997-2013, The MITRE Corporation. All rights reserved.
MITRE is a registered trademark of The MITRE Corporation.
Material on this site may be copied and distributed with permission only.

Privacy Policy | Contact Us