Live-Action Simulations Test Ideas, Save Time and MoneyDecember 2017
Topics: Joint Operations, Command and Control
In the Decision Theater, MITRE personnel experiment with various presentation styles in preparation for a SIMEX. The rails in the ceiling allow the nine stacks of displays at the front to move forward and backward to change operational scenarios.
Imagine you're a Navy officer who needs to see if a new joint mission capability involving underwater drones is feasible. Or a civil-agency manager who wants to test out new communications processes for first responders. How do you assess complicated ideas quickly without spending a fortune?
If you're that Navy officer, will your machine-to-machine communication conflict with the need for human decision-making? And if you’re using new processes and devices, will interoperability between joint commands be an issue? If you’re a civil agency manager, will your communications connect your cooperating agencies without delay or misunderstandings?
One way to find out is with a MITRE SIMEXTM session. SIMEX is a contraction for "simulation experiment." It offers a special mix of technical and operational capabilities for government agencies that want to try out new ideas by using dedicated, state-of-the-art laboratories.
A SIMEX allows mission personnel to develop concepts of operations, or CONOPS, in a realistic, controlled synthetic environment at MITRE facilities in McLean, Virginia. Operators practice techniques and procedures using the latest technology. SIMEXs use real command-and-control systems with simulated weapons and sensors so military and civilian operators can execute the various crisis scenarios.
Save Time, Keep Costs Down
SIMEXs allow agencies to wring out a proof-of-concept faster and at lower cost than a full-blown in-the-field exercise. For example, in a recent classified SIMEX, the sponsor noted: "In three experimental runs, operators made real-time decisions for weapon assignment, engagement timing, and movements. The interaction of live operators, with high-fidelity engagement simulation, enabled weapon tactics to evolve rapidly and iteratively over the course of the SIMEX."
In another classified experiment, representatives from different military organizations worked with personnel sitting in multiple locations. The SIMEX addressed 36 different scenarios related to an advanced weapon system. Participants gained new insights into operations and identified areas for improvement in their current systems. The event reduced overall costs and avoided hundreds of unnecessary staff hours. The activity also set the stage for a live demonstration—all before burning a single gallon of fuel.
"SIMEXs provide quantitative analysis while still allowing for innovation and serendipity," says Jim Dear, who manages and coordinates all the SIMEX laboratory experiments. Dear has been involved with nearly 60 SIMEXs since they began in 2001. He's overseen experiments on important topics ranging from joint surface warfare, bio-security, and maritime domain awareness, to special operations, missile defense, irregular warfare, and more.
Many of them are classified, but MITRE also conducts unclassified SIMEXs for agencies such as the Census Bureau, Border Patrol, Homeland Security, and IRS. For example, a few years ago, MITRE worked with national law enforcement agencies and Virginia state agencies to conduct a SIMEX to demonstrate how social media could help or hinder response times during a crisis.
Two Exceptional Labs: NSEL and SEAL
The events typically occur in two MITRE labs, both in McLean, Virginia. The first lab is the National Security Experimentation Laboratory, or NSEL, which is sponsored by the Office of the Secretary of Defense. Created in 2001, it’s the computational workhorse for a SIMEX. Mission managers can connect to several government and contractor facilities to run experiments that are service-specific, or joint in operation.
NSEL uses real command-and-control systems with simulated weapons and sensors. Military and civilian personnel can execute crisis action scenarios to improve their planning and reaction times. To test interoperability in a distributed environment, the NSEL uses a variety of secure networks.
The newest Simulation, Experimentation and Analysis Lab, or SEAL, opened in early 2017. The SEAL supports analysis, experimentation, testing, training, and mission rehearsal for classified and unclassified operations. It puts sponsors (friendly Blue Cell operators) in a visual environment that shows how their new mission capabilities will work against opposing forces (Red Cell operators). Huge, high-definition monitors can be moved to change the look of command centers for the Blue Cell. Observers can see a SIMEX in action without disturbing operators in either the Blue Cell or the Red Cell. (See "The SEAL—Where the Action Is," below.)
To assure a consistent quality outcome for every SIMEX, Dear picks the MITRE team members himself. He chooses members from MITRE’s seven research and development centers to acquire the ideal mix of skills. Required experience can range from operations research to software development, from 3D gaming to systems integration. "I have the flexibility to bring in a lot of unique talent," he says.
From Scenario Planning to Post-Event Analysis
"The whole SIMEX process from planning to final report is normally five to six months," Dear says. "First, MITRE staff work with our sponsors to design the simulation infrastructure. During the integration and testing process, our data collection team leader builds the Data Collection and Analysis Plan that defines essential data collection to support the SIMEX objectives."
The SIMEX itself takes place over two weeks. The first week includes operator training on the new SIMEX CONOPS and technology. The second week includes 8 to 10 three-hour scenarios when mission operators execute the SIMEX. MITRE staff capture participants’ observations and experiences for reference. These can be used to develop strategy, tactics, and related technologies.
In parallel, the NSEL data collection team executes the Data Collection and Analysis Plan and produces incremental After-Action Reviews. Post-SIMEX analysis captures lessons learned, operator feedback, and data driven measures of effectiveness. This gives program managers, science and technology directors, and warfighters, the information to make informed decisions. About a month after the SIMEX, the data collection team produces a briefing and final report on the SIMEX results, using the agreed-upon data collection plan. Augmenting the written reports for every SIMEX are 8-10-minute video highlight reels depicting the crucial moments during SIMEX execution.
"Each SIMEX is custom-designed to test a new mission capability to its maximum," Dear says. "As new technology rapidly comes along, there’s a good chance of interoperability problems, or man-machine interface issues. Every SIMEX teaches our sponsors and us something new. We have a great combination of capabilities that allow our sponsors to simulate any situation."
—by David Van Cleave
If you work for a government agency and want to learn how a SIMEX can support your military or civilian missions, contact MITRE at firstname.lastname@example.org.