MITRE SIMEX™ Live-Action Simulations Test Ideas, Save MoneyDecember 2017
Topics: Joint Operations, Command and Control, Modeling and Simulation, Government Agency Operations, Military Operations (General)
In the Decision Theater, MITRE personnel experiment with various presentation styles in preparation for a MITRE SIMEX. The rails in the ceiling allow the nine stacks of displays at the front to move forward and backward to change operational scenarios.
Imagine you're a Navy officer who needs to see if a new joint mission capability involving underwater drones is feasible. Or a civil-agency manager who wants to test out new communications processes for first responders. How do you assess complicated ideas quickly without spending a fortune?
If you're that Navy officer, will your machine-to-machine communication conflict with the need for human decision-making? And if you’re using new processes and devices, will interoperability between joint commands be an issue? If you’re a civil agency manager, will your communications connect your cooperating agencies without delay or misunderstandings?
One way to find out is with a MITRE SIMEX session, a simulation that offers a special mix of technical and operational capabilities for government agencies that want to try out new ideas by using dedicated, state-of-the-art laboratories.
A MITRE SIMEX allows mission personnel to develop concepts of operations, or CONOPS, in a realistic, controlled synthetic environment at our facilities in McLean, Virginia. Operators practice techniques and procedures using the latest technology. A MITRE SIMEX session uses real command-and-control systems with simulated weapons and sensors so military and civilian operators can execute the various crisis scenarios. UPDATE: Learn more about how a SIMEX conducted in spring 2018 is helping the U.S. Army develop better electronic warfare prototypes and operational capabilities.
Save Time, Keep Costs Down
A MITRE SIMEX allows agencies to wring out a proof-of-concept faster and at lower cost than a full-blown in-the-field exercise. For example, in a recent classified session, the sponsor noted: "In three experimental runs, operators made real-time decisions for weapon assignment, engagement timing, and movements. The interaction of live operators, with high-fidelity engagement simulation, enabled weapon tactics to evolve rapidly and iteratively over the course of the session."
In another classified experiment, representatives from different military organizations worked with personnel sitting in multiple locations. The MITRE SIMEX addressed 36 different scenarios related to an advanced weapon system. Participants gained new insights into operations and identified areas for improvement in their current systems. The event reduced overall costs and avoided hundreds of unnecessary staff hours. The activity also set the stage for a live demonstration—all before burning a single gallon of fuel.
"A MITRE SIMEX provides quantitative analysis while still allowing for innovation and serendipity," says Jim Dear, who manages and coordinates all the MITRE SIMEX laboratory experiments. Dear has been involved with nearly 60 sessions since they began in 2001. He's overseen experiments on important topics ranging from joint surface warfare, bio-security, and maritime domain awareness, to special operations, missile defense, irregular warfare, and more.
Many of them are classified, but MITRE also conducts unclassified simulations for agencies such as the Census Bureau, Border Patrol, Homeland Security, and IRS. For example, a few years ago, MITRE worked with national law enforcement agencies and Virginia state agencies to conduct a MITRE SIMEX to demonstrate how social media could help or hinder response times during a crisis.
Two Exceptional Labs: NSEL and SEAL
The events typically occur in two MITRE labs, both in McLean, Virginia. The first lab is the National Security Experimentation Laboratory, or NSEL, which is sponsored by the Office of the Secretary of Defense. Created in 2001, it’s the computational workhorse for a MITRE SIMEX. Mission managers can connect to several government and contractor facilities to run experiments that are service-specific, or joint in operation.
NSEL uses real command-and-control systems with simulated weapons and sensors. Military and civilian personnel can execute crisis action scenarios to improve their planning and reaction times. To test interoperability in a distributed environment, the NSEL uses a variety of secure networks.
The newest Simulation, Experimentation and Analysis Lab, or SEAL, opened in early 2017. The SEAL supports analysis, experimentation, testing, training, and mission rehearsal for classified and unclassified operations. It puts sponsors (friendly Blue Cell operators) in a visual environment that shows how their new mission capabilities will work against opposing forces (Red Cell operators). Huge, high-definition monitors can be moved to change the look of command centers for the Blue Cell. Observers can see a MITRE SIMEX in action without disturbing operators in either the Blue Cell or the Red Cell. (See "The SEAL—Where the Action Is," below.)
To assure a consistent quality outcome for every MITRE SIMEX, Dear picks the MITRE team members himself. He chooses members from our seven research and development centers to acquire the ideal mix of skills. Required experience can range from operations research to software development, from 3D gaming to systems integration. "I have the flexibility to bring in a lot of unique talent," he says.
From Scenario Planning to Post-Event Analysis
"The whole MITRE SIMEX process from planning to final report is normally five to six months," Dear says. "First, MITRE staff work with our sponsors to design the simulation infrastructure. During the integration and testing process, our data collection team leader builds the Data Collection and Analysis Plan that defines essential data collection to support the exercise's objectives."
The MITRE SIMEX itself takes place over two weeks. The first week includes operator training on the new MITRE SIMEX CONOPS and technology. The second week includes 8 to 10 three-hour scenarios when mission operators execute the session. MITRE staff capture participants’ observations and experiences for reference. These can be used to develop strategy, tactics, and related technologies.
In parallel, the NSEL data collection team executes the Data Collection and Analysis Plan and produces incremental After-Action Reviews. Post-session analysis captures lessons learned, operator feedback, and data driven measures of effectiveness. This gives program managers, science and technology directors, and warfighters, the information to make informed decisions. About a month after the event, the data collection team produces a briefing and final report on the MITRE SIMEX results, using the agreed-upon data collection plan. Augmenting the written reports for every MITRE SIMEX are 8-10-minute video highlight reels depicting the crucial moments during the plan's execution.
"Each MITRE SIMEX is custom-designed to test a new mission capability to its maximum," Dear says. "As new technology rapidly comes along, there’s a good chance of interoperability problems, or man-machine interface issues. Every simulation teaches our sponsors and us something new. We have a great combination of capabilities that allow our sponsors to simulate any situation."
—by David Van Cleave