ICArUS: Phase 2 Challenge Problem Design and Test Specification

December 2014
Topics: Neurosciences, Modeling and Simulation, Cognitive Systems Engineering
Kevin Burns, The MITRE Corporation
Download PDF (571.34 KB)

​Phase 2 of the IARPA program ICArUS (Integrated Cognitive-neuroscience Architectures for Understanding Sensemaking) requires a research problem that poses cognitive challenges of spatial-temporal sensemaking (BAA, 2010). The problem serves as a challenge for performers who are building integrated cognitive-neuroscience models, and as a tool for obtaining data from human experiments. This document describes the challenge problem, and outlines the T&E (Test & Evaluation) approach for evaluating models in Comparative Performance Assessment and Cognitive Fidelity Assessment (BAA, 2010). Normative (Bayesian) solutions to the challenge problem are derived, as needed to support the assessment of human and model performance. Opportunities are also identified for transition of the challenge problem design and results to the geospatial Intelligence Community.

Note: This document was originally prepared and delivered to IARPA in March, 2014, in order to support ICArUS Phase 2 T&E efforts that concluded in June, 2014.


Interested in MITRE's Work?

MITRE provides affordable, effective solutions that help the government meet its most complex challenges.
Explore Job Openings

Publication Search