Identifying unexpected behaviors of agent-based models through spatial plots and heat maps
Published in Complex Adaptive Systems: Views from the Physical, Natural, and Social Sciences, 2019
Verification and validation (V&V) techniques commonly require modelers to collect and statistically analyze large amounts of data which require specific methods for ordering, filtering, or converting data points. Modelers need simple, intuitive, and efficient techniques for gaining insight into unexpected behaviors to help in determining if these behaviors are errors or if they are artifacts resulting from the model’s specifications. We present an approach to begin addressing this need by applying heat maps and spatial plots to visually observe unexpected behaviors within agent-based models. Our approach requires the modeler to specify hypotheses about expected model behavior. Agent level outputs of interest are then used to create graphical displays to visually test the hypotheses.
Recommended citation: Lynch, Christopher J; Kavak, Hamdi; Gore, Ross; Vernon-Bido, Daniele. (2019). "Identifying unexpected behaviors of agent-based models through spatial plots and heat maps". Complex Adaptive Systems: Views from the Physical, Natural, and Social Sciences. 129-142.
Download Paper