RECORD
Testing Simulation Models Using Frequentist Statistics
- Title:
- Testing Simulation Models Using Frequentist Statistics
- Creator:
- Robinson, Andrew P.
- Date Created:
- 2019-04-10
- Description:
- One approach to validating simulation models is to formally compare model outputs with independent data. We consider such model validation from the point of view of Frequentist statistics. A range of estimates and tests of goodness of fit have been advanced. We review these approaches, and demonstrate that some of the tests suffer from difficulties in interpretation because they rely on the null hypothesis that the model is similar to the observations. This reliance creates two unpleasant possibilities, namely, a model could be spuriously validated when data are too few, or inappropriately rejected when data are too many. Finally, these tests do not allow a principled declaration of what a reasonable level of difference would be considering the purposes to which the model will be put. We consider equivalence tests, and demonstrate that they do not suffer from the previously identified shortcomings. We provide two case studies to illustrate the claims of the chapter.
- Document Type:
- Research Article
- Subjects:
- UIEF statistical modeling data statistics
- Location:
- UIEF
- Latitude:
- 46.869607
- Longitude:
- -116.733856
- Publisher:
- Springer Link
- Department:
- Forest, Rangeland, and Fire Sciences
- Type:
- Text
Source
- Preferred Citation:
- "Testing Simulation Models Using Frequentist Statistics", UIEF Research Exchange, University of Idaho Library Digital Collections, https://www.lib.uidaho.edu/digital/uief/items/uief_0266.html
Rights
- Rights:
- In copyright, educational use permitted.
- Standardized Rights:
- http://rightsstatements.org/vocab/InC-EDU/1.0/