The shortcoming of a test is the difference between the maximal attainable power and the power of the test under consideration. Vanishing shortcoming, when the number of observations tends to infinity, is therefore an optimality property of a test. Other familiar optimality criteria are based on the asymptotic relative efficiency of the test. The relations between these optimality criteria are investigated. It turns out that vanishing shortcoming is seemingly slightly stronger than first-order efficiency, but in regular cases there is equivalence. The results are in particular applied on tests for goodness-of-fit.
- Pitman efficiency
- intermediate or Kallenberg efficiency
- Bahadur efficiency
- Anderson–Darling test
- Cramér–von Mises test