We have already pointed out in section
the
serious caveat with regard to low number of exceedence events when focusing
on the
confidence levels. We again emphasize that while
it is legitimate that any regulatory authority should be looking at these
high levels for the evaluation of risk on a day to day
basis once a model is accepted - the
criteria of accepting this model should be based on performance of the model over
an entire range of extreme levels starting from say the
level.
Figure 3m provides an example of this problem. In figure 3m we have only
plotted data when there is at least one exceedence event beyond a certain
confidence level (contributed by at least one of the two portfolios over
which the measurement is averaged). Thus at the
level the absence of any entry in figure 3m indicates that none of
the models admit a single event of consecutive exceedences over a
1000 day out-of-sample period. It is only when viewing the approach
to the
level that we can pick out the relative performance of the
models and the consistent superiority of model 5.