Index Storage Definition

An index storage is a sequence of integers X1...XN, where N is the number of tokens in the corpus. Each Xi points to an indexed string, for example for the token index it points to a token. The order of X1...XN is just the same as it was in the input corpus. For example using Token index storage DDC can reproduce the whole corpus word by word. By default the first index of the corpus has an index storage, for the other indices this option is switched off (see CIndexSetForLoadingStage::m_bUseItemStorage).