CIndexSetForBigrams Class Reference

#include <ConcBigrams.h>

Inheritance diagram for CIndexSetForBigrams:

Collaboration diagram for CIndexSetForBigrams:

List of all members.

Public Member Functions

• CIndexSetForBigrams (const CStringIndexator *pParent)

  the temp index(used only for bigrams)
  

• virtual ~CIndexSetForBigrams ()
• string GetName () const

  return the name of the index (CStringIndexSet::m_Name)
  

• bool DestroyIndexSet ()

  destroy index set and remove index files
  

• bool LoadIndexSet ()
• bool ConvertTempBigramsToPersistent (string TempBigramsFileName, const vector< CIndexItem > &MainTokenIndex)

  convert temporary left bigrams file to persistent (left and right)
  

• void FindOccurrencesForBigrams (const BigramDirectionEnum bigr_direc, const vector< DWORD > &IndexItems, const size_t PeriodNo, vector< pair< CTokenNo, DWORD > > &occurrences, CShortOccurCacheMap *pCaches, vector< int > &CacheIds) const

  the same as FindOccurrences, but save the idx of token to the second part of the occurrences's items
  

• void ReadAllOccurrences (size_t IndexItemNo, const CSecondWord &I, vector< CTokenNo > &Occurs) const

  read all occurrences of IndexItemN
  

Public Attributes

• CIndexBigram m_LeftBigrams
• CIndexBigram m_RightBigrams

Private Member Functions

• void WriteBigramAndItsOccurs (CSecondWord &I, const DWORD BigramId, CItemIndexForLoading &M, FILE *res_fp, size_t &CurrPositionInResFile, FILE *second_word_fp)
• bool CreateRightBigrams (string TempRightBigramsFileName)
• string GetRightToLeftPerdiv () const

Private Attributes

• map< DWORD, DWORD > m_RightToLeftPerdivIds

---

Constructor & Destructor Documentation

CIndexSetForBigrams::CIndexSetForBigrams

(

const CStringIndexator *

pParent

)

the temp index(used only for bigrams)

References CIndexSetForQueryingStage::m_bCompressOccurrences.

CIndexSetForBigrams::~CIndexSetForBigrams

(

)

[virtual]

---

Member Function Documentation

void CIndexSetForBigrams::WriteBigramAndItsOccurs	(	CSecondWord &	I,
		const DWORD	BigramId,
		CItemIndexForLoading &	M,
		FILE *	res_fp,
		size_t &	CurrPositionInResFile,
		FILE *	second_word_fp
	)			[private]

References BinaryWriteItem(), CIndexSetForQueryingStage::BuildPeriodsDivisionAndCompress(), CItemIndexForLoading::ClearOccurrences(), CItemIndexForLoading::GetOccurs(), CItemIndexForLoading::GetOccursSize(), CSecondWord::m_EndOccurOffset, CSecondWord::m_StartOccur, CSecondWord::m_TheOnlyOccur, and CItemIndexForLoading::WriteOccurrences().

Referenced by ConvertTempBigramsToPersistent().

Here is the call graph for this function:

Here is the caller graph for this function:

bool CIndexSetForBigrams::CreateRightBigrams

(

string

TempRightBigramsFileName

)

[private]

References BinaryReadItem(), BinaryWriteItem(), FileSize(), CIndexBigram::GetFirstWordFileName(), GetRightToLeftPerdiv(), CIndexBigram::GetSecondWordFileName(), CIndexSetForQueryingStage::m_EndPeriodOffsets, CIndexBigram::m_FirstWords, CTempBigram2::m_LeftBigramOffset, CTempBigram2::m_LeftTokenId, m_RightBigrams, CTempBigram2::m_SecondWord, CExpc::m_strCause, RemoveWithPrint(), and WriteVector().

Referenced by ConvertTempBigramsToPersistent().

Here is the call graph for this function:

Here is the caller graph for this function:

string CIndexSetForBigrams::GetRightToLeftPerdiv

(

)

const [private]

References CStringIndexator::m_Path, CIndexSetForQueryingStage::m_pParent, and MakeFName().

Referenced by CreateRightBigrams(), DestroyIndexSet(), and LoadIndexSet().

Here is the call graph for this function:

Here is the caller graph for this function:

string CIndexSetForBigrams::GetName

(

)

const [virtual]

return the name of the index (CStringIndexSet::m_Name)

Implements CIndexSetForQueryingStage.

bool CIndexSetForBigrams::DestroyIndexSet

(

)

destroy index set and remove index files

Reimplemented from CIndexSetForQueryingStage.

References CIndexSetForQueryingStage::DestroyIndexSet(), GetRightToLeftPerdiv(), m_LeftBigrams, m_RightBigrams, CIndexBigram::RemoveFiles(), and RemoveWithPrint().

Referenced by CStringIndexSet::DestroyIndexSet().

Here is the call graph for this function:

Here is the caller graph for this function:

bool CIndexSetForBigrams::LoadIndexSet

(

)

References FileExists(), GetRightToLeftPerdiv(), CIndexBigram::LoadBigrams(), m_LeftBigrams, m_RightBigrams, m_RightToLeftPerdivIds, and ReadVector().

Referenced by CStringIndexSet::ReadFromTheDisk(), and CStringIndexSet::WriteToFile().

Here is the call graph for this function:

Here is the caller graph for this function:

bool CIndexSetForBigrams::ConvertTempBigramsToPersistent	(	string	TempBigramsFileName,
		const vector< CIndexItem > &	MainTokenIndex
	)

convert temporary left bigrams file to persistent (left and right)

References BinaryReadItem(), BinaryWriteItem(), ConvertBufferOffsetToTokenId(), CreateRightBigrams(), CreateTempFileName(), FileSize(), CIndexBigram::GetFirstWordFileName(), CIndexSetForQueryingStage::GetOccursFileName(), CIndexBigram::GetSecondWordFileName(), CTempBigram::InitUnknown(), CTempBigram::LessWithoutAddress(), CTempBigram::m_Distance, CIndexBigram::m_FirstWords, CTempBigram2::m_LeftBigramOffset, m_LeftBigrams, CTempBigram2::m_LeftTokenId, CTempBigram::m_LeftTokenId, CTempBigram::m_RightTokenCorpusAddress, CTempBigram::m_RightTokenId, CTempBigram2::m_SecondWord, CExpc::m_strCause, WriteBigramAndItsOccurs(), CIndexSetForQueryingStage::WritePeriodsDivision(), and WriteVector().

Referenced by CStringIndexSet::WriteToFile().

Here is the call graph for this function:

Here is the caller graph for this function:

void CIndexSetForBigrams::FindOccurrencesForBigrams	(	const BigramDirectionEnum	bigr_direc,
		const vector< DWORD > &	IndexItems,
		const size_t	PeriodNo,
		vector< pair< CTokenNo, DWORD > > &	occurrences,
		CShortOccurCacheMap *	pCaches,
		vector< int > &	CacheIds
	)			const

the same as FindOccurrences, but save the idx of token to the second part of the occurrences's items

References CIndexSetForQueryingStage::AddOccurs(), bdRightBigram, CSecondWord::m_Distance, CSecondWord::m_EndOccurOffset, CSecondWord::m_EndOfSentenceFlag, m_LeftBigrams, m_RightBigrams, m_RightToLeftPerdivIds, CSecondWord::m_SecondWordId, CSecondWord::m_StartOccur, CSecondWord::m_TheOnlyOccur, and CIndexBigram::ReadSecondWords().

Referenced by CQueryTokenNode::EvaluateWithoutHits().

Here is the call graph for this function:

Here is the caller graph for this function:

void CIndexSetForBigrams::ReadAllOccurrences	(	size_t	IndexItemNo,
		const CSecondWord &	I,
		vector< CTokenNo > &	Occurs
	)			const

read all occurrences of IndexItemN

References CIndexSetForQueryingStage::AddOccurs(), CStringIndexator::GetSearchPeriodsCount(), CSecondWord::m_EndOccurOffset, CIndexSetForQueryingStage::m_pParent, CSecondWord::m_StartOccur, and CSecondWord::m_TheOnlyOccur.

Referenced by CStringIndexSet::DumpBigramsOfOneDirection().

Here is the call graph for this function:

Here is the caller graph for this function:

---

Member Data Documentation

map<DWORD, DWORD> CIndexSetForBigrams::m_RightToLeftPerdivIds [private]

Referenced by FindOccurrencesForBigrams(), and LoadIndexSet().

CIndexBigram CIndexSetForBigrams::m_LeftBigrams

Referenced by ConvertTempBigramsToPersistent(), DestroyIndexSet(), CStringIndexSet::DumpBigramsOfOneDirection(), FindOccurrencesForBigrams(), and LoadIndexSet().

CIndexBigram CIndexSetForBigrams::m_RightBigrams

Referenced by CreateRightBigrams(), DestroyIndexSet(), CStringIndexSet::DumpBigramsOfOneDirection(), FindOccurrencesForBigrams(), and LoadIndexSet().

---

The documentation for this class was generated from the following files:

• ConcBigrams.h
• ConcBigrams.cpp