Topic-based vector space model

The Topic-based Vector Space Model (TVSM)[1] (literature: [1]) extends the vector space model of information retrieval by removing the constraint that the term-vectors be orthogonal. The assumption of orthogonal terms is incorrect regarding natural languages which causes problems with synonyms and strong related terms. This facilitates the use of stopword lists, stemming and thesaurus in TVSM. In contrast to the generalized vector space model the TVSM does not depend on concurrence-based similarities between terms.

Definitions

The basic premise of TVSM is the existence of a d dimensional space R with only positive axis intercepts, i.e. R in R+ and d in N+. Each dimension of R represents a fundamental topic. A term vector t has a specific weight for a certain R. To calculate these weights assumptions are made taking into account the document contents. Ideally important terms will have a high weight and stopwords and irrelevants terms to the topic will have a low weight. The TVSM document model is obtained as a sum of term vectors representing terms in the document. The similarity between two documents Di and Dj is defined as the scalar product of document vectors.

Enhanced Topic-based Vector Space Model

The enhancement of the Enhanced Topic-based Vector Space Model (eTVSM)[2] (literature: [2]) is a proposal on how to derive term vectors from an Ontology. Using a synonym Ontology created from WordNet Kuropka shows good results for document similarity. If a trivial Ontology is used the results are similar to Vector Space model.

Implementations

References

  1. ^ Dominik Kuropka; Jörg Becker (2003), Topic-based Vector Space Model (PDF)
  2. ^ Dominik Kuropka; Artem Polyvyanyy (2007), A Quantitative Evaluation of the Enhanced Topic-Based Vector Space Model (PDF)

Content Disclaimer

Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.

  1. The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
  2. There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
  3. It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
  4. Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
  5. Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.