Portal de Periódicos da CAPES

Topic Modeling Techniques for Text Mining Over a Large-Scale Scientific and Biomedical Text Corpus

2022; IGI Global; Volume: 13; Issue: 1 Linguagem: Inglês

10.4018/ijaci.293137

1941-6245

Sandhya Avasthi, Ritu Chauhan, D. P. Acharjya,

Computational and Text Analysis Methods

Topic models are efficient in extracting central themes from large-scale document collection and it is an active research area. The state-of-the-art techniques like Latent Dirichlet Allocation, Correlated Topic Model (CTM), Hierarchical Dirichlet Process (HDP), Dirichlet Multinomial Regression (DMR) and Hierarchical Pachinko Allocation (HPA) model is considered for comparison. . The abstracts of articles were collected between different periods from PUBMED library by keywords adolescence substance use and depression. A lot of research has happened in this area and thousands of articles are available on PubMed in this area. This collection is huge and so extracting information is very time-consuming. To fit the topic models this extracted text data is used and fitted models were evaluated using both likelihood and non-likelihood measures. The topic models are compared using the evaluation parameters like log-likelihood and perplexity. To evaluate the quality of topics topic coherence measures has been used.