Journal of Data and Information Science ›› 2018, Vol. 3 ›› Issue (2): 20-37.doi: 10.2478/jdis-2018-0007

• Research Paper • Previous Articles     Next Articles

CitationAS: A Tool of Automatic Survey Generation Based on Citation Content*

Jie Wang1,3, Chengzhi Zhang2(), Mengying Zhang1,3, Sanhong Deng1,3   

  1. 1School of Information Management, Nanjing University, Nanjing 210023, China
    2Department of Information Management, Nanjing University of Science and Technology, Nanjing 210094, China
    3Jiangsu Key Laboratory of Data Engineering and Knowledge Service, Nanjing University, Nanjing 210023, China
  • Online:2018-06-13 Published:2018-06-14

Abstract:

Purpose: This study aims to build an automatic survey generation tool, named CitationAS, based on citation content as represented by the set of citing sentences in the original articles.Design/methodology/approach: Firstly, we apply LDA to analyse topic distribution of citation content. Secondly, in CitationAS, we use bisecting K-means, Lingo and STC to cluster retrieved citation content. Then Word2Vec, WordNet and combination of them are applied to generate cluster labels. Next, we employ TF-IDF, MMR, as well as considering sentence location information, to extract important sentences, which are used to generate surveys. Finally, we adopt manual evaluation for the generated surveys.Findings: In experiments, we choose 20 high-frequency phrases as search terms. Results show that Lingo-Word2Vec, STC-WordNet and bisecting K-means-Word2Vec have better clustering effects. In 5 points evaluation system, survey quality scores obtained by designing methods are close to 3, indicating surveys are within acceptable limits. When considering sentence location information, survey quality will be improved. Combination of Lingo, Word2Vec, TF-IDF or MMR can acquire higher survey quality.Research limitations: The manual evaluation method may have a certain subjectivity. We use a simple linear function to combine Word2Vec and WordNet that may not bring out their strengths. The generated surveys may not contain some newly created knowledge of some articles which may concentrate on sentences with no citing.Practical implications: CitationAS tool can automatically generate a comprehensive, detailed and accurate survey according to user’s search terms. It can also help researchers learn about research status in a certain field.Originality/value: CitaitonAS tool is of practicability. It merges cluster labels from semantic level to improve clustering results. The tool also considers sentence location information when calculating sentence score by TF-IDF and MMR.

Key words: Automatic survey system, Citation content, Clustering algorithms, Label generation approaches, Sentence extraction methods