earticle

논문검색

An Algorithm on Web Article Automatic Extraction Based on DOM Structure

초록

영어

By analyzing a large number of web pages, we proposed a page segment algorithm which is based on DOM tree structural features and visual features. The algorithm segments the pages to the small particles. It produces basic processing units for recognition algorithms. After segmenting the pages, we extracted the structural and visual features of the pages, and proposed a method to identify the body of the web article. The method uses clustering algorithm and heuristic rules to produce an automatic wrapper. A testing experiment demonstrated the efficacy of the algorithm.

목차

Abstract
 1. Introduction
 2. Related Knowledge of Web Article Page Block and Information Extraction
  2.1. Web article Model
  2.2. Visual Feature
  2.3. The Structure Characteristics of DOM Tree
  2.4. Page Block Algorithm from Bottom to Top
 3. The Body Identification Method of the Web Article
  3.1. Review Stage
  3.2. Design for Identifying of Web Text
  3.3. Text Extraction of Web Article
 4. Experimental Results and Analysis
 5. Conclusion
 Acknowledgments
 References

저자정보

  • Weiguo Shen School of mechanical Engineering, Tianjin Polytechnic University, Tianjin, 300387, China
  • Xiaojian Zou Military Transportation University, Tianjin,300160, China

참고문헌

자료제공 : 네이버학술정보

    함께 이용한 논문

      ※ 원문제공기관과의 협약기간이 종료되어 열람이 제한될 수 있습니다.

      0개의 논문이 장바구니에 담겼습니다.