원문정보
보안공학연구지원센터(IJSEIA)
International Journal of Software Engineering and Its Applications
Vol.9 No.3
2015.03
pp.175-182
피인용수 : 0건 (자료제공 : 네이버학술정보)
초록
영어
Network technology has been in the process of development with IT. Data on the network is increasing rapidly and there are also various data searching methods. One of these methods is a crawler. It finds data that users want and collects it. However, as data on the network increases exponentially, potential problems of the crawler are constantly emerging. This paper investigates that crawlers can operate in one system, decentralizing a crawler’s main functions. By using/implementing a proposed system, the efficiency is compared, analyzed and verified with the existing problems.
목차
Abstract
1. Introduction
2. Related Researches
2.1. General Crawler and Focused Crawler
2.2. Topical Crawler
2.3. Wrapper-based Crawler
2.4. Crawler4j
3. Distributed Crawling System Design and Implementation
3.1. Distributed Crawling System Design
3.2. Distributed Crawling System
3.3. System Experiment
4. Conclusion
References
1. Introduction
2. Related Researches
2.1. General Crawler and Focused Crawler
2.2. Topical Crawler
2.3. Wrapper-based Crawler
2.4. Crawler4j
3. Distributed Crawling System Design and Implementation
3.1. Distributed Crawling System Design
3.2. Distributed Crawling System
3.3. System Experiment
4. Conclusion
References
저자정보
참고문헌
자료제공 : 네이버학술정보