earticle

영어

Recently, as a sensor technology for detecting sensor data such as a temperature sensor, a humidity sensor and an optical sensor has rapidly developed, big data technology is rapidly developing in various fields such as industry, military, medical, and weather. Big data processing consists of five steps: Aggregator, Storage, Processing, Analysis, and Visualization, and processes large amounts of large data. It looks like a simple process, but it requires advanced core skills to drive the flow of large amounts of data. In this paper, we construct a distributed system for data collection and processing in order to conduct an effective big data analysis on a huge amount of sensing data generated in a sensor network. In order to reduce the unnecessary analysis of the data generated by the sensor, we implemented the system using Hadoop ECO System and ELK, and verified the superiority of the paper through simulation.