Research and implementation of campus network mass log collection platform based on elastic stack

Desheng Zeng; Guanquan Wu; Shuanglong Pang; Lihua Chen; Xiaodan Chen; Cui Shao

doi:10.1117/12.2628541

7 March 2022 Research and implementation of campus network mass log collection platform based on elastic stack

Desheng Zeng, Guanquan Wu, Shuanglong Pang, Lihua Chen, Xiaodan Chen, Cui Shao

Proceedings Volume 12167, Third International Conference on Electronics and Communication; Network and Computer Technology (ECNCT 2021); 1216724 (2022) https://doi.org/10.1117/12.2628541
Event: 2021 Third International Conference on Electronics and Communication, Network and Computer Technology, 2021, Harbin, China

Abstract

With the wide application of cloud computing technology and the rise of container technology, many business architectures have undergone huge changes. In recent years, container technology, microservices and other applications have gradually matured, and many enterprises' business systems have gradually migrated to the microservices model, with many microservices running in their respective business systems. In the production environment, logs play an extremely important role, and the logs in the production environment are required for business system operation monitoring, performance optimization, and troubleshooting. In the traditional business model, most of the services running in the production environment adopt independent localized log storage mode, and the operation and maintenance personnel are often unable to locate them quickly, while the large amount of log storage also puts great pressure on the storage of IT systems, and it is difficult to tap the data value of logs with the independent log mode. This paper proposes an Elastic Stack-based massive log management platform based on the business in our campus network as a prototype, deploys log collection components in various business systems in the campus network, classifies logs with appropriate rules, realizes centralized management and visual output, solves the massive log management problem of the current business systems in the campus network, and helps operation and maintenance and R and D.

Citation Download Citation

Desheng Zeng, Guanquan Wu, Shuanglong Pang, Lihua Chen, Xiaodan Chen, and Cui Shao "Research and implementation of campus network mass log collection platform based on elastic stack", Proc. SPIE 12167, Third International Conference on Electronics and Communication; Network and Computer Technology (ECNCT 2021), 1216724 (7 March 2022); https://doi.org/10.1117/12.2628541

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available