Web Crawler Scheduler Based on Coroutine
Zhaoyang Wang · 2019
The application of coroutine has greatly accelerated the programs switching. Compared with threads and processes, it not only satisfies most applications, but also consumes very little system resources. This paper proposes a web crawler scheduler based on coroutine.