Nowadays, with the rapid increase of network resources, traditional search engines can no longer meet people’s needs. Therefore, the network crawler as an important part of the search engine is more and more important. This paper introduces the concept and classification of network crawler, how to use Python language to write the basic network crawler, and how to combine the crawler with the database.