Home/ Questions/Q 7693147
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-31T21:01:02+00:00

There is a task to write a crawler to crawl the webpage by python.

  • 0

There is a task to write a crawler to crawl the webpage by python.
one of the requst is to specify the level of the log file, as is the level of detail of the log file.
But I don’t know what should be record? and what is the level of detail?
Can everyone give me an example?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    This is like what you’re logging now:

    12:01:08 Downloaded http://a.com/aaaaa/1.
12:02:51 Downloaded http://a.com/aaaaa/2.

    This would be logging with more detail:

    12:01:03 Preparing to download http://a.com/aaaaa/1...
12:01:03 Resolved host 'a.com' to '147.34.98.1'
12:01:04 Connected to 'a.com' (147.34.98.1)
12:01:04 Sent HTTP request http://a.com/aaaaa/1
12:01:06 Downloaded (48 KB in 1.5s) from http://a.com/aaaaa/1
12:01:08 Indexed http://a.com/aaaaa/1 (in 1.2s)
12:01:08 Downloaded http://a.com/aaaaa/1.

12:02:39 Preparing to download http://a.com/aaaaa/2
....

    If you give control over log level, this might be a level in the middle:

    12:01:06 Downloaded (48 KB in 1.5s) from http://a.com/aaaaa/1
12:01:08 Indexed http://a.com/aaaaa/1 (in 1.2s)

12:02:36 Downloaded (153 KB in 1.3s) from http://a.com/aaaaa/2
12:02:40 Indexed http://a.com/aaaaa/2 (in 1.6s)
    • 0