scrapy之其他

2018-10-24 15:16:51 浏览数 (1)

1.日志 $为注释 LOG_ENABLED = True LOG_LEVEL = ‘INFO’ $LOG_FILE = ‘./logs/booksisbn.log’

2.失败重试$为注释 RETRY_ENABLED=True RETRY_TIMES = 3 RETRY_HTTP_CODES = [500, 503, 504, 400, 403, 404, 408]

scrapy http

0 人点赞