2.3.0
版本发布时间: 2020-08-05 03:40:08
scrapy/scrapy最新发布版本:2.11.2(2024-05-14 20:12:22)
Hihglights:
-
Feed exports now support Google Cloud Storage as a storage backend
-
The new
FEED_EXPORT_BATCH_ITEM_COUNT
setting allows to deliver output items in batches of up to the specified number of items.It also serves as a workaround for delayed file delivery, which causes Scrapy to only start item delivery after the crawl has finished when using certain storage backends (S3, FTP, and now GCS).
-
The base implementation of item loaders has been moved into a separate library, itemloaders, allowing usage from outside Scrapy and a separate release schedule