PT-2017-13286 · Scrapy+1 · Scrapy+1
Kmike
+1
·
Published
2017-09-05
·
Updated
2022-05-17
·
CVE-2017-14158
CVSS v2.0
7.8
High
| Vector | AV:N/AC:L/Au:N/C:N/I:N/A:C |
Name of the Vulnerable Software and Affected Versions
Scrapy version 1.4
Description
The issue allows remote attackers to cause a denial of service due to memory consumption via large files. This occurs because the software reads arbitrarily many files into memory. This problem is especially significant if the files are then individually written in a separate thread to a slow storage resource. The interaction between
dataReceived in core/downloader/handlers/http11.py and S3FilesStore demonstrates this issue.Recommendations
For Scrapy version 1.4, consider restricting the size of files that can be read into memory to prevent excessive memory consumption. As a temporary workaround, consider implementing a mechanism to limit the number of files that can be processed simultaneously to minimize the risk of denial of service.
Exploit
Fix
DoS
Resource Exhaustion
Found an issue in the description? Have something to add? Feel free to write us 👾
Weakness Enumeration
Related Identifiers
Affected Products
Debian
Scrapy