Go to homepageCyberStrike

Menu

Star on GitHub · 3.2k
Sign inDownload

CVE-2021-41125

5.7 · MEDIUM

Scrapy is a high-level web crawling and scraping framework for Python.

Published Oct 6, 2021CWE-200EPSS 1.26%

Overview

CVE-2021-41125 is a medium-severity vulnerability. It was published on October 6, 2021 and has a CVSS 3.1 base score of 5.7 (MEDIUM).

This vulnerability has a CVSS 3.1 base score of 5.7, rated MEDIUM. It can be exploited remotely over the network. Some level of privileges is required for exploitation.

Technical description

Scrapy is a high-level web crawling and scraping framework for Python. If you use `HttpAuthMiddleware` (i.e. the `http_user` and `http_pass` spider attributes) for HTTP authentication, all requests will expose your credentials to the request target. This includes requests generated by Scrapy components, such as `robots.txt` requests sent by Scrapy when the `ROBOTSTXT_OBEY` setting is set to `True`, or as requests reached through redirects. Upgrade to Scrapy 2.5.1 and use the new `http_auth_domain` spider attribute to control which domains are allowed to receive the configured HTTP authentication credentials. If you are using Scrapy 1.8 or a lower version, and upgrading to Scrapy 2.5.1 is not an option, you may upgrade to Scrapy 1.8.1 instead. If you cannot upgrade, set your HTTP authentication credentials on a per-request basis, using for example the `w3lib.http.basic_auth_header` function to convert your credentials into a value that you can assign to the `Authorization` header of you

Remediation

Check the references section for vendor advisories, patches, and mitigation guidance. If immediate patching is not possible, review the CVSS vector to understand the attack surface and apply compensating controls such as network segmentation or access restrictions.

References

Refdoc.scrapy.org/en/latest/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauthGitHubgithub.com/scrapy/scrapy/commit/b01d69a1bf48060daec8f751368622352d8b85a6GitHubgithub.com/scrapy/scrapy/security/advisories/GHSA-jwqp-28gf-p498Reflists.debian.org/debian-lts-announce/2022/03/msg00021.htmlRefw3lib.readthedocs.io/en/latest/w3lib.html#w3lib.http.basic_auth_headerRefdoc.scrapy.org/en/latest/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauthGitHubgithub.com/scrapy/scrapy/commit/b01d69a1bf48060daec8f751368622352d8b85a6GitHubgithub.com/scrapy/scrapy/security/advisories/GHSA-jwqp-28gf-p498Reflists.debian.org/debian-lts-announce/2022/03/msg00021.htmlRefw3lib.readthedocs.io/en/latest/w3lib.html#w3lib.http.basic_auth_header

How CyberStrike helps

Frequently asked questions

What is CVE-2021-41125?

CVE-2021-41125 is a medium-severity vulnerability. It was published on October 6, 2021 and has a CVSS 3.1 base score of 5.7 (MEDIUM).

How severe is CVE-2021-41125?

This vulnerability has a CVSS 3.1 base score of 5.7, rated MEDIUM. It can be exploited remotely over the network. Some level of privileges is required for exploitation.

How do I fix or remediate CVE-2021-41125?

Check the references section for vendor advisories, patches, and mitigation guidance. If immediate patching is not possible, review the CVSS vector to understand the attack surface and apply compensating controls such as network segmentation or access restrictions.

How can CyberStrike help with CVE-2021-41125?

CyberStrike is an open-source, AI-augmented pentesting engine. Rather than flag a version number, it tests whether an issue like CVE-2021-41125 is actually reachable in your own applications and APIs, then verifies each finding before reporting it. That tells you if the weakness is a real, exploitable risk in your environment or a false positive you can safely deprioritize.

Related MEDIUM CVEs from 2021

View all
Browse by year2026202520242023202220212020201920182017201620152014201320122011201020092008200720062005200420032002200120001999