Unintended leak of Proxy-Authorization header in requests
Since Requests v2.3.0, Requests has been vulnerable to potentially leaking
Proxy-Authorization headers to destination servers, specifically during redirects to an HTTPS origin. This is a product of how
rebuild_proxies is used to recompute and reattach the
Proxy-Authorization header to requests when redirected. Note this behavior has only been observed to affect proxied requests when credentials are supplied in the URL user information component (e.g.
Current vulnerable behavior(s):
For HTTP connections sent through the proxy, the proxy will identify the header in the request itself and remove it prior to forwarding to the destination server. However when sent over HTTPS, the
Proxy-Authorization header must be sent in the CONNECT request as the proxy has no visibility into further tunneled requests. This results in Requests forwarding the header to the destination server unintentionally, allowing a malicious actor to potentially exfiltrate those credentials.
The reason this currently works for HTTPS connections in Requests is the
Proxy-Authorization header is also handled by urllib3 with our usage of the ProxyManager in adapters.py with
proxy_manager_for. This will compute the required proxy headers in
proxy_headers and pass them to the Proxy Manager, avoiding attaching them directly to the Request object. This will be our preferred option going forward for default usage.
Starting in Requests v2.31.0, Requests will no longer attach this header to redirects with an HTTPS destination. This should have no negative impacts on the default behavior of the library as the proxy credentials are already properly being handled by urllib3's ProxyManager.
For users with custom adapters, this may be potentially breaking if you were already working around this behavior. The previous functionality of
rebuild_proxies does not make sense in any case, so we would encourage any users impacted to migrate any handling of Proxy-Authorization directly into their custom adapter.
For users who are not able to update Requests immediately, there is one potential workaround.
You may disable redirects by setting
False on all calls through Requests top-level APIs. Note that if you're currently relying on redirect behaviors, you will need to capture the 3xx response codes and ensure a new request is made to the redirect destination.
import requests r = requests.get('http://github.com/', allow_redirects=False)
This vulnerability was discovered and disclosed by the following individuals.
Dennis Brinkrolf, Haxolot (https://haxolot.com/) Tobias Funke, (email@example.com)
All versions starting from 2.3.0 before 2.31.0
Upgrade to version 2.31.0 or above.