urllib3 Open source HTTP library with thread-safe connection pooling and file post support
Download

urllib3 Ranking & Summary

urllib3 Tags

connection connection pooler pooler crawl website crawler http library

urllib3 Description

Open source HTTP library with thread-safe connection pooling and file post support The urllib3 library is perfect for:· Talking to an API· Crawling a website· Any situation where being able to post files, handle redirection, and retrying is useful. urllib3 is relatively lightweight, so it can be easily used for anything! Performance When you normally do a urllib call, a separate socket connection is created with each request. By reusing existing sockets (supported since HTTP 1.1), the requests will take up less resources on the server's end, and also provide a faster response time at the client's end. With some simple benchmarks, downloading 15 URLs from google.com is about twice as fast when using HTTPConnectionPool (which uses 1 connection) than using plain urllib (which uses 15 connections). Here are some key features of "urllib3": · HTTPConnectionPool - Thread-safe connection pooling and re-using · filepost - File posting! Supported implicitly by HTTPConnectionPool.post_url · (Optional) Automatically handles redirection and retries!

urllib3 Related Software