10 个 Python 爬虫入门实战示例

环境准备

安装 requests 库：

pip install requests

1. 爬取百度页面

import requests
response = requests.get("http://www.baidu.com")
response.encoding = response.apparent_encoding
print("状态码:" + str(response.status_code))
print(response.text)

2. GET 方法实例

import requests
response = requests.get("http://httpbin.org/get")
print(response.status_code)
print(response.text)

3. POST 方法实例

import requests
response = requests.post("http://httpbin.org/post")
print(response.status_code)
print(response.text)

4. PUT 方法实例

import requests
response = requests.put("http://httpbin.org/put")
print(response.status_code)
print(response.text)

5. GET 方法传参 (1)

import requests
response = requests.get("http://httpbin.org/get?name=hezhi&age=20")
print(response.status_code)
print(response.text)

6. GET 方法传参 (2)

import requests
data = {
    "name": "hezhi",
    "age": 20
}
response = requests.get("http://httpbin.org/get", params=data)
print(response.status_code)
(response.text)