파이썬/웹스크래핑
user agent
광이11
2024. 3. 11. 12:17
https://www.whatismybrowser.com/detect/what-is-my-user-agent/
What is my user agent?
Every request your web browser makes includes your User Agent; find out what your browser is sending and what this identifies your system as.
www.whatismybrowser.com
import requests
url='http://nadocoding.tistory.com'
headers ={"User-Agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36"}
res=requests.get(url, headers=headers)
# res.raise_for_Status()
with open('madocoding.html','w',encoding='utf8') as f:
f.write(res.text)
# import requests
# res=requests.get('http://nadocoding.tistory.com')
# # res.raise_for_Status()
# with open('nadocoding_b.html','w',encoding='utf8') as f:
# f.write(res.text)
user agent 할 때 문제 : requests가 제대로 안 불러와짐
모듈 설치해봐도 오류 발생함
useragent를 사용해야 글꼴이 꺠지는 것과 같은 문제가 발생하지 않음. 오리지널 html문서와 동일한 결과가 나타남