源码网商城,靠谱的源码在线交易网站 我的订单 购物车 帮助

源码网商城

python使用BeautifulSoup分析网页信息的方法

  • 时间:2021-12-01 09:12 编辑: 来源: 阅读:
  • 扫一扫,手机访问
摘要:python使用BeautifulSoup分析网页信息的方法
本文实例讲述了python使用BeautifulSoup分析网页信息的方法。分享给大家供大家参考。具体如下: 这段python代码查找网页上的所有链接,分析所有的span标签,并查找class包含titletext的span的内容
[u]复制代码[/u] 代码如下:
#import the library used to query a website import urllib2 #specify the url you want to query url = "http://www.python.org" #Query the website and return the html to the variable 'page' page = urllib2.urlopen(url) #import the Beautiful soup functions to parse the data returned from the website from BeautifulSoup import BeautifulSoup #Parse the html in the 'page' variable, and store it in Beautiful Soup format soup = BeautifulSoup(page) #to print the soup.head is the head tag and soup.head.title is the title tag print soup.head print soup.head.title #to print the length of the page, use the len function print len(page) #create a new variable to store the data you want to find. tags = soup.findAll('a') #to print all the links print tags #to get all titles and print the contents of each title titles = soup.findAll('span', attrs = { 'class' : 'titletext' }) for title in allTitles: print title.contents
希望本文所述对大家的Python程序设计有所帮助。
  • 全部评论(0)
联系客服
客服电话:
400-000-3129
微信版

扫一扫进微信版
返回顶部