beautifulsoup 相关问题

我试图在这里抓取一个结构与我之前的问题非常相似的表格。我刚刚更改了属性名称，但出现索引超出范围错误。这是TR：我正在尝试在这里抓取一张表格，其结构与我之前的问题非常相似。我刚刚更改了属性名称，但出现了 index out of range 错误。这是TR： <TR VALIGN="bottom"> <TD BGCOLOR=#cc6600 ALIGN="center" >1</TD> <TD BGCOLOR=#CC6600 ALIGN="left" >Wachtell, Lipton</TD> <TD BGCOLOR=#CC6600 ALIGN="center" >1 </TD> <TD BGCOLOR=#CC6600 ALIGN="center" >9.1%</TD> <TD BGCOLOR=#FF9933 ALIGN="center" >$3,385,000 </TD> </TR> 我正在尝试获取第一个ALIGN="left"和最后一个ALIGN="center"。但最后一行的索引给出了错误。这是我正在使用的代码： soup = BeautifulSoup(urllib.urlopen("http://www.law.com/special/professionals/amlaw/amlaw200/amlaw200_ppp.html")) rows = soup.findAll(name='tr',attrs={'valign':'bottom'}, limit=13) for row in rows: tds_left = row.findAll(name='td',attrs={'align':'left'}, limit=13) tds_center = row.findAll(name='td',attrs={'align':'center'}, limit=13) if tds_left: firm_name = tds_left[0].text if tds_center: # the following line gives an error if the index is different than 0 ppp = tds_center[0].text 谢谢！更新 Traceback (most recent call last): File "C:\Program Files (x86)\Google\google_appengine\google\appengine\ext\webapp\_webapp25.py", line 701, in __call__ handler.get(*groups) File "C:\U\A\D\\toplawfirms.py", line 384, in get ppp = tds_center[2].text IndexError: list index out of range 更新作为对agf评论的回应是print tds_center和for item in tds_center: print item？ tds_center: [] tds_center: [] tds_center: [] tds_center: [ ] item: tds_center: [] item: tds_center: [Rank By Profits Per Partner, Rank By Revenue Per Lawyer, Change In Profits per Partner from 1998, Profits Per Partner] item: Rank By Profits Per Partner item: Rank By Revenue Per Lawyer item: Change In Profits per Partner from 1998 item: Profits Per Partner tds_center: [1, 1 , 9.1%, $3,385,000 ] item: 1 item: 1 item: 9.1% item: $3,385,000 tds_center: [2, 2 , 5.0%, $3,055,000 ] item: 2 item: 2 item: 5.0% item: $3,055,000 tds_center: [3, 4 , 2.9%, $2,110,000 ] item: 3 item: 4 item: 2.9% item: $2,110,000 tds_center: [4, 3 , 8.7%, $1,790,000 ] item: 4 item: 3 item: 8.7% item: $1,790,000 tds_center: [5, 9 , 6.9%, $1,710,000 ] item: 5 item: 9 item: 6.9% item: $1,710,000 tds_center: [6, 6 , 10.8%, $1,655,000 ] item: 6 item: 6 item: 10.8% item: $1,655,000 tds_center: [7, 5 , 5.1%, $1,610,000 ] item: 7 item: 5 item: 5.1% item: $1,610,000 我修改了以下代码中获取最后一个“中心”td 的方式： import urllib from BeautifulSoup import BeautifulSoup soup = BeautifulSoup(urllib.urlopen("http://www.law.com/special/professionals/amlaw/amlaw200/amlaw200_ppp.html")) rows = soup.findAll(name='tr',attrs={'valign':'bottom'}, limit=13) for row in rows: tds_left = row.findAll(name='td',attrs={'align':'left'}, limit=13) tds_center = row.findAll(name='td',attrs={'align':'center'}, limit=13) if tds_left: firm_name = tds_left[0].text print firm_name if tds_center: # get last td "center" ppp = tds_center[-1].text print ppp 并得到以下结果： Firm Profits PerPartner Wachtell, Lipton $3,385,000 Robins, Kaplan $3,055,000 Cravath $2,110,000 Sullivan & Cromwell $1,790,000 Cahill Gordon $1,710,000 Simpson Thacher $1,655,000 Davis Polk $1,610,000 回溯与代码不对应。回溯： ppp = tds_center[2].text 您的代码： ppp = tds_center[0].text 代码的结果输出有效，但看起来不是很有趣，John Keyes 有更有趣的输出，但具有 [-1] 值。这取决于您的需求。

python web-scraping beautifulsoup

回答 2 投票 0

Windmill 未获取所有 html 内容

我正在尝试使用 python Windmill 框架从网页上抓取数据。但是，我在从页面获取 HTML 表格内容时遇到问题。该表是由 Javascript 生成的 - 因此...

python web-scraping beautifulsoup windmill

回答 1 投票 0

如何去掉像 ' 这样的字符而不是撇号？ [重复]

可能的重复：在 Python 中将 XML/HTML 实体转换为 Unicode 字符串我正在尝试使用 Python 抓取网站。我导入并使用 urllib2、BeautifulSoup 和 re 模块。回复...

python regex web-scraping beautifulsoup

回答 1 投票 0

beautifulSoup 屏幕抓取不正确嵌套的列表 <ul>s

我对 BeautifulSoup 非常陌生，在过去的三天里，我试图从 http://www.ucanews.com/diocesan-directory/html/ordinary-of-philippine-cagayandeoro 获取教堂列表-parishes.html。 ...