我试图仅捕获“其他”文本,实质上是提取强标记元素
<ul class="listing-row__meta">
<li>
<strong>Ext. Color:</strong>
Other
</li>
</ul>
我的代码到目前为止:
import requests
from bs4 import BeautifulSoup
from csv import writer
response = requests.get('https://www.cars.com/for-sale/searchresults.action/?mdId=21811&mkId=20024&page=1&perPage=100&rd=99999&searchSource=PAGINATION&showMore=false&sort=relevance&stkTypId=28880&zc=11209')
soup = BeautifulSoup(response.text, 'html.parser')
posts = soup.find_all(class_='shop-srp-listings__inner')
with open('posts.csv', 'w') as csv_file:
csv_writer = writer(csv_file)
headers = ['title', 'color', 'price']
csv_writer.writerow(headers)
for post in posts:
title = post.find(class_="listing-row__title").get_text().replace('\n', '').strip()
color = post.find("li").get_text().replace('\n', '').strip()
colorremove = color.strong.extract()
price = post.find("span", attrs={"class": "listing-row__price"}).get_text().replace('\n', '').strip()
csv_writer.writerow([title, colorremove, price])
这个特殊的脚本没有运行,在此之前我只保留了颜色线并且工作正常,但是它会显示“Ext.Color”
你可以find
<strong>
元素,然后得到它的next_sibling
:
from bs4 import BeautifulSoup
markup = r"""
<ul class="listing-row__meta">
<li>
<strong>Ext. Color:</strong>
Other
</li>
</ul>
"""
soup = BeautifulSoup(markup, "html.parser")
print(soup.find("strong").next_sibling.strip())
结果:
Other
您可以在父类上使用stripped_strings
from bs4 import BeautifulSoup
html = """
<ul class="listing-row__meta">
<li>
<strong>Ext. Color:</strong>
Other
</li>
</ul>
"""
soup = BeautifulSoup(html, "lxml")
firstItem = soup.select_one('.listing-row__meta')
strings = [string for string in firstItem.stripped_strings]
print(strings[1])