未显示 Selenium 中的输出

Question

它尝试使用 Selenium 来废弃 Indiamart 网站，但我没有收到任何错误。现在我没有得到输出。我不知道我哪里错了。

我在这里复制代码和输出。我想要数据帧中的输出来提取数据。

from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.common.by import By
from selenium.webdriver.common.keys import Keys
import pandas as pd 
import time
import os 
# Set up the service for ChromeDriver
service = Service(r'C:\Users\vamsi\OneDrive\Documents\Selenium\chromedriver.exe')
# Initialize the Chrome WebDriver with the service
driver = webdriver.Chrome(service=service)
#URL visit 
driver.get("https://dir.indiamart.com/impcat/boneless-chicken.html")
driver.maximize_window()
#Locate elements using the updated methods
company_names = driver.find_elements(By.XPATH, '//h2[@class="lcname"]')
address = driver.find_elements(By.XPATH, '//p[@class="sm clg"]')
view_mobilenumber = driver.find_elements(By.XPATH, '//a[@class="mo viewn vmn"]')
contactlist = driver.find_elements(By.XPATH, '//span[@class="pns-h duet"]')
namelist = []
addresslist = []
numberlist = []
# Calculate the minimum length to avoid index errors
min_length = min(len(names), len(address), len(contactlist))
for i in range(min_length):
    name = comapany_names[i].text
    addresslist = address[i].text
    view_mobilenumber.click()
    contact = contactlist[i].get_attribute("innerHTML")
    
    namelist.append(names)
    addresslist.append(addresslist)
    numberlist.append(contact)
#Intialise data of lists
data = {'company_names': namelist, 'address': addresslist, 'contactlist': numberlist}
df = pd.DataFrame(data)
# Display the DataFrame
print(df)
output: - Empty DataFrame
          Columns: [company_names, address, contactlist]
          Index: []
driver.quit()

Answer 1

主要问题在第 25 行，其中“min_length”计算为零（因为“len(contactlist)”等于零）并且 for 循环甚至没有启动。

我浏览了该网站，我意识到在第 20 行，“contactlist”未正确获取，xpath 中的破折号必须替换为下划线，如下所示：

contactlist = driver.find_elements(By.XPATH, '//span[@class="pns_h duet"]')

这将为您提供以下输出：

        company_names                       address     contactlist
0        Mutton Mahal  Greater Kailash 1, New Delhi  [phone]
1   Khan'S Royal Farm          Park Street, Kolkata  [phone]
2                                                    [phone]
3                                                    [phone]
4                                                    [phone]
5                                                    [phone]
6                                                    [phone]
7                                                    [phone]
8                                                    [phone]
9                                                    [phone]
10                                                   [phone]
11                                                   [phone]
12                                                   [phone]
13                                                   [phone]
14                                                   [phone]
15                                                   [phone]
16                                                   [phone]
17                                                   [phone]
18                                                   [phone]
19                                                   [phone]
20                                                   [phone]
21                                                   [phone]
22                                                   [phone]
23                                                   [phone]
24                                                   [phone]
25                                                   [phone]
26                                                   [phone]
27                                                   [phone]