我编写了一个python文件,执行该文件后应在本地目录中创建一个csv文件。即使执行成功完成,python文件也不会在本地目录中创建csv文件。我的代码和输出屏幕截图包含在下面:
from selenium import webdriver
from bs4 import BeautifulSoup
import pandas as pd
def web_scraper(self):
driver = webdriver.Chrome("/usr/local/chromedriver_mac")
headline_titles = [] # List to store Headline titles
headline_dates = [] # List to store date of Headline titles
driver.get("<a href=https://www.marketwatch.com/investing/stock/aal/profile")
content = driver.page_source
soup = BeautifulSoup(content)
for i in soup.find('div[1]', href=True, attrs={'class': 'headlinewrapper'}):
name = i.find('ol/li[' + i + ']/div/p[1]/a')
date = i.find('ol/li[' + i + ']/div/p[2]/span/span[2]')
headline_titles.append(name.text)
headline_dates.append(date.text)
df = pd.DataFrame({'Headline Title': headline_titles, 'Headline Date': headline_dates})
df.to_csv('headlines.csv', index=False, encoding='utf-8')
return(headline_titles, headline_dates)
由于当前工作目录(cwd)问题,最有可能将其保存在您不希望的位置。
根据PyCharm current working directory更改PyCharm中的当前工作目录,或使用代码显式更改它:
import os # put these lines at the top of your script
os.chdir(r"/Users/bsulin/PycharmProjects/StockNewsWebScraper/")