使用 Python Selenium 从 Javascript 代码获取数据 [已关闭]

Question

我正在尝试使用 Selenium 从网站获取 javascript 数据。然而，我无法实现我想要的。下面是 JavaScript 代码的屏幕截图。我想提取这些代码中的条形码编号和变化值（例如36号、37号）。我怎样才能最好地做到这一点？感谢您的帮助。

网页javascript代码

编辑1：

Javascript代码：

窗口。PRODUCT_DETAIL_APP_INITIAL_STATE={"product":{"attributes":[],"alternativeVariants":[],"variants":[{"attributeId":338,"attributeName":"Beden","attributeType" :"尺寸","attributeValue":"36","邮票":[{"type":1,"text":"KARGO BEDAVA"},{"type":3,"text":"%35" }],"price":{"profitMargin":0,"discountedPrice":{"text":"143,99 TL","value":143.99}," sellPrice":{"text":"159,99 TL","value":159.99},"originalPrice":{"text":"219,99 TL","value":219.99},"currency":"TRY"},"fulfilmentType":"mp", “attributeBeautifiedValue”：“36”，“isWinner”：true，“listingId”：“cb32c614f54395f199628ef7066ab102”，“stock”：null，“可销售”：true，“availableForClaim”：true，“条形码”：“100406115”，“itemNumber ":118134976,"discountedPriceInfo":"Sepette %10 Indirim","hasCollectable":false,"unitInfo":{"unitPrice":false,"unitPriceText":false},"rushDeliveryMerchantListingExist":false}],"otherMerchants" :[],"campaign":{"id":591963,"name":"Kadın Giyimde Avantajlı Ürünler - Sepette %10 INDirim","startDate":"2021-11-30T14:30:05","endDate" :"2021-12-07T05:00:00","isMultipleSupplied":false,"stockTypeId":7,"url":"/kadin-giyimde-avantajli-urunler---sepette--10-indirim/butikdetay/ 591963","showTimer":false},"category":{"id":103718,"name":"Klasik Topuklu Ayakkabı","hierarchy":"Ayakkabı/Topuklu Ayakkabı/Klasik Topuklu Ayakkabı","可退款": true,"beautifiedName":"klasik-topuklu-ayakkabi","isVASEnabled":false},"brand":{"isVirtual":false,"beautifiedName":"laminta","id":205748,"name": "LAMINA","path":"/laminta-x-b205748"},"color":"GÜMÜŞ ŞEFFAF","metaBrand":{"id":205748,"name":"LAMINA","beautifiedName": "","isVirtual":false,"path":""},"showVariants":true,"showSexualContent":true,"brandCategoryBanners":[],"allVariants":[{"itemNumber":118134976,"值":"36","inStock":true,"currency":"TRY","barcode":"100406115","price":143.99},{"itemNumber":118134979,"value":"37", "inStock":true,"currency":"TRY","barcode":"100406116","price":143.99},{"itemNumber":118134975,"value":"38","inStock":true, "currency":"TRY","barcode":"100406117","price":143.99},{"itemNumber":118134983,"value":"39","inStock":true,"currency":"TRY ","条形码":"100406118","价格":143.99},{"itemNumber":118123516,"value":"40","inStock":true,"currency":"TRY","条形码": "100406119","价格":143.99}]

我的简单代码如下。我收到一个带有以下代码的条形码。但是，我无法提取每个变体的条形码和其他信息。

def barkodBul():
    if ('barcode' in driver.page_source):
        p_id = driver.find_elements_by_tag_name("script")
        for script in p_id:
            innerHTML = script.get_property('innerHTML')
            task = re.search('barcode', innerHTML)
            if (task):
                barkod = [l for l in innerHTML.split("{") if "barcode" in l][0]
                barkod = barkod.split(",")
                for k in range(0,len(barkod)):
                    if('barcode' in barkod[k]):
                        barkod = barkod[k].split(":")
                        print barkod[1]
                        barkod = barkod[1].replace('"', '')
                        print barkod
                        return barkod

    return 0

我想做的事： 36条码For36 37 BarcodeFor37 等

编辑2 - 解决方案：谢谢esqew

def barkodBul2():

    time.sleep(3)
    timeout = 30
    WebDriverWait(driver, timeout).until(EC.visibility_of_element_located((By.CLASS_NAME, "pr-new-br")))
    product_detail = driver.execute_script('return window.__PRODUCT_DETAIL_APP_INITIAL_STATE__')
    for variant in product_detail['product']['variants']:
        print variant['attributeValue'] + " " + variant['barcode']

Output:
36 100406115
37 100406116
38 100406117
39 100406118
40 100406119

Answer 1

当数据被很好地构造为对象时，为什么要使用 RegExp 呢？直接使用 Selenium 提取内容，然后从那里访问您想要的数据：

def barkodBul():
    product_detail = driver.execute_script('return window.PRODUCT_DETAIL_APP_INITIAL_STATE'))
    for variant in product_detail['product']['allVariants']:
        print variant['value'] + " " + variant['barcode']