在 python 中使用 selenium 从 Xpath 中提取文本时出现问题

Question

我正在使用 Selenium 从以下页面中提取数据。

页url：www2.miami-dadeclerk.com/cef/CitationSearch.aspx

点击作品集：0131230371470。点击第一个。

我使用以下代码提取了某些信息：

templist = []

status = driver.find_element_by_xpath('.//*[@id="lblCitationHeader"]').text
total_due = driver.find_element_by_xpath('.//*[@id="lblCitationHeader"]').text
issue_dept = driver.find_element_by_xpath('.//*[@id="form1"]/div[4]/div[9]/div/div/div[2]/table/tbody/tr[5]/td[2]').text
lien_placed = driver.find_element_by_xpath('.//*[@id="lblLienPlaced"]').text

Table_dict = {
    'Status': status,
    'Total Due': total_due,
    'Issuing Department': issue_dept,
    'Lien_Placed': lien_placed
    }

templist.append(Table_dict)
df = pd.DataFrame(templist)

结果如下：

    Status  Total Due   Issuing Department  Lien_Placed
0   Citation No.: 2010 - S001916 Issue Date: 1/ ... Citation No.: 2010 - S001916 Issue Date: 1/ ... 05 ANIMAL SERVICES DEPARTMENT (305) 629-7387

此处 lblCitationHeader 下的所有数据都在 Status 和 Total due 下。

为此我提取了他们的 Xpath：

Status: //*[@id="lblCitationHeader"]/text()[3]
Total Due: //*[@id="lblCitationHeader"]/text()[4]

当我在代码中输入上面的内容时：

status = driver.find_element_by_xpath('.//*[@id="lblCitationHeader"]/text()[3]').text

出现以下错误：

Message: invalid selector: Unable to locate an element with the xpath expression .//*[@id="lblCitationHeader"]/text()[3]"] because of the following error:
SyntaxError: Failed to execute 'evaluate' on 'Document': The string './/*[@id="lblCitationHeader"]/text()[3]"]' is not a valid XPath expression.
  (Session info: chrome=96.0.4664.110)

我了解 Xpath 用于定位元素而不是文本。但是我无法找到存储文本的部分 return 它。

图片供参考：

我要提取的数据是：-

状态到期总计发行部门留置权

Answer 1

对于当前文档 STATUS TOTAL DUE 和 ISSUING DEPT 字段有一个值和提取您需要诱导的值 WebDriverWait for the and you can use either of the following :

代码块：

driver.get("https://www2.miami-dadeclerk.com/cef/CitationSearch.aspx")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.LINK_TEXT, "Folio"))).click()
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "input#txtFolioNumber"))).send_keys("0131230371470")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "input#btnFolioSearch"))).click()
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "table tbody>tr>td>a>span"))).click()
status = driver.execute_script('return arguments[0].childNodes[5].textContent;', WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "span#lblCitationHeader")))).strip()
total_due = driver.execute_script('return arguments[0].lastChild.textContent;', WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "span#lblCitationHeader")))).strip()
issue_dept = WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//strong[contains(., 'Issuing Department:')]//following::td[1]/span"))).text
print(f"{status}--{total_due}--{issue_dept}")

控制台输出：

* DEPARTMENT CLOSED *--[=11=].00--05 ANIMAL SERVICES DEPARTMENT (305) 629-7387

注意：您必须添加以下导入：

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

在 python 中使用 selenium 从 Xpath 中提取文本时出现问题

Problem in extracting text from Xpath using selenium in python

python

selenium

xpath

selenium-webdriver