基本的网络爬虫不退出异步功能

Question

当我运行这个函数时，我通过console.log得到了预期的结果，但是这个函数没有退出。为什么会这样？

const puppeteer = require('puppeteer');

async function scrape(url) {
    const browser = await puppeteer.launch();
    const page = await browser.newPage();
    const target = await page.goto(url);
    const waiting = await page.waitForXPath('XPATH...');
    const [el] = await page.$x('XPATH...');
    const txt = await el.getProperty('textContent');

    const rawTxt  = txt.jsonValue();
    console.log(rawTxt);
}

Answer 1

完成任务后尝试关闭 Puppeteer。

// ... your code
browser.close()

const puppeteer = require('puppeteer');

async function scrape(url) {
    const browser = await puppeteer.launch();
    const page = await browser.newPage();
    const target = await page.goto(url);
    const waiting = await page.waitForXPath('XPATH...');
    const [el] = await page.$x('XPATH...');
    const txt = await el.getProperty('textContent');

    const rawTxt  = txt.jsonValue();
    console.log(rawTxt);

    browser.close() // <--
}

基本的网络爬虫不退出异步功能

basic webscraper not exiting async function

javascript

node.js

web-scraping

async-await