pyautogui：继续尝试直到找到图像

Question

如何在屏幕上的特定位置搜索图像，在限制 'x' 秒的连续搜索中，直到找到图像？其中如果没有找到图片，return一个False如果找到图片，return找到的位置的坐标...也可以自动点击。

当等待加载网页的特定视觉响应时，想到此函数作为 'done' 的触发器。我创建了仅基于视觉的操作来浏览网站的自动化，因此我不应该将库用作请求或硒。 lib pyautogui 是我找到的最好的工具，但是它的方法非常简陋（只关注要点），我无法创建更实用的功能。

Answer 1

天哪...我已经受够了 pyautogui 方法的精简...

也许对你有帮助。

下面有一个非常灵活的可以在小范围内进行连续和优化的搜索。

我试图使文档字符串尽可能可读。

如果您觉得功能不够清楚，请告诉我，我会改进文档字符串。

import logging
import pyautogui as pag
from PIL import Image
import time

def pag_suf(img, x, y, margin, clicks=0, duration=0, interval=0,
            debug_msg='', time_limit=None, sample_dump=None):
    """
    Pyautogui - Search Until Find
    Searches the image indefinitely at a specific point on the screen
    considering as the search area, the image size plus an expansion margin.
    If found, you can click on the center of the image.
    :param img: String. Fullpath image | List. List of Fullpath image
    :param x: coordinate x
    :param y: coordinate y
    :param margin: Integer. expansion margin to expand the search area
    :param clicks: Integer. number of clicks
    :param duration: Float. duration of mouse movement
    :param interval: Float. sleep time after click
    :param time_limit: Integer. Time limit in seconds
    :param debug_msg: String. Debug message to identify log
    :param sample_dump: String. File name if image .bmp
    :return: List. Coordinates of the center of the found image. |
             False. If time_limit reached.
    """

    is_string = type(img) == str
    list_img = []
    if is_string:
        list_img.append(img)
    else:
        list_img = img

    # Search for image at the indicated location with tolerance margins
    return_value = None
    logging.debug(f"{debug_msg}: Finding...")
    first_loop = True
    start_time = time.time()

    while return_value is None:

        # Scape in time_limit
        if time_limit is not None:
            elapsed_time = time.time() - start_time
            if elapsed_time > time_limit:
                return False
            else:
                pass
        else:
            pass

        if first_loop is False:
            time.sleep(0.5)
        else:
            first_loop = False

        for img in list_img:
            im = Image.open(img)
            # Defining variables
            img_width, img_height = im.size
            coor_x = x - img_width / 2 - margin
            coor_y = y - img_height / 2 - margin
            region_x = img_width + margin * 2
            region_y = img_height + margin * 2

            # Save collected sample
            screen_sample = pag.screenshot(imageFilename=sample_dump,
                                            region=(coor_x, coor_y,
                                                    region_x, region_y))
            return_value = pag.locate(img, screen_sample)
            if return_value is not None:
                # logging.debug(img)
                break

    logging.debug(f"{debug_msg}: Found.")

    click_x = coor_x + return_value[0] + img_width / 2
    click_y = coor_y + return_value[1] + img_height / 2

    # Click on the center of the found location
    if clicks != 0:
        pag.click(click_x, click_y, clicks,
                  duration=duration, interval=interval)

    click_arr = []
    click_arr.append(click_x)
    click_arr.append(click_y)

    return click_arr

pyautogui：继续尝试直到找到图像

pyautogui: keep trying until find image

python

pyautogui