Python 异步调用独立函数

Question

我有如下4个函数，其中3个调用外部api来获取随机数据：

def get_external_data(zip_code, info_code):
    data_url = MY_ENDPOINT_1.format(zip_code)
    data_response = requests.request(
        'GET',
        url=data_url,
        headers={
            'content-Type': 'application/json',
            'info-code': info_code
        }
    )
    return data_response

def get_info(info_code):
    info_url = INFO_URL.format(info_code)
    info_response = requests.request(
        'GET',
        url=info_url,
        headers={
            'content-Type': 'application/json',
            'info-code': info_code
        }
    )
    return info_response

def get_zip(zip_code):
    zip_url = zip_URL.format(zip_code)
    zip_response = requests.request(
        'GET',
        url=zip_url,
        headers={
            'content-Type': 'application/json',
            'zip-code': zip_code
        }
    )
    return zip_response

def get_all_data(info_cd, zip_code):
    data_response = get_external_data(zip_code, info_cd)
    info_response = get_info(info_cd)
    zip_response = get_zip(zip_code)
    return data_response, info_response, zip_response

我试图通过在 get_all_data() 函数中使用 concurrent.futures 调用 3 个数据函数来实现 3 个异步调用。从文档中我了解到我们可以使用如下输入列表对一个函数进行线程处理：

resp_list = list()
# Asynchronous
with ThreadPoolExecutor(max_workers=3) as executor:
    thread_responses = executor.map(self.get_info, info_list)
    for x in thread_responses:
        resp_list.append(x)

但是在这种特殊情况下，我如何使用具有不同输入的 3 个不同函数实现 3 个线程？

Answer 1

您可以使用 executor.submit 在其自己的线程中进行每个调用，如下所示：

with ThreadPoolExecutor(max_workers=3) as executor:
    data_future = executor.submit(get_external_data, zip_code, info_cd)
    info_future = executor.submit(get_info, info_cd)
    zip_future = executor.submit(get_zip, zip_code)
    # and then collect results
    results = [
        f.result()
        for f in (data_future, info_future, zip_future)
    ]

查看相关文档：https://docs.python.org/3/library/concurrent.futures.html#concurrent.futures.Executor.submit

Python 异步调用独立函数

Python asynchronous call separate functions

python

asynchronous

python-3.x

python-requests

concurrent.futures