如何通过 python 多进程粉碎套接字对象？它引发了 EOFError

Question

我正在尝试用简单的代码测试 multiProcess Procee Class。

但是当我将 socket 对象作为参数传递给 Process 时，它会引发 EOFError.

下面是简单的代码和异常。

import multiprocessing
import socket

class Multi(multiprocessing.Process):

    def __init__(self, s):
        multiprocessing.Process.__init__(self)
        self.s = s

    def run(self):
        for i in range(100):
            print "aaaa"


if __name__ in "__main__":
    s = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
    p = Multi(s)
    p.start()
    p.join()

.

Traceback (most recent call last):
  File "C:\Users\sangmin\workspace\multiProcessTest\multiProcessTest.py", line 24, in <module>
    p.start()
  File "C:\Python27\lib\multiprocessing\process.py", line 130, in start
    self._popen = Popen(self)
  File "C:\Python27\lib\multiprocessing\forking.py", line 277, in __init__
    dump(process_obj, to_child, HIGHEST_PROTOCOL)
  File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump
    ForkingPickler(file, protocol).dump(obj)
  File "C:\Python27\lib\pickle.py", line 224, in dump
    self.save(obj)
  File "C:\Python27\lib\pickle.py", line 331, in save
    self.save_reduce(obj=obj, *rv)
  File "C:\Python27\lib\pickle.py", line 419, in save_reduce
    save(state)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 649, in save_dict
    self._batch_setitems(obj.iteritems())
  File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems
    save(v)
  File "C:\Python27\lib\pickle.py", line 331, in save
    self.save_reduce(obj=obj, *rv)
  File "C:\Python27\lib\pickle.py", line 419, in save_reduce
    save(state)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 548, in save_tuple
    save(element)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 649, in save_dict
    self._batch_setitems(obj.iteritems())
  File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems
    save(v)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 748, in save_global
    (obj, module, name))
pickle.PicklingError: Can't pickle <built-in method recvfrom_into of _socket.socket object at 0x020C94A0>: it's not found as __main__.recvfrom_into
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Python27\lib\multiprocessing\forking.py", line 381, in main
    self = load(from_parent)
  File "C:\Python27\lib\pickle.py", line 1378, in load
    return Unpickler(file).load()
  File "C:\Python27\lib\pickle.py", line 858, in load
    dispatch[key](self)
  File "C:\Python27\lib\pickle.py", line 880, in load_eof
    raise EOFError
EOFError

Answer 1

在Windows中，multiprocessing使用pickle在进程间传输对象。无法 pickle 套接字对象，因此出现了您看到的问题。

您的代码在 Linux 中确实有效，这是因为 multiprocessing 在该平台上使用 fork。分叉进程的子进程继承父进程的文件句柄，其中一个是套接字。

不清楚您要达到什么目的。您可以将主机名和端口信息传递给子进程，并让它创建自己的套接字。

您还应该能够使用 threading 而不是 multiprocessing。

如何通过 python 多进程粉碎套接字对象？它引发了 EOFError

How can I shred socket object over python multiProcess? It raises EOFError

python

sockets

multiprocessing