boto 内部的奇怪行为 docker
Weird behaviour of boto inside docker
我是运行以下image:
docker run -it --rm python:3.4-slim /bin/bash
里面（如root），我安装了：
root@dab02ca9c61d:~# apt-get update && apt-get install nano
然后是boto
root@dab02ca9c61d:~# pip install boto
然后我在/root/.boto中写了如下内容：
[Credentials]
aws_access_key_id = some_long_string
aws_secret_access_key = another_bigger_string
[Boto]
debug = 2
num_retries = 10
（这个文件和我主机上的一样）
版本是：
root@dab02ca9c61d:~# python -V
Python 3.4.4
root@dab02ca9c61d:~# pip list
boto (2.38.0)
pip (7.1.2)
setuptools (18.2)
root@dab02ca9c61d:~#
（与我的 host/local 机器中的完全相同）
如果我启动 python 控制台：
root@dab02ca9c61d:~# python
Python 3.4.4 (default, Jan 8 2016, 00:24:55)
[GCC 4.9.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import boto
>>> boto.connect_s3()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
validate_certs=validate_certs, profile_name=profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 569, in __init__
host, config, self.provider, self._required_auth_capability())
File "/usr/local/lib/python3.4/site-packages/boto/auth.py", line 987, in get_auth_handler
'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials
>>>
如果我激活日志记录：
>>> boto.set_stream_logger('boto')
>>> boto.connect_s3()
2016-01-11 01:53:23,577 boto [DEBUG]:Using access key found in config file.
2016-01-11 01:53:23,577 boto [DEBUG]:Using secret key found in config file.
2016-01-11 01:53:23,577 boto [DEBUG]:Retrieving credentials from metadata server.
--- Logging error ---
Traceback (most recent call last):
File "/usr/local/lib/python3.4/logging/__init__.py", line 978, in emit
msg = self.format(record)
File "/usr/local/lib/python3.4/logging/__init__.py", line 828, in format
return fmt.format(record)
File "/usr/local/lib/python3.4/logging/__init__.py", line 573, in format
record.exc_text = self.formatException(record.exc_info)
File "/usr/local/lib/python3.4/logging/__init__.py", line 523, in formatException
traceback.print_exception(ei[0], ei[1], tb, None, sio)
File "/usr/local/lib/python3.4/traceback.py", line 169, in print_exception
for line in _format_exception_iter(etype, value, tb, limit, chain):
File "/usr/local/lib/python3.4/traceback.py", line 146, in _format_exception_iter
for value, tb in values:
File "/usr/local/lib/python3.4/traceback.py", line 125, in _iter_chain
context = exc.__context__
AttributeError: 'NoneType' object has no attribute '__context__'
Call stack:
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
validate_certs=validate_certs, profile_name=profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 555, in __init__
profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 200, in __init__
self.get_credentials(access_key, secret_key, security_token, profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 376, in get_credentials
self._populate_keys_from_metadata_server()
File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 391, in _populate_keys_from_metadata_server
data='meta-data/iam/security-credentials/')
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 394, in get_instance_metadata
return _get_instance_metadata(metadata_url, num_retries=num_retries, timeout=timeout)
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 234, in _get_instance_metadata
return LazyLoadMetadata(url, num_retries, timeout)
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 244, in __init__
data = boto.utils.retry_url(self._url, num_retries=self._num_retries, timeout=self._timeout)
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 224, in retry_url
boto.log.exception('Caught exception reading instance data')
Message: 'Caught exception reading instance data'
Arguments: ()
2016-01-11 01:53:24,582 boto [ERROR]:Unable to read instance data, giving up
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
validate_certs=validate_certs, profile_name=profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 569, in __init__
host, config, self.provider, self._required_auth_capability())
File "/usr/local/lib/python3.4/site-packages/boto/auth.py", line 987, in get_auth_handler
'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials
>>>
（这个例子在我的本地机器上运行）
我已经阅读了 Boto Credential Error with Python on Windows 和其他问题。没有任何效果。
之后，我查看了 boto.pyami 的源代码，如果我逐行执行，什么也没有。
例如：
>>> boto.config.sections()
['Credentials', 'Boto']
>>> boto.config.get_value('Credentials', 'aws_access_key_id')
>>>
注意最后一条命令returns None.
boto.config 使用 ConfigParser，如果我使用它，它会起作用：
>>> import configparser
>>> config = configparser.ConfigParser()
>>> config.read('~/.boto')
[]
>>> config.read('/root.boto')
['/root/.boto']
>>> config.get('Credentials', 'aws_access_key_id')
'some_long_string'
>>>
(注意如果我用相对路径是不行的)
最后如果我使用：
>> boto.connect_s3('some_long_string', 'another_bigger_string')
2016-01-11 02:05:33,636 boto [DEBUG]:Using access key provided by client.
2016-01-11 02:05:33,636 boto [DEBUG]:Using secret key provided by client.
S3Connection:s3.amazonaws.com
>>>
我又安装了一个 tests:I awscli 并且没有问题，将配置文件放在 /etc/boto.cfg 中但没有用。
我已经在这度过了整个周末，有什么想法吗？
由于我无法发表评论，所以我会把它作为答案，但不完全确定 docker 的问题是什么，但我也能够重现该问题。可能想在 boto 上提出问题，看看那里是否有人可以提供帮助。但是我能够通过设置环境变量 AWS_ACCESS_KEY_ID、AWS_SECRET_ACCESS_KEY 然后启动 python 来让它工作。不知道这是否有帮助，但只是想把它扔在那里，因为我花了一些时间看它。
我是运行以下image:
docker run -it --rm python:3.4-slim /bin/bash
里面（如root），我安装了：
root@dab02ca9c61d:~# apt-get update && apt-get install nano
然后是boto
root@dab02ca9c61d:~# pip install boto
然后我在/root/.boto中写了如下内容：
[Credentials]
aws_access_key_id = some_long_string
aws_secret_access_key = another_bigger_string
[Boto]
debug = 2
num_retries = 10
（这个文件和我主机上的一样）
版本是：
root@dab02ca9c61d:~# python -V
Python 3.4.4
root@dab02ca9c61d:~# pip list
boto (2.38.0)
pip (7.1.2)
setuptools (18.2)
root@dab02ca9c61d:~#
（与我的 host/local 机器中的完全相同）
如果我启动 python 控制台：
root@dab02ca9c61d:~# python
Python 3.4.4 (default, Jan 8 2016, 00:24:55)
[GCC 4.9.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import boto
>>> boto.connect_s3()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
validate_certs=validate_certs, profile_name=profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 569, in __init__
host, config, self.provider, self._required_auth_capability())
File "/usr/local/lib/python3.4/site-packages/boto/auth.py", line 987, in get_auth_handler
'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials
>>>
如果我激活日志记录：
>>> boto.set_stream_logger('boto')
>>> boto.connect_s3()
2016-01-11 01:53:23,577 boto [DEBUG]:Using access key found in config file.
2016-01-11 01:53:23,577 boto [DEBUG]:Using secret key found in config file.
2016-01-11 01:53:23,577 boto [DEBUG]:Retrieving credentials from metadata server.
--- Logging error ---
Traceback (most recent call last):
File "/usr/local/lib/python3.4/logging/__init__.py", line 978, in emit
msg = self.format(record)
File "/usr/local/lib/python3.4/logging/__init__.py", line 828, in format
return fmt.format(record)
File "/usr/local/lib/python3.4/logging/__init__.py", line 573, in format
record.exc_text = self.formatException(record.exc_info)
File "/usr/local/lib/python3.4/logging/__init__.py", line 523, in formatException
traceback.print_exception(ei[0], ei[1], tb, None, sio)
File "/usr/local/lib/python3.4/traceback.py", line 169, in print_exception
for line in _format_exception_iter(etype, value, tb, limit, chain):
File "/usr/local/lib/python3.4/traceback.py", line 146, in _format_exception_iter
for value, tb in values:
File "/usr/local/lib/python3.4/traceback.py", line 125, in _iter_chain
context = exc.__context__
AttributeError: 'NoneType' object has no attribute '__context__'
Call stack:
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
validate_certs=validate_certs, profile_name=profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 555, in __init__
profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 200, in __init__
self.get_credentials(access_key, secret_key, security_token, profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 376, in get_credentials
self._populate_keys_from_metadata_server()
File "/usr/local/lib/python3.4/site-packages/boto/provider.py", line 391, in _populate_keys_from_metadata_server
data='meta-data/iam/security-credentials/')
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 394, in get_instance_metadata
return _get_instance_metadata(metadata_url, num_retries=num_retries, timeout=timeout)
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 234, in _get_instance_metadata
return LazyLoadMetadata(url, num_retries, timeout)
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 244, in __init__
data = boto.utils.retry_url(self._url, num_retries=self._num_retries, timeout=self._timeout)
File "/usr/local/lib/python3.4/site-packages/boto/utils.py", line 224, in retry_url
boto.log.exception('Caught exception reading instance data')
Message: 'Caught exception reading instance data'
Arguments: ()
2016-01-11 01:53:24,582 boto [ERROR]:Unable to read instance data, giving up
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.4/site-packages/boto/__init__.py", line 141, in connect_s3
return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
File "/usr/local/lib/python3.4/site-packages/boto/s3/connection.py", line 190, in __init__
validate_certs=validate_certs, profile_name=profile_name)
File "/usr/local/lib/python3.4/site-packages/boto/connection.py", line 569, in __init__
host, config, self.provider, self._required_auth_capability())
File "/usr/local/lib/python3.4/site-packages/boto/auth.py", line 987, in get_auth_handler
'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials
>>>
（这个例子在我的本地机器上运行）
我已经阅读了 Boto Credential Error with Python on Windows
之后，我查看了 boto.pyami 的源代码，如果我逐行执行，什么也没有。
例如：
>>> boto.config.sections()
['Credentials', 'Boto']
>>> boto.config.get_value('Credentials', 'aws_access_key_id')
>>>
注意最后一条命令returns None.
boto.config 使用 ConfigParser，如果我使用它，它会起作用：
>>> import configparser
>>> config = configparser.ConfigParser()
>>> config.read('~/.boto')
[]
>>> config.read('/root.boto')
['/root/.boto']
>>> config.get('Credentials', 'aws_access_key_id')
'some_long_string'
>>>
(注意如果我用相对路径是不行的)
最后如果我使用：
>> boto.connect_s3('some_long_string', 'another_bigger_string')
2016-01-11 02:05:33,636 boto [DEBUG]:Using access key provided by client.
2016-01-11 02:05:33,636 boto [DEBUG]:Using secret key provided by client.
S3Connection:s3.amazonaws.com
>>>
我又安装了一个 tests:I awscli 并且没有问题，将配置文件放在 /etc/boto.cfg 中但没有用。
我已经在这度过了整个周末，有什么想法吗？
由于我无法发表评论，所以我会把它作为答案，但不完全确定 docker 的问题是什么，但我也能够重现该问题。可能想在 boto 上提出问题，看看那里是否有人可以提供帮助。但是我能够通过设置环境变量 AWS_ACCESS_KEY_ID、AWS_SECRET_ACCESS_KEY 然后启动 python 来让它工作。不知道这是否有帮助，但只是想把它扔在那里，因为我花了一些时间看它。