你可以选择 boto3 s3 协议吗?
can you choose the boto3 s3 protocol?
显然,普通的 s3uri 协议几乎已被弃用。这是boto3使用的吗?我们可以 select s3n 或 s3a 哪个是新的首选方法?
来自 AmazonS3 wiki:
A block-based filesystem backed by S3. Files are stored as blocks, just like they are in HDFS. This permits efficient implementation of renames. This filesystem requires you to dedicate a bucket for the filesystem - you should not use an existing bucket containing files, or write other files to the same bucket. The files stored by this filesystem can be larger than 5GB, but they are not interoperable with other S3 tools. Nobody is/should be uploading data to S3 via this scheme any more; it will eventually be removed from Hadoop entirely. Consider it (as of May 2016), deprecated.
作为后端 boto3 使用 AWS S3 Rest API:
http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html
这是目前唯一可用的选项。
如果您不喜欢 boto3 的工作方式,请考虑编写您自己的请求。
显然,普通的 s3uri 协议几乎已被弃用。这是boto3使用的吗?我们可以 select s3n 或 s3a 哪个是新的首选方法?
来自 AmazonS3 wiki:
A block-based filesystem backed by S3. Files are stored as blocks, just like they are in HDFS. This permits efficient implementation of renames. This filesystem requires you to dedicate a bucket for the filesystem - you should not use an existing bucket containing files, or write other files to the same bucket. The files stored by this filesystem can be larger than 5GB, but they are not interoperable with other S3 tools. Nobody is/should be uploading data to S3 via this scheme any more; it will eventually be removed from Hadoop entirely. Consider it (as of May 2016), deprecated.
作为后端 boto3 使用 AWS S3 Rest API: http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html
这是目前唯一可用的选项。
如果您不喜欢 boto3 的工作方式,请考虑编写您自己的请求。