aliyun / oss-emulator Goto Github PK

View Code? Open in Web Editor NEW

57.0 7.0 22.0 32 KB

OSS Emulator

License: MIT License

Ruby 100.00%

oss-emulator's Introduction

Aliyun OSS Emulator

关于

oss-emulator 轻量级的OSS服务模拟器，提供与OSS服务相同的API接口。

使用场景

基于OSS应用的调试，甚至无网络环境下也可以调试基于OSS的应用；
基于OSS应用的性能测试，节省大量费用；

支持接口

oss-emulator 支持 put, get, list, copy, delete, multipart 等数据操作API接口，支持部分Bucket操作接口。

Bucket相关接口

支持

ListBuckets(GetService),PutBucket(CreateBucket),GetBucket,DeleteBucket,
GetBucketLocation,GetBucketInfo,PutBucketACL,GetBucketACL

不支持

PutBucketLogging,PutBucketWebsite,PutBucketReferer,PutBucketLifecycle,
GetBucketLogging,GetBucketWebsite,GetBucketReferer,GetBucketLifecycle,
DeleteBucketLogging,DeleteBucketWebsite,DeleteBucketLifecycle

Object相关接口

支持

PutObject,CopyObject,AppendObject,GetObject,DeleteObject,DeleteMultipleObjects,
HeadObject,GetObjectMeta,PutObjectACL,GetObjectACL

不支持

PostObject,Callback,PutSymlink,GetSymlink,RestoreObject

Multipart相关接口

支持

InitiateMultipartUpload,UploadPart,CompleteMultipartUpload

不支持

UploadPartCopy,AbortMultipartUpload,ListMultipartUpload,ListParts

环境

Ruby 2.2.8及以上

安装

安装运行 oss-emulator 前，请确保已经安装 Ruby。

Linux

安装依赖

    sudo gem install thor builder

下载 oss-emulator
运行。进入 oss-emulator 目录, 执行命令 ruby bin/emulator -r store -p 8080。

Windows

安装依赖

    gem install thor builder

下载 oss-emulator
运行。进入 oss-emulator 目录, 执行命令 ruby bin/emulator -r store -p 8080。

使用示例

ossutil

方法一：直接在命令行中携带参数, 其中endpoint设置为oss-emulator的IP; AccessKeyId和AccessKeySecret如下, 也可以不填。如：

    ossutil -e http://192.168.0.1:8080 -i  AccessKeyId -k AccessKeySecret ls oss://bucket

方法二：使用 ossutil config 命令配置参数，参数配置和 方法一 相同：

    ossutil config

提示：

ossutil文档请参考官网

Python SDK

Python SDK 连接 oss-emulator 代码的如下, 其中endpoint设置为 oss-emulator 的IP, AccessKeyId和AccessKeySecret如下, 也可以不填。

    import oss2

    auth = oss2.Auth('AccessKeySecret', 'AccessKeySecret')
    bucket = oss2.Bucket(auth, 'http//:192.168.0.1:8080', 'MyBucketName')
    bucket.create_bucket()

提示：

Python SDK的说明文档请参考官网

oss-emulator's People

Contributors

Stargazers

Watchers

Forkers

djyin4op szewec cxmlg woeoio luluhongxu lornezhang66 kph11 yuanzhubi cbpu weiliang-ms liulp teozhanggg teocheung thorntechpublic

oss-emulator's Issues

当Ruby低于2.2.8时，一启动就报错退出，给出的错误信息，看不出到是ruby版本过低的问题

当Ruby低于2.2.8时，一启动就报错退出，给出的错误信息，看不出到是ruby版本过低的问题。可以直接在程序里判断ruby版本号是否大于等于2.2.8，如果低于，就给出明确的版本过低报错并退出。

Address error in README.

  import oss2

   auth = oss2.Auth('AccessKeySecret', 'AccessKeySecret')
   bucket = oss2.Bucket(auth, 'http//:192.168.0.1:8080', 'MyBucketName')
   bucket.create_bucket()

http//:192.168.0.1 -> http://192.168.0.1

为什么文件能够上传,可是读取列表的时候跟拉文件的时候就会报错

in `require': cannot load such file -- webrick (LoadError)

When using ruby 3.0.2p107 (2021-07-07 revision 0db68f0233) [x86_64-linux-gnu] in Ubuntu 22.04 this error is thrown:

$ ruby bin/emulator -r store -p 8080
internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb:85:in require': cannot load such file -- webrick (LoadError) from <internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb>:85:in require'
from /gnt/oss/oss-emulator/lib/emulator/server.rb:2:in <top (required)>' from <internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb>:85:in require'
from internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb:85:in require' from /gnt/oss/oss-emulator/lib/emulator/cmdline.rb:2:in <top (required)>'
from internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb:85:in require' from <internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb>:85:in require'
from bin/emulator:6:in `

This is caused because ruby 3.x does not include webrick anymore.

The solution is to install it as a dependency:

sudo gem install thor builder webrick

listObject 性能问题.

使用 ossutil64.exe -e http://127.0.0.18080 -i AccessKeySecret -k AccessKeySecret ls oss://kraken-house/sh/2018/0417/mktdt00.txt/1400/
查询需要60-80秒

使用 ossutil64.exe -e http://127.0.0.1:8080 -i AccessKeySecret -k AccessKeySecret cp oss://kraken-house/sh/2018/0530/mktdt00.txt/1400 ./tmp/2018/0530/mktdt00.txt/1400 --update --recursive
也需要60-80秒.

运行环境是 windows 物理机 24C64G