oursky / aws-site-manager Goto Github PK

Instead of doing parallel upload / download in our own code and handle pagination properly

https://docs.aws.amazon.com/sdk-for-go/api/service/acm/#RequestCertificateOutput

Add a new option to use Cloudfront compressing options, when enabled configure Cloudfront to enable gzip, and avoid gzip on S3.

Okay this is my first Go code :(

Points to consider:

• Using filename / query string versioning is better, shall we do it in this script?
• According to http://docs.aws.amazon.com/AmazonCloudFront/2012-05-05/DeveloperGuide/Invalidation.html , We should invalid different url encoding (such as + vs %20 for space) and with trailing slash and without.
• Handle > 1000 paths to send multiple invalidation request.

Now it is true by default but not mentioned in help text.

Add a new option, when enabled, set up another S3 bucket to redirect www.hostname.com to host name.com

panic: EOF

goroutine 36 [running]:
panic(0x476300, 0xc420014130)
/usr/local/Cellar/go/1.7.1/libexec/src/runtime/panic.go:500 +0x1a1
main.CheckErr(0x7a1ee0, 0xc420014130)
/Users/chpapa/Workspace/go/src/github.com/oursky/aws-site-manager/main.go:33 +0x5c
main.UploadFileHandler(0xc4203b06c0, 0xc42006c180, 0xc4203e2b80, 0xc420142110, 0x10, 0xc42002a0a8, 0x171800, 0xc42006c240)
/Users/chpapa/Workspace/go/src/github.com/oursky/aws-site-manager/sync.go:190 +0xb9c
created by main.Sync
/Users/chpapa/Workspace/go/src/github.com/oursky/aws-site-manager/sync.go:81 +0x3cf

My env is go1.7.1
Installed using

go get -u github.com/oursky/aws-site-manager
go install github.com/oursky/aws-site-manager

Running aws-site-manager sync --domain xxx.oursky.com result in following logs
Log: https://gist.github.com/rickmak/71466a9fa12d46b0f0ba186ef40c8644

Expect a proper error rather than this trace.

If Dry Run is true, should display description of what will happen if the command run, instead of calling the AWS api.

For usage of non cloudfront cases.

aws-sdk-go have been annouced officially and we should use the new SDK.

Should be two options:

1. Disable compress on S3 side
2. Disable compress on DefaultCacheBehavior of Cloudfront

Use some other's existing tools?

Want to have:

• Invalidate files on CloudFront
• Gzip files automatically

Follow up #32 after I correct the credentials.

Got this log: https://gist.github.com/rickmak/6e40921047c6206b2a5d3807039da195

AWS provide the API getting the s3 bucket location

for example in aws cli, we can query the bucket region by this: aws s3api get-bucket-location --bucket domain.oursky.com

Save the config to .aws-site-manager-sync, and if users provide no parameter, will use the same parameter as last time to sync.