google / shifter Goto Github PK

View Code? Open in Web Editor NEW

41.0 8.0 22.0 38.58 MB

Shifter - OpenShift workloads to GKE/Anthos

Home Page: https://shifter.cloud

License: Apache License 2.0

Makefile 0.62% Go 42.19% Shell 6.90% Dockerfile 0.90% JavaScript 12.81% HTML 0.35% Vue 25.05% CSS 0.91% HCL 10.26%

anthos gke k8s kubernetes openshift migration application google-cloud-platform google-kubernetes-engine

shifter's Introduction

Shifter - Openshift to Kubernetes Migration Accelerator

Shifter is a tool which accelerates the migration from OpenShift 3.x / 4.x by translating the applications for Kubernetes, GKE & Anthos and supports migrating to Service Mesh with ASM + Istio Support.

Capabilities

Convert existing manifest files from OpenShift to Kubernetes.
Convert or extract manifest files from a running OpenShift cluster.
Run locally via a CLI tool or deploy a web-based user interface.
Convert OpenShift routes/networking to Google ILB/ELB or Istio/ASM virtual services + gateway creation.
Convert OpenShift templates to helm charts.
Convert ImageStreams to Images + Modify on the fly the Container Registry source.
Use GCS Buckets as the source/destination.

Issues and Feature Requests

If you have issues or would like to see some functionality added please raise a issue via Github Issues: https://github.com/google/shifter/issues

For issues please indicate:

Your operating system and version.
Your OpenShift cluster version.
Attach a copy of the manifest (if possible).
Attach a copy of the log output (if possible).
Detail the issue or feature in as much detail as possible.

Contributing & Development

If you have improvements or fixes, we would love to have your contributions. Please read CONTRIBUTING.md for more information on the process we would like contributors to follow.

For development see DEVELOPMENT.md for details on pre-requisites and style guides.

Components

Shifter can either be ran via the command line or via a web ui front end.

Shifter Core (CLI & API Server)

Provides the backend service required by the front-end application and also provides the CLI tooling if the front-end web interface is not required.

Documentation

Read the detailed documentation at shifter/README.md

Demo

Shifter UI

Provides a front-end application written in Vue that connects to the Shfiter API's, for more information see shifter-ui/readme.md

Releases

Binaries - https://github.com/google/shifter/releases
Shifter Core Docker Image - docker pull images.shifter.cloud/shifter:latest
Shifter UI Docker Image - docker pull images.shifter.cloud/shifter-ui:latest

Run Shifter

Run The Latest Shifter Version Locally with the UI

Get the Source & Run Latest Docker Release

git clone https://github.com/google/shifter 
cd shifter
docker-compose -f docker-compose.yml up

Open a browser and go to http://localhost:9090

Run The Latest Shifter Version Locally wth the CLI

Run the Latest Docker Release (With List Action)

export CLUSTER_ENDPOINT="https://console.okd.<CLUSTER_DOMAIN>:8443"
export BEARER_TOKEN="<BEARER_TOKEN>"

docker run \
images.shifter.cloud/shifter:latest \
./shifter cluster -e $OKD_ENDPOINT -t $OKD_TOKEN list --all-namespaces

Run the Latest Docker Release (With an Export Action)

export CLUSTER_ENDPOINT="https://console.okd.<CLUSTER_DOMAIN>:8443"
export BEARER_TOKEN="<BEARER_TOKEN>"

docker run \
-v 'pwd':/output \
images.shifter.cloud/shifter:latest \
./shifter cluster -e $CLUSTER_ENDPOINT -t $BEARER_TOKEN export --all-namespaces /output

Stargazers over time

shifter's People

Contributors

Stargazers

Watchers

shifter's Issues

source-path and output-path options are not available in this latest version local CLI option

I checked and found that source-path and output-path options are not available in this latest version local CLI option.
please add both options, so that I can use it to convert the files from local system using CLI

below are the reference option in from "./shifter convert" command:

-f, --source-path
-o, --output-path
-t, --output-format

--
Regards,
Himanshu Gaur

strategy parameters not available after converting the file via shifter

I`m facing an issue at the time of converting template to helm .

Issue: shifter is not taking care the "strategy" .

I`m sharing the strategy parameters from source-file and output-file

strategy parameters from source file:

strategy:
activeDeadlineSeconds:
resources: {}
rollingParams:
intervalSeconds:
maxSurge: %
maxUnavailable: %
timeoutSeconds:
updatePeriodSeconds:
type:

strategy parameters from output file:

strategy: {}

Please help to fix this issue or suggest for taking care it.

--
Regards,
Himanshu Gaur

BUG: RSA PRIVATE KEY was publicly exposed

Hi team, Hope you are doing well :)

I have found a bug in your repository: https://github.com/google/shifter/blob/173d6574b6010af21910f0f7ca9c43879b8720d0/okd-cluster/4.x/02-appdeployment/bank-of-anthos/kubernetes-manifests/jwt/jwt-secret.yaml

As it was ENCODED here in the form of
jwtRS256.key: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlKS3dJQkFBS0NBZ0VBNEd2Wk5Ta2o1aWlXYjJEWk0yZkN4NWJHR1lnd2FLNFNNc3lJOEs4b0ZRZXBMMTNZClJPWEt3NVMrbEVMSDlBZXRUZGNUQWRrYkN6eWFwU2RrM1Bxd3hoQ2FmNGtudktlUmk3NmNzRzZtYzBrcngxR0kKdFk2NVgrTnEwcWFSdkxkT09iRlFHbUlIeDc1emtaNjU0K2Z0dm52Q1k1T1BqVjQ0TGt0dTF3bHJCbXIyMjVRUwpGYklhOEE5NkJTcEp6S20wYWhLKzZyOFZ2dk9xMUJIR1pJSUtLR1E3L3pMdXhQT24rYzN3Q0YwVlFZMjBZNFhvCm8rRFZ0LyswTUk4T1p2ZEF1YWIyVVh1YitUaXdBZ0c3Njh5bkpQaDdla2xMdGR0QTFCR2dsWG1vRVI0eHZoaFgKUXNPUnRUaTYwRlpQWDdDM1YxcmxVZStyVTlCWTZDbHJXbGVKdGdCZjFYUi90Qm1MZGZCNFlWbkt0ekI3dkxDbApPS3VsdGFkdVNWbmZ2OEMwdXoxelBCWkl3WG5zVk83WHlTVlBBSkJUOFBWR1Iza2JnOW5FRGsvclZsS1lNSW5EClNPOFNITnlLTytrNnBUaG1hbW9xTUJKQkNwY0MrRzFVUFVxWWV1Szh3NjZaU3BLV2ZQY3RtWWViUHNraUpiS2UKT3JIVlUyRGo3enpkaW1MMmJlaHFTd1NpM3pBa2xXZjRGU0F6aC80enBENFdxM0lDd2NYbFBxYTU5T0IwcXFBQwp4NUFtRUZsdlF1VUkwcTZ3WjZ2cmxBWUsrTWRtNER2RkFVbFhzNW1mbDZPRnZ0YkZTZHF1ckU2SXROVnlSVlFBCmx6WFdtaEM4R3JXQklodDFPSkxXREtPNWx2Wm1KUS9sazdic1VyNCsyK05ObnNzTXBuTUI2QytJejZzQ0F3RUEKQVFLQ0FnRUFoQ0c3ZnpzN3NiVlA3VCsrWWkvRFZMUUc2dDF1Y3hPYUQyS3hkZFFLNjJiWlM5UWJFMldnWGtyagpjbk5uT3R5U1F2UlFjcFFiQWlDcWhIYVBRalF2aEU0ZVNOeStFcXN1WEhMYjJsMHJqMUVUZjRVWDBwMjNzeWM0CnE5SDZtSHZzaUxkSERHR1BaeUZROWZuWVJNRTNEeUhhcjdvZm1RSlNYWjk0SVErZ2ZlVFlkeXZWQWdVZEt4NVIKbjF6b21xR0lZYk9yeUphOC9QS0dMOXBQVHJucHRTSmUyTUJxS0hlMC9MVXRrQjhOOXN5eDJxN3E3Q0hpY3pVUQpLRTd5RWRtZHVERC9jYll2ZlNyTkprRlRIV0FmUVBzejZDbmpjNjBsbkRiTXIzVXphUEM0Sk00OEFra1hMdlc1CnVCUTVJNFB1VG5acjhqUUVVWktuNWZrTkJlSG9aNjlZVVp2eWdOcGJRaVMxWi9CRzYwVDVZN1VPY09wWVJ2bCsKL0dSNUFSNnpZQVJKbTBKNmg3U2NsdGhLSjdaVnFldWV5U3B1UG9mTjg0V241Zm1mbWdsR2F0dlc4KzFGR2ZNRQppWGxHbzhHQ1ZyampzN013a0pMT3Jlc0lRblFWK3ZmWC95Nk9WRExMS21yeGJCT3BPcm5TK01icnFoOXBsRGFICks1N0VOVngzWWxVd2M3bFRHd2Q2cS9nVnhSWDZRc1F3VEl5UHVOOUozMWd0dXRCeS9FTVVGc1hJenJhRmRIQzgKZXVlT1N3V0JQT05XbUkzN1BCVTIycXFyMWE3d1Y3Z0lJOGg3WS8waDNDYjFYWjZsQ2FzOCt0emI3VFZNMGxWQwpINWNYaXRqM2xKS1B1b2VzOXpTNFhEQjQ0V1hwZkw4SFVXQ1NuSWF2ZVJYUHhwbDRJbUVDZ2dFQkFQMjJEZml3CmVaRDBSTzlManJSR2cxODJlNnNSZ052VUQrOTFjUnBRNFBDcnlKQm1tTmNWOFBNZVdoZFlPaHdCWW1JMjkyWkkKcjFyeHVwclBCdE43dTNnWmhKYkVXL1IvSFozc2lPSmNycHlhejBVNUpDSzRTOERSbkdnUUdOQUdJNFlsVUNxNwpLL2JOa0JLcnRpSEVpOWV6RGQ3SjIrRGJGK0FiSXNWdlNnNnNHdEp1TG8rY0VRUzFaNzkycTQ5NUt6dWJyUDhvClVIbWFuc1R1ZEtLL1lZY0dlcU9pS2V0bmgrK0ZUc0hXek1NTEJ3VllySVlZRHZ5RWUvZEFkNWUzM3ZTRSsrbXkKZEVaVkZidVRMQmdzSW4wM0dmZ1pnNE56QkNhSm9NZGJtU3NiaUxGMkRTL1g4eXNKNldLYzdVTFMwMXJwSjBLTgo0VldQNjhiZlZOd1YwbmtDZ2dFQkFPSnlKaVN5aGJrL1hEVjRzT2ZLS1BBQ3RJTkN0ZWk2OWpYVVVOUHNhQndNCjFMNURCOU5tNjhLb3piVTN1Rk9QbmRPZERrMms5cm5WS1JkSlYrTHhPQ2NEdE5aMzlGQ3JtbUs3TGc4TnBUM2cKVksxc29YamFtcGI3NU1LWjZzaGFIUDRFUUMvTVVoeVF1UXkydEtUS3JMYUNFRmdzR1RhRHFaOU9xMVdIZzhWNwoxdUkzak8xYnNzNFRQWjJxbXVOYjE0WEMzQnJaeDE4eWY3MnJZMEk5RTAxdXorUmp4VUdSK0E3dlloSklYVWtMCmtzQTJqV1ludktsVmZRRWJpWlVpcjQ0d2IraEZ4Z3JwcVBvSmNCTzgvdS9UYXZ3MjFqbjFkRys3NWZqZnI5M3UKRjExbUh2VVY2Z0RJenN4NDVicDVDek5oUmdTTHNRZk9INFdpdytIcUNrTUNnZ0VCQU1UZGtFZkpmL3IzWDhvaQo0ZStHeTRlRStqOEtqT2VHekhxdHNYNlBCWXdhYjcyRXJ0SXV4MUdPMnE5RW1ZcURsSGpMVi9zNUtVQXpVKzJ0CitRaisrTCsvWlQrcnpBS1M1RU5YZC92Vm1QUVJ1QVZweWwxYWpnVm5ZS3JxMnFZSUxXWjQ2NVRNdWRkL09HMFUKYW5ZWFViK2t3MzE5T3ExbXRFY0VKMTMxOWd3ZWhZMkZTNEhKd3ZiWllGQ1QzNW1ybHQxZzljTGo0RllMb1drRAo4dU1hQjY1RFc4US9IN0gzR3ViRGxSSVovN2JVaHJVaVVuU1dsSUppdHVKclZxRVdYdDF6bHhtR2pHekt0dHRlCjNwYy9IOS96Y3FZdC9mdHdzdWJJWWtadkVCSUFBbmhaTnZCSjYva1liczFESVdONXZlRE1DOWU3eWY2ZmQzOVEKYWtPQWQxa0NnZ0VCQUpCQ2RraFVydHBJSWg4eWgwanpRa2M5QWZESlZBZ3k2MTE1cUJDS2YveTJzK1dONEhOdQpFdTROQ2hmVHFvc1phRXVDdDdVQlRla3ZnaUVDcVltN2NMRnlMQWVobmJTeXpnVHVDRGF3MDc5cXBhZGlHREJjCjI3VXFQaDgzWFJwTVJrSVJSUzd1TkxWY0FYZTNBYmdtSWdlWExvQnRmNVo2SkZxSURLRE5WMFk5VWJVRi9MTE8KQTBoRGU3SnhHSUdWWmVVaU1ZU3RqdFQzMytkZVF6clVtL0p0a09XSUpnZFN6YnYrQnZWc3dua2hkVmtjcDlJWApxSm9jQ3lua2VDN1pUUXdCa1psZ3NmMEx4SW1kNzVlemhKb1dqd2FraksrWnpwYk1Gb01KUmduVmYyOFIrdERhCktCeGQwVmowQUM1ZXBLTVQ2ajVGRy8vRDhkTDUwVjZmOGU4Q2dnRUJBTWgreklJb3FKZWlXTGgzOUFtTTRQZEkKSFNod0lISXBUNUhGS05jOTFzRnRDZFdXVDIweXVPZHNLZU9TTDZjMjJsVFpjcklFZFlDY0Q5SVhyWm8xVmxXOAorSGFmNDFhcHhlaU1PZVBNR3ZlNEQ2ZEdrUXcyWXBuNXlOQUUwYk1qa1hFU3JuMzMvV3JqSFFtWFdvNmFSdnVZCnkrMktzbGwvK1BzajlwNXd3WVYxRGp0QzFXU0lmdFZNMkJuRlViQVVyMmNHSVNXWlNnWU9yUDU1elZKK3REeloKSXhrMDZ6TUNZU3pEL1pPTUJZSjUvTFFPWnlPUUs0R2xnMytUUUNXUERHNTRtUEo0dElmNUZCZ25wSU5QRGNLQwpLc2RTQlg4S0xNeU83aEVzOCtuZFRWNWlxa0pscGNCdVJ3VXVUSmlFakc0MWZnaXZPVThTR0V5elZPbW1NNG89Ci0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg==

After doing Base64 decode I got the RSA PRIVATE KEY

Impact:

RSA private key is used to generate digital signatures, and the RSA public key is used to verify digital signatures. The RSA public key is also used for key encryption of DES or AES DATA keys and the RSA private key for key recovery.

Shifter UI Colours incorrect in Chrome on Gnome GTK

Using the latest (as of issue) Google Chrome on linux gives incorrect colour profile, colours work as expected in Firefox

Linux build tested: Arch with Linux kernel 5.19.5
Gnome 42.4
Window Server : X11
Chrome version: 104.0.5112.101

Rename label deploymentconfig to deployment

Though this is unnecessary and may not be relevant but if we see a label with a key deploymentconfig, would it make sense to rename the key to deployment?

Please feel free to close this without if you think this is not relevant at all.

Output filenames malformed

Output filenames are malformed in the format of .yaml.yaml etc.

BUG: Sensitive JDBC data was exposed publicly

Hi team, Hope u doing well :)

I have found a bug or we can say it's an issue that sensitive data was exposed publicly which causes a high advantage to an attacker.

Because JDBC is an application programming interface (API) for the programming language Java, which defines how a client may access a database. It is a Java-based data access technology used for Java database connectivity. It is part of the Java Standard Edition platform, from Oracle Corporation.

For an attacker, it becomes easier to access the database belonging to this repository

terminal stuck after executing the command sh build-deploy-local.sh

logs:

,[re(s,{to:"/"},{default:De(()=>[uf]),:1}),re(s,{to:"/about"},{default:De(()=>[ff]),:1}),af])])]),re(of)],64)}}}),pf=wu({history:jc("/"),routes:[{path:"/",name:"home",component:hf},{path:"/about",name:"about",component:()=>Bn(()=>import("./AboutView.8e100392.js"),["assets/AboutView.8e100392.js","assets/AboutView.ab071ea6.css"])},{path:"/status/healthz",name:"healthz",component:()=>Bn(()=>import("./HealthzView.39e8f622.js"),["assets/HealthzView.39e8f622.js","assets/HealthzView.dedbb70f.css","assets/index.15c82977.js"])},{path:"/status/settingz",name:"settingz",component:()=>Bn(()=>import("./SettingzView.47290ae2.js"),["assets/SettingzView.47290ae2.js","assets/SettingzView.64984f6c.css","assets/index.15c82977.js"])}]});const mf="http://localhost:9091/api/v1";var gf={SHIFTER_SERVER_ENDPOINT:mf};const Gt=hc(Ru),_f=gc();Gt.config.globalProperties.$shifterConfig={API_BASE_URL:gf.SHIFTER_SERVER_ENDPOINT};Gt.use(_f);Gt.use(pf);Gt.mount("#app");const Ef=Gt.config.globalProperties.$shifterConfig;export{wr as D,In as _,ue as a,vf as b,at as c,bf as d,bo as e,re as f,Uu as g,Ce as h,yf as m,We as o,Ef as s,Qo as t,xt as u,De as w};
shifter_server_development | [GIN] 2022/06/06 - 17:46:58 | 404 | 3.75µs | 172.19.0.1 | GET "/"
shifter_server_development | [GIN] 2022/06/06 - 17:47:13 | 404 | 1.389µs | 172.19.0.1 | GET "/"
shifter_server_development | [GIN] 2022/06/06 - 17:47:59 | 404 | 6.4µs | 172.19.0.1 | GET "/"

https://shifter.cloud/

When using UI to convert from Openshift to Kubernetes getting constant error

Error during conversion (from cli) when the output format of helm is chosen

Issue - When shifter was run from the cli (command and output below), with the '-o helm' argument, it panics with an exit code 2.

Environment details -

OS - Amazon Linux 2, go version go1.19.9 linux/amd64

Running shifter locally via cli

Input manifest - ./_test/yaml/multidoc/os-nginx.yaml

I am using the latest release of shifter.

=================== Output log below ==============================

[root@ip-10-2-3-65 shifter]# go run shifter convert --output-format helm -i yaml ./_test/yaml/multidoc/os-nginx.yaml ./out/
2023/07/28 16:50:19

/ // / () / /_ _____
__ / __ / / // __/ _ / /
/ / / / / / __/ // __/ /
/// //// _/___//

goroutine 1 [running]:
reflect.Value.call({0x1a2b0c0?, 0x2d76b88?, 0x0?}, {0x1c30b10, 0x4}, {0xc0005c6ae0, 0x2, 0x1f530c8?})
/usr/lib/golang/src/reflect/value.go:427 +0x1b5a
reflect.Value.Call({0x1a2b0c0?, 0x2d76b88?, 0x2d45a80?}, {0xc0005c6ae0?, 0x0?, 0x19296e0?})
/usr/lib/golang/src/reflect/value.go:368 +0xbc
shifter/generator.NewGenerator({0x7ffc2624677b, 0x4}, {0xc00053fbc8, 0x2, 0x0?})
/root/shifter/shifter/generator/generator.go:37 +0x20f
shifter/ops.(*Converter).ConvertFiles(0xc000495860)
/root/shifter/shifter/ops/convert.go:141 +0x1d1
shifter/cmd.glob..func5(0x2d27e60?, {0xc00040a9c0, 0x2, 0x6?})
/root/shifter/shifter/cmd/convert.go:79 +0x3ac
github.com/spf13/cobra.(*Command).execute(0x2d27e60, {0xc00040a960, 0x6, 0x6})
/root/go/pkg/mod/github.com/spf13/[email protected]/command.go:876 +0x67b
github.com/spf13/cobra.(*Command).ExecuteC(0x2d280e0)
/root/go/pkg/mod/github.com/spf13/[email protected]/command.go:990 +0x3bd
github.com/spf13/cobra.(*Command).Execute(...)
/root/go/pkg/mod/github.com/spf13/[email protected]/command.go:918
shifter/cmd.Execute()
/root/shifter/shifter/cmd/root.go:46 +0x25
main.main()
/root/shifter/shifter/shifter.go:20 +0x17
exit status 2
[root@ip-10-2-3-65 shifter]#

add unit tests for `apps.go` and `build.go`

I would like to add unit tests for shifter/openshift/apps.go and shifter/openshift/build.go