Git Product home page Git Product logo

cnstackcommunityedition's Introduction

CNStack社区版

简介

CNStack(云原生技术中台)是阿里云云原生最佳实践的输出载体。它可以在多云、混合云场景下集中纳管基础设施资源,统一编排和调度工作负载,帮助客户高效构建高性能、高可用、高可靠和安全合规的现代化应用,提升企业数字化转型的整体效能。

CNStack的目标是提供一个开放、共享、标准化的云原生生态系统,使企业能够更加轻松地构建和管理云原生应用,同时也促进了云原生技术的发展和普及。

CNStack从原先的容器平台产品升级成全栈的云原生技术中台产品。它创建了“云服务”,“云组件”的标准规范和支持这些标准规范的线上集成发布服务云原生交付平台ADP。“云服务”通过服务的形式提供能力扩展,使用CNStack提供的用户,租户,鉴权,审计,许可证,多集群部署,UI框架等基础能力,与既有能力或其他服务无缝的协作。目前,已发布的云服务包括:多集群管理,分布式应用管理、分布式存储、虚拟化服务、云边协同、服务网格等。更多的云服务会陆续发布。

CNStack社区版包括CNStack,多集群管理云服务,虚拟化云服务,云边协同云服务等。除了高可用部署模式外,CNStack 社区版提供了与商业版本一致的能力,包括“云服务”和“云组件”扩展。其他扩展平台能力的“云服务”也会有序放出。

产品优势

  • 安全可靠:采用 ACK Distro 作为 K8s 基础,核心组件来自公有云ACK并经历了线上、线下众多场景考验
  • 轻量方便:最小功能集可以运行在笔记本上。通过 sealer 进行打包和交付,仅需数分钟便可以完成部署
  • 体验一致:社区版与商业版同源,仅有高可用部署等部分差异。未来会有更多功能开放
  • 完整生态:“云服务”,“云组件”标准规范和线上集成发布服务云原生交付平台ADP提供灵活,方便的自助能力扩展
  • 迭代快速:版本节奏更快,更灵活,可以快速体验新功能
  • 兼容适配:通过网络插件hybridnet和本地存储插件open-local,最大限度适配多种基础设施。

产品部署

最小功能集,一键部署

环境要求:

  • 规格:master节点8C16GB,worker节点2C4GB
  • 磁盘:根目录80GB以上可用磁盘空间
  • OS:CentOS 7.9,Anolis 8.6
  • 架构:amd64,arm64

更为详细的环境要求请参考 ACK Distro环境要求

在master节点执行以下安装命令:

单节点,一键部署

# 获取sealer工具
ARCH=amd64 # or arm64
wget http://sealerio.oss-cn-shanghai.aliyuncs.com/releases/sealer-v0.9.3-linux-${ARCH}.tar.gz -O sealer.tar.gz && tar -xvf sealer.tar.gz -C /usr/bin

# 获取配置文件
wget http://ack-a-aecp.oss-cn-hangzhou.aliyuncs.com/cnstack-ce/clusterfile/cnstack-ce-v2-1-0-ce-4-clusterfile.yaml -O ClusterFile.yaml

# 示例IP:192.168.0.1(master内部IP)136.67.0.1(master外部IP)
sealer run -f ClusterFile.yaml -m 192.168.0.1 -p $passwd -e gatewayExternalIP=136.67.0.1 -e ingressExternalIP=136.67.0.1

多节点,master节点多IP环境,一键部署:

# 获取sealer工具
ARCH=amd64 # or arm64
wget http://sealerio.oss-cn-shanghai.aliyuncs.com/releases/sealer-v0.9.3-linux-${ARCH}.tar.gz -O sealer.tar.gz && tar -xvf sealer.tar.gz -C /usr/bin

# 获取配置文件
wget http://ack-a-aecp.oss-cn-hangzhou.aliyuncs.com/cnstack-ce/clusterfile/cnstack-ce-v2-1-0-ce-4-clusterfile.yaml -O ClusterFile.yaml

# 示例IP:192.168.0.1(master内部IP)136.67.0.1(master外部IP)192.168.0.2(worker1)192.168.0.3(worker2)192.168.0.4(worker3)
sealer run -f ClusterFile.yaml -m 192.168.0.1 -n 192.168.0.2,192.168.0.3,192.168.0.4 -p $passwd -e gatewayExternalIP=136.67.0.1 -e ingressExternalIP=136.67.0.1

# 查看App状态
kubectl get app -A

# 等待所有App的状态为Running

部署完成后,通过浏览器访问 https://$Master_IP_1:30383 即可以访问CNStack社区版的控制台(默认用户名:admin 默认密码:Ab123456)。

注意,上述命令安装了CNStack和多集群管理云服务,但是CNStack在各个纳管集群内的日志和监控组件默认没有安装,所以相关的管理页面会显示后端服务未准备好等错误信息。可以在平台管理的能力中心页面运维CNStack,更改数据面配置安装日志和监控组件。此外,制品管理能力需要对接第三方的Harbor服务。在CNStack社区版没有包含Harbor服务。

image

image

通过Clusterfile,实现高级配置

默认情况下,CNStack使用csi-hostpath作为其默认存储类,如果想让CNStack更好地管理它使用的磁盘,请按需准备好裸的数据盘(无需分区及挂载):

  • EtcdDevice: 分配给etcd的磁盘,容量必须大于20GiB,IOPS>3300,仅Master节点需要
  • StorageDevice: 分配给docker和kubelet的磁盘,容量建议大于200GiB
  • DockerRunDiskSize, KubeletRunDiskSize: 详见yaml说明

准备好磁盘后,配置您的ClusterFile.yaml文件

apiVersion: sealer.cloud/v2
kind: Cluster
metadata:
  name: my-cluster # 固定为my-cluster
spec:
  ...
  env: # all env are NOT necessary,所有的env变量都是非必填项
    # 需要自动安装的ACKDISTRO的组件,默认为空,支持ack-node-problem-detector,kube-prometheus-crds,paralb
    - Addons=ack-node-problem-detector,kube-prometheus-crds
    # 需要自动安装的CNStack组件,默认为空,支持logging,monitor
    - ComponentToInstall=logging,monitor # 需要默认安装的组件
    # 容器网络配置
    - PodCIDR=172.45.0.0/16,5408:4003:10bb:6a01:83b9:6360:c66d:0000/112 # pod subnet, support ipv6 cidr, must be dual stack cidr
    - SvcCIDR=10.96.0.0/16,6408:4003:10bb:6a01:83b9:6360:c66d:0000/112 # service subnet, support ipv6 cidr, must be dual stack cidr
    # 存储盘配置
    - EtcdDevice=/dev/vdb # EtcdDevice is device for etcd, default is "", which will use system disk
    - StorageDevice=/dev/vdc # StorageDevice is device for kubelet and container daemon, default is "", which will use system disk
    - YodaDevice=/dev/vdd # YodaDevice is device for open-local, if not specified, open local can't provision pv
    - DockerRunDiskSize=100 # unit is GiB, capacity for /var/lib/docker, default is 100
    - KubeletRunDiskSize=100 # unit is GiB, capacity for /var/lib/kubelet, default is 100
    # CNStack平台对外暴露方式的配置
    - gatewayExternalIP=${master0实例公网 EIP 或 Gateway SLB 对外IP,该地址要能够被您的浏览器访问到}
    - ingressExternalIP=${master0实例公网 EIP 或 Ingress SLB 对外IP,该地址要能够被您的浏览器访问到}
    - gatewayInternalIP=${master0内部ip 或者 Gateway SLB 内部IP}
    - ingressInternalIP=${master0内部ip 或者 Ingress SLB 内部IP}
    - gatewayExposeMode=ip_domain # 平台对外暴露模式,可配置为ip,ip_domain,domain,默认是ip_domain
    - gatewayPort=30383 # 对外暴露的CNStack平台管控的端口
    - ingressHttpPort=80 # 对外暴露的CNStack平台数据的端口(HTTP)
    - ingressHttpsPort=443 # 对外暴露的CNStack平台数据的端口(HTTPS)
  ssh:
    passwd: "password"
    #user: root # default is root
    #port: "22" # default is 22
    #pk: /root/.ssh/id_rsa
    #pkPasswd: xxx
  hosts:
    - ips: # support ipv6
        - 1.1.1.1
      roles: [ master ] # add role field to specify the node role
      env: # all env are NOT necessary, rewrite some nodes has different env config
        - EtcdDevice=/dev/vdb
        - StorageDevice=/dev/vde
      # rewrite ssh config if some node has different passwd...
      # ssh:
      #  user: root
      #  passwd: passwd
      #  port: "22"
    - ips: # support ipv6
        - 2.2.2.2
        - 3.3.3.3
        - 4.4.4.4
      roles: [ node ]

集群参数说明

  • gatewayExternalIP、gatewayInternalIP
    • gatewayExternalIP 表示 Gateway 外部IP,gatewayInternalIP 表示 Gateway 内部IP。
    • 默认为master0的地址。
  • ingressExternalIP、ingressInternalIP
    • ingressExternalIP 表示 Ingress 外部IP,ingressInternalIP 表示 Ingress 内部IP。
    • 默认为master0的地址。
  • gatewayExposeMode
    • 平台对外暴露模式,可配置ip,ip_domain,domain,默认是ip_domain。
    • 如果配置为ip,平台只能通过 gatewayExternalIP 和 gatewayPort 来访问。
    • 如果配置为domain,平台只能通过 gatewayDomain 和 gatewayPort 来访问。
    • 如配置为ip_domain,即为混合模式,可以通过 IP 或域名访问,通过IP或域名访问时,会共享Cookie,所以需要确保IP和域名都能访问。
  • PlatformCAPath、PlatformCAKeyPath
    • 用户自定义CA证书。可以是自签发的Root CA证书和Key,也可以是Intermediate CA(中间CA)的证书和Key。
    • 如果不配置,则会自签发Root CA,并可以在平台下载证书,用于系统信任证书。
  • gatewayDomain
    • 平台域名,默认为 cnstack.local
    • 会根据平台域名自动生成ingress的下级域名:ingress.${gatewayDomain}
  • gatewayPort
    • 平台访问端口,默认为30383。

配置完成ClusterFile.yaml后,执行sealer run命令安装CNStack社区版

# 运行sealer run命令
sealer run -f ClusterFile.yaml 

# 查看App状态
kubectl get app -A

# 等待所有App的状态为Running

节点角色规划说明

CNStack集群中包含以下几种角色(role),每个节点扮演其中一至多种角色:

  • master,用于部署k8s核心组件
    • 标签,node-role.kubernetes.io/master: ""
    • 污点,node-role.kubernetes.io/master:NoSchedule
  • cnstack-infra,用于部署云服务组件
    • 标签,node-role.kubernetes.io/cnstack-infra: ""
    • 污点,无
  • proxy,用于部署对外组件,如Ingress、Iam-Gateway,这部分节点需要能够对客户侧客户端(例如访问平台使用的浏览器、访问服务的业务组件)放开
    • 标签,node-role.kubernetes.io/proxy: ""
    • 污点,无
  • node,用于部署用户负载,无污点
    • 标签,node-role.kubernetes.io/node: ""
    • 污点,无。

master/node的使用方式和社区版K8s一致,使用"sealer run/join -m"添加的就是master,"-n"就是node,或者在ClusterFile中的roles中指定了master/node的角色,指定为master的节点会被作为K8s管控节点添加,注意,CNStack社区版中只允许单Master。

通过"-e RemoveMasterTaint=true"可以在部署时自动去除Master的污点,也可以后续手动去除污点。

CNStack社区版默认会为所有节点打上cnstack-infra和proxy的role,并且不带污点。

更多

如想了解更多的配置参数,请参考 ACK Distro进阶配置方式

产品卸载

# 执行sealer delete删除安装的管理集群
sealer delete -a --force
# 如果使用定制安装,启用了卷管理服务,删除平台创建的数据卷
vgremove open-local-pool-0 --force 

快速开始

使用手册

依赖组件介绍

纯离线环境的部署

如果部署环境没有互联网连接,请执行以下命令下载安装包

# 在有互联网连接的主机,使用sealer pull拉取集群镜像和配置文件
sealer pull ack-agility-registry.cn-shanghai.cr.aliyuncs.com/ecp_builder/cnstack-ce:v2-1-0-ce-4

# 保存集群镜像为tar文件
sealer save ack-agility-registry.cn-shanghai.cr.aliyuncs.com/ecp_builder/cnstack-ce:v2-1-0-ce-4 -o cnstack.tar

# 将sealer,集群镜像cnstack.tar和配置文件 ClusterFile.yaml传输到没有互联网连接的部署主机,在部署主机执行以下命令
sealer load -i cnstack.tar

然后,可以按照产品部署指南部署产品

用户支持

使用钉钉扫描以下二维码,加入CNStack社区版客户支持群,获取产品支持,参与需求讨论。

image

参考

cnstackcommunityedition's People

Contributors

haiyangding avatar luckyfengyong avatar lxs137 avatar tamerga avatar vincecui avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

cnstackcommunityedition's Issues

Unable to instuall CNStack because of swap.

OS: Fedora35
Before the installation, I had run swapoff -a, and run free -h, checked whether the swap had been off.
[root@fedora ~]# free -h
total used free shared buff/cache available
Mem: 15Gi 2.1Gi 3.4Gi 538Mi 9Gi 12Gi
Swap: 0B 0B 0B

Still got swap didnot disable error.
image

"too many open files" error when install kubevirt in cnstack

When i installed kubevirt in cnstack, but has a error about virt-handler. The err logs as follows:

{"component":"virt-handler","hostname":"yhf02","level":"info","pos":"virt-handler.go:195","timestamp":"2023-05-04T06:52:07.918682Z"}
W0504 06:52:07.922104   92191 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
{"component":"virt-handler","level":"info","msg":"set verbosity to 2","pos":"virt-handler.go:455","timestamp":"2023-05-04T06:52:07.939817Z"}
{"component":"virt-handler","level":"info","msg":"setting rate limiter to 5 QPS and 10 Burst","pos":"virt-handler.go:464","timestamp":"2023-05-04T06:52:07.939924Z"}
{"component":"virt-handler","level":"info","msg":"set verbosity to 2","pos":"virt-handler.go:455","timestamp":"2023-05-04T06:52:07.939945Z"}
{"component":"virt-handler","level":"info","msg":"CPU features of a minimum baseline CPU model: map[apic:true clflush:true cmov:truecx16:true cx8:true de:true fpu:true fxsr:true lahf_lm:true lm:true mca:true mce:true mmx:true msr:true mtrr:true nx:true pae:true pat:true pge:true pni:true pse:true pse36:true sep:true sse:true sse2:true sse4.1:true ssse3:true syscall:true tsc:true]","pos":"cpu_plugin.go:96","timestamp":"2023-05-04T06:52:08.020292Z"}
{"component":"virt-handler","level":"warning","msg":"host model mode is expected to contain only one model","pos":"cpu_plugin.go:103","timestamp":"2023-05-04T06:52:08.020344Z"}
{"component":"virt-handler","level":"info","msg":"node-labeller is running","pos":"node_labeller.go:94","timestamp":"2023-05-04T06:52:08.021374Z"}
{"component":"virt-handler","level":"info","msg":"set verbosity to 2","pos":"virt-handler.go:455","timestamp":"2023-05-04T06:52:08.021708Z"}
{"component":"virt-handler","level":"info","msg":"setting rate limiter to 5 QPS and 10 Burst","pos":"virt-handler.go:464","timestamp":"2023-05-04T06:52:08.021810Z"}
{"component":"virt-handler","level":"info","msg":"Starting domain stats collector: node name=yhf02","pos":"prometheus.go:472","timestamp":"2023-05-04T06:52:08.022603Z"}
{"component":"virt-handler","level":"info","msg":"Starting Guest OS Info collector: node name=yhf02","pos":"prometheus_guest_info.go:65","timestamp":"2023-05-04T06:52:08.022653Z"}
{"component":"virt-handler","level":"info","msg":"STARTING informer vmiInformer-sources","pos":"virtinformers.go:306","timestamp":"2023-05-04T06:52:08.022775Z"}
{"component":"virt-handler","level":"info","msg":"STARTING informer vmiInformer-targets","pos":"virtinformers.go:306","timestamp":"2023-05-04T06:52:08.022832Z"}
{"component":"virt-handler","level":"info","msg":"STARTING informer extensionsKubeVirtCAConfigMapInformer","pos":"virtinformers.go:306","timestamp":"2023-05-04T06:52:08.022876Z"}
{"component":"virt-handler","level":"info","msg":"STARTING informer CRDInformer","pos":"virtinformers.go:306","timestamp":"2023-05-04T06:52:08.022897Z"}
{"component":"virt-handler","level":"info","msg":"STARTING informer kubeVirtInformer","pos":"virtinformers.go:306","timestamp":"2023-05-04T06:52:08.022912Z"}
{"component":"virt-handler","level":"info","msg":"metrics: max concurrent requests=3","pos":"virt-handler.go:479","timestamp":"2023-05-04T06:52:08.023746Z"}
{"component":"virt-handler","level":"fatal","msg":"Failed to create an inotify watcher","pos":"cert-manager.go:105","reason":"too many open files","timestamp":"2023-05-04T06:52:08.024081Z"}
panic: Failed to create an inotify watcher

goroutine 104 [running]:
kubevirt.io/client-go/log.FilteredLogger.Critical({{0x25c9b00, 0xc003ba95e0}, {0x20e67c2, 0xc}, 0x0, 0x0, 0x2, 0x2, {0x25ce760, 0x3ab6d60}}, ...)
	staging/src/kubevirt.io/client-go/log/log.go:338 +0x196
kubevirt.io/kubevirt/pkg/certificates/bootstrap.(*FileCertificateManager).Start(0xc0004aa550)
	pkg/certificates/bootstrap/cert-manager.go:105 +0x1a5
created by main.(*virtHandlerApp).Run
	cmd/virt-handler/virt-handler.go:368 +0x1bcf

Who is using CNStack Community Edition | 如果贵公司在尝试使用CNStack社区版可以在此留下使用场景

填写案例好处:

获得阿里云原生团队免费全职支持,解决产品评估遇到的问题,帮助解决场景信息
需求可以得到最高优先级的支持
有机会获得企业线下培训(报名超过30人即可有机会)
例如:

公司:阿里云
联系方式:(可选,如果不方便留下联系方式,可以通过下面邮箱私发给冯泳)
姓名 冯泳
邮箱 [email protected]
钉钉 [email protected]
微信 luckyfengyong
使用场景:多集群资源管理和应用部署
当前进展:调研中|落地中|已落地
E.g:

Company: Alibaba Cloud
Contact: (optional)
Name Yong Feng
Email [email protected]
DingTalk [email protected]
WeChat luckyfengyong
Scenario: Manage resource and deploy application across multiple Kubernetes clusters

接入集群镜像pull需认证

Failed to pull image "ack-agility-registry.cn-shanghai.cr.aliyuncs.com/ecp_builder/ocm-deployer:v1.5.1": rpc error: code = Unknown desc = Error response from daemon: pull access denied for ack-agility-registry.cn-shanghai.cr.aliyuncs.com/ecp_builder/ocm-deployer, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.