Device-Manager

介绍
磁盘任务(action)和状态(status)
开发记录
安装
kocenter磁盘接口

Usage

负责监听CRD并对宿主机设备进行操作，目前主要包括：

磁盘挂载
磁盘卸载
磁盘挂载时挂载点的文件清理

注意点

一个节点一份extenddevice，名称为节点名

磁盘任务(action)和状态(status)

挂载任务及状态

在磁盘为卸载成功umountSucceed或等待中Available状态时可以执行挂载操作

action: mount
status:

mountSucceed：挂载成功
mountFailed：挂载失败
mounting: 挂载中
Pending: 任务（挂载、卸载）等待中，可以显示等待中

卸载任务及状态

在磁盘非卸载成功umountSucceed状态时可以执行卸载操作

action: umount
status:

umountSucceed：卸载成功
umountFailed：卸载失败
umounting： 卸载中
Pending: 任务（挂载、卸载）等待中，可以显示等待中

磁盘清理

在磁盘为挂载成功状态MountSuccess时可以执行清理操作。

执行清理

action: clean
cleanStatus:

cleanSucceed：清理成功
cleanFailed：清理失败
cleaning：清理中
Pending: 等待中

其他状态

Available： 可用

开发记录

容器内磁盘挂载

ssh 127.0.0.1 mount /dev/sdd <mount path>

注意点

宿主机上的~/.ssh文件夹需要挂载到容器内；
宿主机上的/etc/ssh/ssh_config文件需要挂载进容器内；
容器内需要安装ssh包；

需要用到的命令

lsblk
mount, umount
mkfs.xfs mkfs.ext4
ssh

koscenter需要开发的接口

磁盘列表（调用node-hardware-discovery接口）
磁盘挂载（status置为available）、卸载、清理

extenddevice示例

apiVersion: device.k8s.io/v1alpha1
kind: ExtendDevice
metadata:
  creationTimestamp: "2021-03-04T03:35:43Z"
  generation: 802
  name: master1
  resourceVersion: "61443566"
  selfLink: /apis/device.k8s.io/v1alpha1/extenddevices/master1
  uid: 8c42ad96-4761-441d-b07a-0ec9987abae2
spec:
  node: worker2
  disk:
  - name: sdc
    clean: false
    fsType: xfs
    mountPoint: /opt/mnt2
    uuid: b6895b0c-7408-45f5-bba9-ca1baf7aa44a
    formatting: true
    action: mount
    status: Available
    dump: false
  - name: sdb
    clean: false
    fsType: ext4
    mountPoint: /opt/mnt1
    uuid: bef7fc78-c463-4a8a-9aed-f0a40d725060
    formatting: true
    action: mount
    status: Available
    dump: true
status:
  lastUpdateTime: "2021-03-04T06:57:27Z"
  message: create

Installation

deploy with helm

helm install device-manager device-manager/ -n kube-system

uninstall

helm delete device-manager  -n kube-system

kocenter磁盘接口

获取disk设备信息

Request

http://10.19.141.137:11443/v1/clusters/devices?name=master1&deviceType=disk

Method

GET

Parameters

name: 磁盘所在节点名称，必填项
deviceType: 设备类型，当前只支持`disk`，必填项

Response

{
  "data": {
    "devices": [
      {
        "name": "worker2",
        "disk": [
          {
            "name": "sda",
            "size": 600127266816,
            "sizeUnit": "558.9GB",
            "isSSD": false,
            "type": "",
            "serial": "5000039858391315",
            "vendor": "TOSHIBA",
            "partitions": [
              {
                "name": "sda1",
                "size": 1048576,
                "sizeUnit": "1MB",
                "mountPoint": "",
                "type": "",
                "uuid": "",
                "inuse": false,
                "action": "",
                "status": "Available",
                "cleanStatus": "",
                "errors": [],
                "existInED": false
              },
              {
                "name": "sda2",
                "size": 1073741824,
                "sizeUnit": "1GB",
                "mountPoint": "/boot",
                "type": "ext4",
                "uuid": "4efc90f6-bbef-40f1-8818-8086341d66a3",
                "inuse": true,
                "action": "mount",
                "status": "mountSucceed",
                "cleanStatus": "",
                "errors": [],
                "existInED": false
              },
              {
                "name": "sda3",
                "size": 599050420224,
                "sizeUnit": "557.9GB",
                "mountPoint": "/",
                "type": "",
                "uuid": "a52c7B-KJr8-87Pm-d0Ox-5Qkh-5cSO-TTTJXs",
                "inuse": true,
                "action": "mount",
                "status": "mountSucceed",
                "cleanStatus": "",
                "errors": [],
                "existInED": false
              }
            ],
            "mountPoint": "",
            "inuse": true,
            "uuid": "",
            "hardwareID": "",
            "healthStatus": "pass",
            "healthError": null,
            "action": "mount",
            "status": "mountSucceed",
            "cleanStatus": "",
            "errors": [],
            "existInED": false
          },
          {
            "name": "sdb",
            "size": 480103981056,
            "sizeUnit": "447.1GB",
            "isSSD": true,
            "type": "xfs",
            "serial": "BTDV741501GV480BGN",
            "vendor": "ATA",
            "partitions": [],
            "mountPoint": "/opt/mnt1",
            "inuse": true,
            "uuid": "43561191-8ab4-4fbb-92b8-5ca92381f8ae",
            "hardwareID": "",
            "healthStatus": "pass",
            "healthError": null,
            "action": "mount",
            "status": "mountSucceed",
            "cleanStatus": "cleanSucceed",
            "errors": [],
            "existInED": true
          },
          {
            "name": "sdc",
            "size": 1800360124416,
            "sizeUnit": "1.6TB",
            "isSSD": false,
            "type": "ext4",
            "serial": "5000cca02c71c364",
            "vendor": "HGST",
            "partitions": [],
            "mountPoint": "/opt/mnt2",
            "inuse": true,
            "uuid": "f5a5ca3d-0519-4b0b-8aab-160f7e00db26",
            "hardwareID": "",
            "healthStatus": "pass",
            "healthError": null,
            "action": "mount",
            "status": "mountSucceed",
            "cleanStatus": "cleanSucceed",
            "errors": [],
            "existInED": true
          },
          {
            "name": "sdd",
            "size": 600127266816,
            "sizeUnit": "558.9GB",
            "isSSD": false,
            "type": "ext4",
            "serial": "5000cca02f419c4c",
            "vendor": "HGST",
            "partitions": [],
            "mountPoint": "",
            "inuse": false,
            "uuid": "0b5c6a03-7dd0-4e46-b969-129885d2f79b",
            "hardwareID": "",
            "healthStatus": "pass",
            "healthError": null,
            "action": "",
            "status": "Available",
            "cleanStatus": "",
            "errors": [],
            "existInED": false
          }
        ]
      }
    ]
  },
  "message": "",
  "resultCode": "0"
}

挂载disk

Request

http://10.19.141.137:11443/v1/clusters/devices/disks

Method

POST

Body

{
  "action": "mount",
  "devices": [{
  	"node": "worker2",
  	"disk": [{
  		"name": "sdb",
  		"fsType": "xfs",
  		"mountPoint": "/opt/mnt1",
  		"uuid": "bef7fc78-c463-4a8a-9aed-f0a40d725060",
  		"formatting": true,
  		"dump": true
  	},{
  		"name": "sdc",
  		"fsType": "ext4",
  		"mountPoint": "/opt/mnt2",
  		"uuid": "b6895b0c-7408-45f5-bba9-ca1baf7aa44a",
  		"formatting": true,
  		"dump": false
  	}]}]
}

Response

{
    "data": [
        {
            "metadata": {
                "name": "worker2",
                "selfLink": "/apis/device.k8s.io/v1alpha1/extenddevices/worker2",
                "uid": "180ab273-a0f5-413a-9a28-d4ad0ba9aadf",
                "resourceVersion": "66570646",
                "generation": 2,
                "creationTimestamp": "2021-03-12T06:25:25Z"
            },
            "spec": {
                "disk": [
                    {
                        "name": "sdb",
                        "clean": false,
                        "fsType": "xfs",
                        "mountPoint": "/opt/mnt1",
                        "uuid": "bef7fc78-c463-4a8a-9aed-f0a40d725060",
                        "formatting": true,
                        "action": "mount",
                        "status": "Available",
                        "cleanStatus": "",
                        "dump": true,
                        "errors": []
                    },
                    {
                        "name": "sdc",
                        "clean": false,
                        "fsType": "ext4",
                        "mountPoint": "/opt/mnt2",
                        "uuid": "b6895b0c-7408-45f5-bba9-ca1baf7aa44a",
                        "formatting": true,
                        "action": "mount",
                        "status": "Available",
                        "cleanStatus": "",
                        "dump": false,
                        "errors": []
                    }
                ],
                "node": "worker2"
            },
            "status": {
                "lastUpdateTime": "2021-03-12T06:35:03Z",
                "message": "create"
            }
        }
    ],
    "message": "",
    "resultCode": "0"
}

卸载disk

Request

http://10.19.141.137:11443/v1/clusters/devices/disks

Method

POST

Body

{
  "action": "umount",
  "devices": [{
  	"node": "worker2",
  	"disk": [{
  		"name": "sdb"
  	},{
  		"name": "sdc"
  	}]}]
}

Response

{
    "data": [
        {
            "metadata": {
                "name": "worker2",
                "selfLink": "/apis/device.k8s.io/v1alpha1/extenddevices/worker2",
                "uid": "180ab273-a0f5-413a-9a28-d4ad0ba9aadf",
                "resourceVersion": "66571907",
                "generation": 8,
                "creationTimestamp": "2021-03-12T06:25:25Z"
            },
            "spec": {
                "disk": [
                    {
                        "name": "sdb",
                        "clean": false,
                        "fsType": "xfs",
                        "mountPoint": "/opt/mnt1",
                        "uuid": "bef7fc78-c463-4a8a-9aed-f0a40d725060",
                        "formatting": true,
                        "action": "umount",
                        "status": "Pending",
                        "cleanStatus": "mounting",
                        "dump": true,
                        "errors": []
                    },
                    {
                        "name": "sdc",
                        "clean": false,
                        "fsType": "ext4",
                        "mountPoint": "/opt/mnt2",
                        "uuid": "b6895b0c-7408-45f5-bba9-ca1baf7aa44a",
                        "formatting": true,
                        "action": "umount",
                        "status": "Pending",
                        "cleanStatus": "mounting",
                        "dump": false,
                        "errors": []
                    }
                ],
                "node": "worker2"
            },
            "status": {
                "lastUpdateTime": "2021-03-12T06:37:48Z",
                "message": "create"
            }
        }
    ],
    "message": "",
    "resultCode": "0"
}

清理磁盘

只有通过接口进行挂载的磁盘，即磁盘信息保存在CRD ExtendDevices中才可以进行清理，并且磁盘需要为mountSucceed状态。

Request

http://10.19.141.137:11443/v1/clusters/devices/disks

Method

POST

Body

{
  "action": "clean",
  "devices": [{
  	"node": "worker2",
  	"disk": [{
  		"name": "sdb"
  	},{
  		"name": "sdc"
  	}]}]
}

Response

{
    "data": [
        {
            "metadata": {
                "name": "worker2",
                "selfLink": "/apis/device.k8s.io/v1alpha1/extenddevices/worker2",
                "uid": "795e1249-fab4-4fea-b592-7e82aad9da2b",
                "resourceVersion": "66584617",
                "generation": 8,
                "creationTimestamp": "2021-03-12T06:34:39Z"
            },
            "spec": {
                "disk": [
                    {
                        "name": "sdb",
                        "clean": true,
                        "fsType": "xfs",
                        "mountPoint": "/opt/mnt1",
                        "uuid": "bef7fc78-c463-4a8a-9aed-f0a40d725060",
                        "formatting": true,
                        "action": "mount",
                        "status": "mountSucceed",
                        "cleanStatus": "Pending",
                        "dump": true,
                        "errors": null
                    },
                    {
                        "name": "sdc",
                        "clean": true,
                        "fsType": "ext4",
                        "mountPoint": "/opt/mnt2",
                        "uuid": "b6895b0c-7408-45f5-bba9-ca1baf7aa44a",
                        "formatting": true,
                        "action": "mount",
                        "status": "mountSucceed",
                        "cleanStatus": "Pending",
                        "dump": false,
                        "errors": null
                    }
                ],
                "node": "worker2"
            },
            "status": {
                "lastUpdateTime": "2021-03-12T07:06:11Z",
                "message": "create"
            }
        }
    ],
    "message": "",
    "resultCode": "0"
}

aixeshunter/device-manager-operator

Device-Manager

Usage

磁盘任务(action)和状态(status)

挂载任务及状态

卸载任务及状态

磁盘清理

执行清理

其他状态

开发记录

容器内磁盘挂载

需要用到的命令

koscenter需要开发的接口

extenddevice示例

Installation

deploy with helm

uninstall

kocenter磁盘接口

获取disk设备信息

挂载disk

卸载disk

清理磁盘