wtsi-hgi/hgi-systems

Unable to provision consul servers (issue with attached volume)

Closed this issue · 0 comments

I removed consul-server-delta-hgi-03 from the consul cluster and then deleted the instance and its volume. Ansible is encountering problems recreating this node:

<Previous tasks complete successfully>
...
TASK [attached-openstack-volume : identify xfs volumes] 
failed: [consul-server-delta-hgi-03] (item={'mountpoint': '/data/consul', 'size': '10236M', 'name': 'consul-data', 'fstype': 'xfs'}) => {
    "changed": false,
    "cmd": [
        "blkid",
        "-c",
        "/dev/null",
        "-o",
        "value",
        "-s",
        "TYPE",
        "/dev/consul-vg/consul-data"
    ],
    "delta": "0:00:00.021467",
    "end": "2017-06-12 10:15:09.848756",
    "failed": true,
    "invocation": {
        "module_args": {
            "_raw_params": "blkid -c /dev/null -o value -s TYPE /dev/consul-vg/consul-data",
            "_uses_shell": false,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "warn": true
        }
    },
    "item": {
        "fstype": "xfs",
        "mountpoint": "/data/consul",
        "name": "consul-data",
        "size": "10236M"
    },
    "msg": "non-zero return code",
    "rc": 2,
    "start": "2017-06-12 10:15:09.827289",
    "stderr": "",
    "stderr_lines": [],
    "stdout": "",
    "stdout_lines": []
}

On the newly provisioned consul node:

$ blkid
/dev/vda1: LABEL="cloudimg-rootfs" UUID="b14f53da-7bc9-4604-a014-341f669f87c0" TYPE="ext4" PARTUUID="f1917857-01"
/dev/vdb: UUID="wZck3R-WOxC-hJbQ-LO1z-gLIW-kooa-2ybAW7" TYPE="LVM2_member"

On existing consul nodes:

$ blkid
/dev/vda1: LABEL="cloudimg-rootfs" UUID="b14f53da-7bc9-4604-a014-341f669f87c0" TYPE="ext4" PARTUUID="f1917857-01"
/dev/vdb: UUID="xSNQ5I-kdpe-D6RI-r5Oh-C8hY-HYGz-VdwMpE" TYPE="LVM2_member"
/dev/mapper/consul--vg-consul--data: UUID="cb20986e-bf8e-4e50-960c-1fb5084b2312" TYPE="xfs"