ksingh7/Try-Ceph

The vagrant box link is dead.

Closed this issue · 4 comments

The vagrant box link is dead.

@shuoli84 could you check again , its working for me

image

hey karan . playbook need some modification
input file not found at /vm/ceph/Try-Ceph/roles/osds/files/fetch/127.0.0.1/var/lib/ceph/bootstrap-osd/ceph.keyring or /vm/ceph/Try-Ceph/fetch/127.0.0.1/var/lib/ceph/bootstrap-osd/ceph.keyring

ls -l fetch/

total 4
drwxr-xr-x. 4 root root 4096 Aug 24 11:57 mon0

actual location
fetch/mon0/var/lib/ceph/bootstrap-osd/

also mon args is not supported

TASK: [mons | Start and add that the monitor service to the init sequence] ****
failed: [mon0] => {"failed": true}
msg: Failed to issue method call: Unit mon.service failed to load: No such file or directory.

Hi @anil25

Could you retry this in a fresh way.

Just now i tried this in a fresh environment and worked for me. Below are my logs.

teeri:temp ksingh$ date
Mon Aug 24 22:18:02 EEST 2015
teeri:temp ksingh$
teeri:temp ksingh$ git clone https://github.com/ksingh7/Try-Ceph.git
Cloning into 'Try-Ceph'...
remote: Counting objects: 216, done.
remote: Total 216 (delta 0), reused 0 (delta 0), pack-reused 216
Receiving objects: 100% (216/216), 102.19 KiB | 0 bytes/s, done.
Resolving deltas: 100% (65/65), done.
Checking connectivity... done.
teeri:temp ksingh$
teeri:temp ksingh$ cd Try-Ceph/
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$ ls -la
total 48
drwxr-xr-x  10 ksingh  staff    340 Aug 24 22:02 .
drwxr-xr-x   5 ksingh  staff    170 Aug 24 22:02 ..
drwxr-xr-x  12 ksingh  staff    408 Aug 24 22:02 .git
-rw-r--r--   1 ksingh  staff  10501 Aug 24 22:02 README.md
-rw-r--r--   1 ksingh  staff   2472 Aug 24 22:02 Vagrantfile
-rw-r--r--   1 ksingh  staff     79 Aug 24 22:02 ansible.cfg
drwxr-xr-x   3 ksingh  staff    102 Aug 24 22:02 group_vars
drwxr-xr-x   5 ksingh  staff    170 Aug 24 22:02 roles
drwxr-xr-x   3 ksingh  staff    102 Aug 24 22:02 screenshot
-rw-r--r--   1 ksingh  staff    170 Aug 24 22:02 site.yml
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$ vagrant status
Current machine states:

mon0                      not created (virtualbox)
osd0                      not created (virtualbox)
osd1                      not created (virtualbox)
osd2                      not created (virtualbox)

This environment represents multiple VMs. The VMs are all listed
above with their current state. For more information about a specific
VM, run `vagrant status NAME`.
teeri:Try-Ceph ksingh$ vagrant up
Bringing machine 'mon0' up with 'virtualbox' provider...
Bringing machine 'osd0' up with 'virtualbox' provider...
Bringing machine 'osd1' up with 'virtualbox' provider...
Bringing machine 'osd2' up with 'virtualbox' provider...
==> mon0: Box 'ceph/centos7' could not be found. Attempting to find and install...
    mon0: Box Provider: virtualbox
    mon0: Box Version: >= 0
==> mon0: Loading metadata for box 'ceph/centos7'
    mon0: URL: https://atlas.hashicorp.com/ceph/centos7
==> mon0: Adding box 'ceph/centos7' (v0.1) for provider: virtualbox
    mon0: Downloading: https://atlas.hashicorp.com/ceph/boxes/centos7/versions/0.1/providers/virtualbox.box
==> mon0: Successfully added box 'ceph/centos7' (v0.1) for 'virtualbox'!
==> mon0: Importing base box 'ceph/centos7'...
==> mon0: Matching MAC address for NAT networking...
==> mon0: Checking if box 'ceph/centos7' is up to date...
==> mon0: Setting the name of the VM: Try-Ceph_mon0_1440443216336_32163
==> mon0: Clearing any previously set network interfaces...
==> mon0: Preparing network interfaces based on configuration...
    mon0: Adapter 1: nat
    mon0: Adapter 2: hostonly
==> mon0: Forwarding ports...
    mon0: 22 => 2222 (adapter 1)
==> mon0: Running 'pre-boot' VM customizations...
==> mon0: Booting VM...
==> mon0: Waiting for machine to boot. This may take a few minutes...
    mon0: SSH address: 127.0.0.1:2222
    mon0: SSH username: vagrant
    mon0: SSH auth method: private key
    mon0: Warning: Connection timeout. Retrying...
    mon0: Warning: Remote connection disconnect. Retrying...
==> mon0: Machine booted and ready!
==> mon0: Checking for guest additions in VM...
==> mon0: Setting hostname...
==> mon0: Configuring and enabling network interfaces...
==> mon0: Mounting shared folders...
    mon0: /vagrant => /Users/ksingh/temp/Try-Ceph
==> osd0: Box 'ceph/centos7' could not be found. Attempting to find and install...
    osd0: Box Provider: virtualbox
    osd0: Box Version: >= 0
==> osd0: Loading metadata for box 'ceph/centos7'
    osd0: URL: https://atlas.hashicorp.com/ceph/centos7
==> osd0: Adding box 'ceph/centos7' (v0.1) for provider: virtualbox
==> osd0: Importing base box 'ceph/centos7'...
==> osd0: Matching MAC address for NAT networking...
==> osd0: Checking if box 'ceph/centos7' is up to date...
==> osd0: Setting the name of the VM: Try-Ceph_osd0_1440443261749_74182
==> osd0: Fixed port collision for 22 => 2222. Now on port 2200.
==> osd0: Clearing any previously set network interfaces...
==> osd0: Preparing network interfaces based on configuration...
    osd0: Adapter 1: nat
    osd0: Adapter 2: hostonly
    osd0: Adapter 3: hostonly
==> osd0: Forwarding ports...
    osd0: 22 => 2200 (adapter 1)
==> osd0: Running 'pre-boot' VM customizations...
==> osd0: Booting VM...
==> osd0: Waiting for machine to boot. This may take a few minutes...
    osd0: SSH address: 127.0.0.1:2200
    osd0: SSH username: vagrant
    osd0: SSH auth method: private key
    osd0: Warning: Connection timeout. Retrying...
==> osd0: Machine booted and ready!
==> osd0: Checking for guest additions in VM...
==> osd0: Setting hostname...
==> osd0: Configuring and enabling network interfaces...
==> osd0: Mounting shared folders...
    osd0: /vagrant => /Users/ksingh/temp/Try-Ceph
==> osd1: Box 'ceph/centos7' could not be found. Attempting to find and install...
    osd1: Box Provider: virtualbox
    osd1: Box Version: >= 0
==> osd1: Loading metadata for box 'ceph/centos7'
    osd1: URL: https://atlas.hashicorp.com/ceph/centos7
==> osd1: Adding box 'ceph/centos7' (v0.1) for provider: virtualbox
==> osd1: Importing base box 'ceph/centos7'...
==> osd1: Matching MAC address for NAT networking...
==> osd1: Checking if box 'ceph/centos7' is up to date...
==> osd1: Setting the name of the VM: Try-Ceph_osd1_1440443314096_47868
==> osd1: Fixed port collision for 22 => 2222. Now on port 2201.
==> osd1: Clearing any previously set network interfaces...
==> osd1: Preparing network interfaces based on configuration...
    osd1: Adapter 1: nat
    osd1: Adapter 2: hostonly
    osd1: Adapter 3: hostonly
==> osd1: Forwarding ports...
    osd1: 22 => 2201 (adapter 1)
==> osd1: Running 'pre-boot' VM customizations...
==> osd1: Booting VM...
==> osd1: Waiting for machine to boot. This may take a few minutes...
    osd1: SSH address: 127.0.0.1:2201
    osd1: SSH username: vagrant
    osd1: SSH auth method: private key
    osd1: Warning: Connection timeout. Retrying...
==> osd1: Machine booted and ready!
==> osd1: Checking for guest additions in VM...
==> osd1: Setting hostname...
==> osd1: Configuring and enabling network interfaces...
==> osd1: Mounting shared folders...
    osd1: /vagrant => /Users/ksingh/temp/Try-Ceph
==> osd2: Box 'ceph/centos7' could not be found. Attempting to find and install...
    osd2: Box Provider: virtualbox
    osd2: Box Version: >= 0
==> osd2: Loading metadata for box 'ceph/centos7'
    osd2: URL: https://atlas.hashicorp.com/ceph/centos7
==> osd2: Adding box 'ceph/centos7' (v0.1) for provider: virtualbox
==> osd2: Importing base box 'ceph/centos7'...
==> osd2: Matching MAC address for NAT networking...
==> osd2: Checking if box 'ceph/centos7' is up to date...
==> osd2: Setting the name of the VM: Try-Ceph_osd2_1440443369345_74947
==> osd2: Fixed port collision for 22 => 2222. Now on port 2202.
==> osd2: Clearing any previously set network interfaces...
==> osd2: Preparing network interfaces based on configuration...
    osd2: Adapter 1: nat
    osd2: Adapter 2: hostonly
    osd2: Adapter 3: hostonly
==> osd2: Forwarding ports...
    osd2: 22 => 2202 (adapter 1)
==> osd2: Running 'pre-boot' VM customizations...
==> osd2: Booting VM...
==> osd2: Waiting for machine to boot. This may take a few minutes...
    osd2: SSH address: 127.0.0.1:2202
    osd2: SSH username: vagrant
    osd2: SSH auth method: private key
    osd2: Warning: Connection timeout. Retrying...
==> osd2: Machine booted and ready!
==> osd2: Checking for guest additions in VM...
==> osd2: Setting hostname...
==> osd2: Configuring and enabling network interfaces...
==> osd2: Mounting shared folders...
    osd2: /vagrant => /Users/ksingh/temp/Try-Ceph
==> osd2: Running provisioner: ansible...
PYTHONUNBUFFERED=1 ANSIBLE_FORCE_COLOR=true ANSIBLE_HOST_KEY_CHECKING=false ANSIBLE_SSH_ARGS='-o UserKnownHostsFile=/dev/null -o ControlMaster=auto -o ControlPersist=60s' ansible-playbook --private-key=/Users/ksingh/.vagrant.d/insecure_private_key --user=vagrant --connection=ssh --limit='all' --inventory-file=/Users/ksingh/temp/Try-Ceph/.vagrant/provisioners/ansible/inventory --extra-vars={"fsid":"10c95f01-2dd2-4863-affa-60c4eafcd8d2","monitor_secret":"AQBNTxZRWId7JxAA/Ac4ToR7ZfNdOGDSToGHpA=="} site.yml

PLAY [mons;osds] **************************************************************

GATHERING FACTS ***************************************************************
ok: [osd1]
ok: [mon0]
ok: [osd2]
ok: [osd0]

TASK: [common | Copying Ceph key] *********************************************
changed: [mon0]
changed: [osd2]
changed: [osd0]
changed: [osd1]

TASK: [common | Importing Ceph GPG  key] **************************************
changed: [osd2]
changed: [osd0]
changed: [mon0]
changed: [osd1]

TASK: [common | Copying EPEL key] *********************************************
changed: [osd2]
changed: [osd1]
changed: [osd0]
changed: [mon0]

TASK: [common | Importing EPEL GPG  key] **************************************
changed: [osd2]
changed: [osd0]
changed: [mon0]
changed: [osd1]

TASK: [common | Adding EPEL repo] *********************************************
changed: [osd0]
changed: [osd2]
changed: [osd1]
changed: [mon0]

TASK: [common | Adding ceph to YUM repo] **************************************
changed: [osd2]
changed: [osd0]
changed: [osd1]
changed: [mon0]

TASK: [common | Disable firewalld] ********************************************
changed: [osd0]
changed: [osd1]
changed: [osd2]
changed: [mon0]

TASK: [common | Stop firewalld] ***********************************************
changed: [osd2]
changed: [osd0]
changed: [osd1]
changed: [mon0]

TASK: [common | Creating directories required by ceph [/var/lib/ceph]] ********
changed: [osd1]
changed: [osd2]
changed: [mon0]
changed: [osd0]

TASK: [common | Creating directories required by ceph [/var/lib/ceph/{{ item }}]] ***
changed: [osd0] => (item=tmp)
changed: [mon0] => (item=tmp)
changed: [osd1] => (item=tmp)
changed: [osd2] => (item=tmp)
changed: [mon0] => (item=mon)
changed: [osd2] => (item=mon)
changed: [osd1] => (item=mon)
changed: [mon0] => (item=bootstrap-osd)
changed: [osd2] => (item=bootstrap-osd)
changed: [osd1] => (item=bootstrap-osd)
changed: [osd0] => (item=mon)
changed: [osd0] => (item=bootstrap-osd)

TASK: [common | Creating directories required by ceph [/var/log/ceph]] ********
changed: [osd0]
changed: [osd2]
changed: [mon0]
changed: [osd1]

TASK: [common | Creating directories required by ceph [/etc/ceph]] ************
changed: [mon0]
changed: [osd0]
changed: [osd2]
changed: [osd1]

TASK: [common | Installing Ceph packages] *************************************
changed: [osd2]
changed: [mon0]
changed: [osd1]
changed: [osd0]

TASK: [common | Generating Ceph configuration file] ***************************
changed: [osd1]
changed: [mon0]
changed: [osd2]
changed: [osd0]

PLAY [mons] *******************************************************************

GATHERING FACTS ***************************************************************
ok: [mon0]

TASK: [mons | Creating monitor initial keyring] *******************************
changed: [mon0]

TASK: [mons | Setting initial monitor key permissions] ************************
ok: [mon0]

TASK: [mons | Creating monitor directory] *************************************
changed: [mon0]

TASK: [mons | Creating administrator keyring , Generating a client.admin user and adding the user to the keyring] ***
changed: [mon0]

TASK: [mons | Adding the client.admin key to the ceph.mon.keyring.] ***********
changed: [mon0]

TASK: [mons | Generating a monitor map using the hostname,host IP address and the FSID. Save it as /tmp/monmap] ***
changed: [mon0]

TASK: [mons | Populating the monitor daemon with the monitor map and keyring.] ***
changed: [mon0]

TASK: [mons | Start and add that the monitor service to the init sequence] ****
changed: [mon0]

TASK: [mons | Adding the new monitor to the cluster] **************************
changed: [mon0]

TASK: [mons | Copy keys to the ansible server under fetch dirctory] ***********
changed: [mon0] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring)
changed: [mon0] => (item=/var/lib/ceph/mon/ceph-mon0/keyring)
ok: [mon0] => (item=/etc/ceph/ceph.bootstrap-osd.keyring)
ok: [mon0] => (item=/etc/ceph/ceph.mon.keyring)
changed: [mon0] => (item=/etc/ceph/ceph.conf)
changed: [mon0] => (item=/etc/ceph/ceph.client.admin.keyring)

TASK: [mons | Cloning ceph-dash from github] **********************************
changed: [mon0]

TASK: [mons | Upgrading jinja2 for ceph-dash] *********************************
changed: [mon0]

TASK: [mons | Executing ceph-dash] ********************************************
<job 14091850264.4576> finished on mon0

TASK: [mons | Install RGW] ****************************************************
changed: [mon0]

TASK: [mons | Creating RGW keyring] *******************************************
changed: [mon0]

TASK: [mons | Setting RGW keyring persmissions] *******************************
ok: [mon0]

TASK: [mons | Generate key for RGW instance] **********************************
changed: [mon0]

TASK: [mons | Add capabilities to RGW key] ************************************
changed: [mon0]

TASK: [mons | Add RGW key to cluster] *****************************************
changed: [mon0]

TASK: [mons | Start RGW] ******************************************************
changed: [mon0]

PLAY [osds] *******************************************************************

GATHERING FACTS ***************************************************************
ok: [osd0]
ok: [osd1]
ok: [osd2]

TASK: [osds | Creating directories required by ceph] **************************
ok: [osd0] => (item=tmp)
ok: [osd2] => (item=tmp)
ok: [osd1] => (item=tmp)
ok: [osd2] => (item=mon)
ok: [osd0] => (item=mon)
ok: [osd1] => (item=mon)
ok: [osd2] => (item=mds)
ok: [osd0] => (item=mds)
ok: [osd1] => (item=mds)
ok: [osd2] => (item=bootstrap-osd)
ok: [osd0] => (item=bootstrap-osd)
ok: [osd1] => (item=bootstrap-osd)
ok: [osd2] => (item=bootstrap-mds)
ok: [osd0] => (item=bootstrap-mds)
ok: [osd1] => (item=bootstrap-mds)

TASK: [osds | Gathering keys from MON node to OSD node [ STEP-1 ]] ************
changed: [osd1]
changed: [osd2]
changed: [osd0]

TASK: [osds | Copying OSD bootstrap key to OSD node] **************************
changed: [osd1]
changed: [osd0]
changed: [osd2]

TASK: [osds | Zapping OSD] ****************************************************
changed: [osd1] => (item=/dev/sdb)
changed: [osd0] => (item=/dev/sdb)
changed: [osd2] => (item=/dev/sdb)
changed: [osd1] => (item=/dev/sdc)
changed: [osd0] => (item=/dev/sdc)
changed: [osd2] => (item=/dev/sdc)

TASK: [osds | Prepare OSD disk(s)] ********************************************
changed: [osd1] => (item=/dev/sdb)
changed: [osd0] => (item=/dev/sdb)
changed: [osd2] => (item=/dev/sdb)
changed: [osd1] => (item=/dev/sdc)
changed: [osd0] => (item=/dev/sdc)
changed: [osd2] => (item=/dev/sdc)

TASK: [osds | Activating  OSD] ************************************************
changed: [osd0] => (item=/dev/sdb)
changed: [osd1] => (item=/dev/sdb)
changed: [osd0] => (item=/dev/sdc)
changed: [osd1] => (item=/dev/sdc)
changed: [osd2] => (item=/dev/sdb)
changed: [osd2] => (item=/dev/sdc)

TASK: [osds | Start and add that the OSD service to the init sequence] ********
changed: [osd1]
changed: [osd0]
changed: [osd2]

PLAY RECAP ********************************************************************
mon0                       : ok=37   changed=31   unreachable=0    failed=0
osd0                       : ok=23   changed=20   unreachable=0    failed=0
osd1                       : ok=23   changed=20   unreachable=0    failed=0
osd2                       : ok=23   changed=20   unreachable=0    failed=0

teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$ vagrant ssh mon0 -c "sudo ceph -s"
    cluster 10c95f01-2dd2-4863-affa-60c4eafcd8d2
     health HEALTH_OK
     monmap e1: 1 mons at {mon0=192.168.101.10:6789/0}
            election epoch 2, quorum 0 mon0
     osdmap e21: 6 osds: 6 up, 6 in
      pgmap v33: 384 pgs, 6 pools, 848 bytes data, 43 objects
            210 MB used, 65123 MB / 65333 MB avail
                 384 active+clean
Connection to 127.0.0.1 closed.
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$
teeri:Try-Ceph ksingh$ date
Mon Aug 24 22:18:02 EEST 2015
teeri:Try-Ceph ksingh$

Commits done by @sigurdga has fixed this.