Creation of chunks failed because of space (on real drives)

[shosseinimotlagh]

[06/12/24 14:11:43-07:00] [I] [5569] [homestore_test_common.hpp:293:do_start_homestore] Initialize and start HomeStore with app_mem_size = 460.80mb
[06/12/24 14:11:43-07:00] [I] [5569] [homestore_config.hpp:93:operator()] Free Blks Slab distribution is not initialized, possibly first boot - setting with defaults
[06/12/24 14:11:43-07:00] [I] [5569] [homestore_config.hpp:105:init_settings_default] Some settings are defaultted or overridden explicitly in the code, saving the new settings
[06/12/24 14:11:43-07:00] [I] [5569] [homestore.cpp:137:start] Homestore is loading with following services: meta,index,
[06/12/24 14:11:43-07:00] [I] [5569] [cp_mgr.cpp:363:CPWatchdog] CP watchdog timer setting to : 10 seconds
[06/12/24 14:11:43-07:00] [I] [5569] [iomgr_timer.cpp:179:setup_timer_fd] Creating recurring global timer fd 24 and adding it into fd poll list
[06/12/24 14:11:43-07:00] [I] [5612] [reactor.hpp:50:IOThreadMetrics] Registring metrics group name = IOThreadMetrics, thread_name = cp_io
[06/12/24 14:11:43-07:00] [I] [5612] [iomgr_timer.cpp:179:setup_timer_fd] Creating non-recurring per-thread timer fd 27 and adding it into fd poll list
[06/12/24 14:11:43-07:00] [I] [5569] [drive_interface.cpp:220:get_drive_type] Drive=/dev/index is detected to be drive_type=block_nvme
[06/12/24 14:11:43-07:00] [I] [5569] [drive_interface.cpp:220:get_drive_type] Drive=/dev/data1 is detected to be drive_type=block_hdd
[06/12/24 14:11:43-07:00] [I] [5569] [device_manager.cpp:78:DeviceManager] Overridding HDD open flags from DIRECT_IO to BUFFERED_IO
[06/12/24 14:11:43-07:00] [I] [5569] [drive_interface.cpp:220:get_drive_type] Drive=/dev/data2 is detected to be drive_type=block_hdd
[06/12/24 14:11:43-07:00] [I] [5569] [drive_interface.cpp:220:get_drive_type] Drive=/dev/data3 is detected to be drive_type=block_hdd
[06/12/24 14:11:43-07:00] [I] [5569] [physical_dev.cpp:87:PhysicalDev] Opening device /dev/index with DIRECT_IO mode.
[06/12/24 14:11:43-07:00] [I] [5569] [physical_dev.cpp:108:PhysicalDev] Device /dev/index opened with dev_id=30 size=465.75gb
[06/12/24 14:11:43-07:00] [I] [5569] [device_manager.cpp:125:format_devices] Formatting Homestore on Device=/dev/index with first block as: [magic=0xceeddeeb, checksum=1601605940, first_blk_header=[gen_number=1, version=4, product_name=OmStore system_uuid=66358bb0-a84d-4193-a87e-b130181b5546], this_pdev_info=[data_offset=8.79mb, size=465.74gb, pdev_id=0 max_pdev_chunks=14905 dev_attr=[phys_page_size=4kb, align_size=512, atomic_phys_page_size=4kb, num_streams=1] mirror_super_block?=false]] total_super_blk_size=8163840
[06/12/24 14:11:43-07:00] [I] [5569] [physical_dev.cpp:87:PhysicalDev] Opening device /dev/data1 with BUFFERED_IO mode.
[06/12/24 14:11:43-07:00] [I] [5569] [physical_dev.cpp:108:PhysicalDev] Device /dev/data1 opened with dev_id=31 size=5.46tb
[06/12/24 14:11:43-07:00] [I] [5569] [device_manager.cpp:125:format_devices] Formatting Homestore on Device=/dev/data1 with first block as: [magic=0xceeddeeb, checksum=43025438, first_blk_header=[gen_number=1, version=4, product_name=OmStore system_uuid=66358bb0-a84d-4193-a87e-b130181b5546], this_pdev_info=[data_offset=183.19mb, size=5.46tb, pdev_id=1 max_pdev_chunks=357664 dev_attr=[phys_page_size=4kb, align_size=512, atomic_phys_page_size=4kb, num_streams=1] mirror_super_block?=true]] total_super_blk_size=183697408
[06/12/24 14:11:43-07:00] [I] [5569] [physical_dev.cpp:87:PhysicalDev] Opening device /dev/data2 with BUFFERED_IO mode.
[06/12/24 14:11:43-07:00] [I] [5569] [physical_dev.cpp:108:PhysicalDev] Device /dev/data2 opened with dev_id=32 size=5.46tb
[06/12/24 14:11:43-07:00] [I] [5569] [device_manager.cpp:125:format_devices] Formatting Homestore on Device=/dev/data2 with first block as: [magic=0xceeddeeb, checksum=2175907333, first_blk_header=[gen_number=1, version=4, product_name=OmStore system_uuid=66358bb0-a84d-4193-a87e-b130181b5546], this_pdev_info=[data_offset=183.19mb, size=5.46tb, pdev_id=2 max_pdev_chunks=357664 dev_attr=[phys_page_size=4kb, align_size=512, atomic_phys_page_size=4kb, num_streams=1] mirror_super_block?=true]] total_super_blk_size=183697408
[06/12/24 14:11:44-07:00] [I] [5569] [physical_dev.cpp:87:PhysicalDev] Opening device /dev/data3 with BUFFERED_IO mode.
[06/12/24 14:11:44-07:00] [I] [5569] [physical_dev.cpp:108:PhysicalDev] Device /dev/data3 opened with dev_id=33 size=5.46tb
[06/12/24 14:11:44-07:00] [I] [5569] [device_manager.cpp:125:format_devices] Formatting Homestore on Device=/dev/data3 with first block as: [magic=0xceeddeeb, checksum=4283521036, first_blk_header=[gen_number=1, version=4, product_name=OmStore system_uuid=66358bb0-a84d-4193-a87e-b130181b5546], this_pdev_info=[data_offset=183.19mb, size=5.46tb, pdev_id=3 max_pdev_chunks=357664 dev_attr=[phys_page_size=4kb, align_size=512, atomic_phys_page_size=4kb, num_streams=1] mirror_super_block?=true]] total_super_blk_size=183697408
[06/12/24 14:11:44-07:00] [I] [5569] [device_manager.cpp:229:create_vdev] meta Virtual device is attempted to be created with num_chunks=1, it needs to be adjust to new_num_chunks=12
[06/12/24 14:11:44-07:00] [I] [5569] [device_manager.cpp:292:create_vdev] New Virtal Dev=meta of size=46.57gb with id=0 is attempted to be created with multi_pdev_opts=ALL_PDEV_STRIPED. The params are adjusted as follows: VDev_Size=46.57gb Num_pdevs=1 Total_chunks_across_all_pdevs=12 Each_Chunk_Size=3.88gb
[06/12/24 14:11:44-07:00] [I] [5569] [device_manager.cpp:324:create_vdev] 3205 chunks is created on pdev /dev/index for vdev meta
[06/12/24 14:11:44-07:00] [E] [5569] [physical_dev.cpp:266:create_chunks] Creation of chunks failed because of space, removing 119 partially created chunks
unknown file: Failure
C++ exception with description "Physical dev has no room for additional chunk" thrown in SetUp().

[xiaoxichen]

maybe related with #415