-----============= acceptance-small: conf-sanity ============----- Wed Mar 6 23:44:03 EST 2024 excepting tests: 32newtarball 110 skipping tests SLOW=no: 45 69 106 111 114 Stopping clients: oleg242-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg242-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg242-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg242-server oleg242-server: oleg242-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory loading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing load_modules_local oleg242-server: Loading modules from /home/green/git/lustre-release/lustre oleg242-server: detected 4 online CPUs by sysfs oleg242-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format mds2: lustre-mdt2/mdt2 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt2/mdt2 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg242-server: oleg242-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg242-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg242-server: oleg242-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg242-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server debug_raw_pointers=Y debug_raw_pointers=Y == conf-sanity test 35b: Continue reconnection retries, if the active server is busy ========================================================== 23:45:42 (1709786742) start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre debug=ha conf-sanity.sh test_35b 2024-03-0623h46m04s Set up a fake failnode for the MDS at_max=0 at_max=0 Injecting EBUSY on MDS fail_loc=0x80000136 mdc.lustre-MDT0000-mdc-ffff8800b6c7d800.stats=clear mdc.lustre-MDT0001-mdc-ffff8800b6c7d800.stats=clear Creating a test file and stat it File: '/mnt/lustre/d35b.conf-sanity/f35b.conf-sanity' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115238826934274 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-03-06 23:46:50.000000000 -0500 Modify: 2024-03-06 23:46:50.000000000 -0500 Change: 2024-03-06 23:46:50.000000000 -0500 Birth: - Stop injecting EBUSY on MDS fail_loc=0 done at_max=600 at_max=600 Debug log: 67 lines, 67 kept, 0 dropped, 0 bad. umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server unloading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing unload_modules_local modules unloaded. oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-mdt1/mdt1 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-mdt2/mdt2 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-ost1/ost1 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-ost2/ost2 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found tunefs failed, reformatting instead Stopping clients: oleg242-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg242-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 oleg242-server: oleg242-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing load_modules_local oleg242-server: Loading modules from /home/green/git/lustre-release/lustre oleg242-server: detected 4 online CPUs by sysfs oleg242-server: Force libcfs to create 2 CPU partitions oleg242-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg242-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format mds2: lustre-mdt2/mdt2 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt2/mdt2 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg242-server: oleg242-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg242-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg242-server: oleg242-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg242-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server PASS 35b (197s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == conf-sanity test 38: MDS recreates missing lov_objid file from OST data ========================================================== 23:49:02 (1709786942) start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre copying 10 files to /mnt/lustre/d38.conf-sanity tar: Removing leading `/' from member names umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:) osp.lustre-OST0000-osc-MDT0000.prealloc_next_id=44 osp.lustre-OST0000-osc-MDT0001.prealloc_next_id=34 stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server delete lov_objid file on MDS 000000 43 000008 start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre osp.lustre-OST0000-osc-MDT0000.prealloc_next_id=2 osp.lustre-OST0000-osc-MDT0001.prealloc_next_id=66 umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:) stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server 000000 2 000008 oleg242-server: 8+0 records in oleg242-server: 8+0 records out oleg242-server: 4096 bytes (4.1 kB) copied, 0.00073216 s, 5.6 MB/s start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre osp.lustre-OST0000-osc-MDT0000.prealloc_next_id=35 osp.lustre-OST0000-osc-MDT0001.prealloc_next_id=98 umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:) stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server 000000 34 000008 files compared the same umount lustre on /mnt/lustre..... stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server stop mds service on oleg242-server unloading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg242-client: oleg242-client: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-client: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 PASS 38 (171s) error: set_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: setting 'debug_raw_pointers'='0': No such file or directory oleg242-server: error: set_param: param_path 'debug_raw_pointers': No such file or directory oleg242-server: error: set_param: setting 'debug_raw_pointers'='0': No such file or directory error: get_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: setting 'debug_raw_pointers'='Y': No such file or directory oleg242-server: error: get_param: param_path 'debug_raw_pointers': No such file or directory pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 oleg242-server: error: set_param: param_path 'debug_raw_pointers': No such file or directory oleg242-server: error: set_param: setting 'debug_raw_pointers'='Y': No such file or directory == conf-sanity test 51: Verify that mdt_reint handles RMF_MDT_MD correctly when an OST is added ========================================================== 23:51:56 (1709787116) Stopping clients: oleg242-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg242-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 oleg242-server: oleg242-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing load_modules_local oleg242-server: Loading modules from /home/green/git/lustre-release/lustre oleg242-server: detected 4 online CPUs by sysfs oleg242-server: Force libcfs to create 2 CPU partitions oleg242-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg242-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format mds2: lustre-mdt2/mdt2 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt2/mdt2 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre setup single mount lustre success fail_loc=0x142 start ost2 service on oleg242-server Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-ost2/ost2 Started lustre-OST0001 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec stop ost2 service on oleg242-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg242-server umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:-f) stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server unloading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing unload_modules_local modules unloaded. oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-mdt1/mdt1 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-mdt2/mdt2 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-ost1/ost1 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found oleg242-server: oleg242-server: tunefs.lustre FATAL: Device lustre-ost2/ost2 has not been formatted with mkfs.lustre oleg242-server: tunefs.lustre: exiting with 19 (No such device) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 19 checking for existing Lustre data: not found tunefs failed, reformatting instead Stopping clients: oleg242-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg242-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 oleg242-server: oleg242-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing load_modules_local oleg242-server: Loading modules from /home/green/git/lustre-release/lustre oleg242-server: detected 4 online CPUs by sysfs oleg242-server: Force libcfs to create 2 CPU partitions oleg242-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg242-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format mds2: lustre-mdt2/mdt2 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-mdt2/mdt2 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg242-server: oleg242-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg242-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg242-server: oleg242-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg242-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server PASS 51 (262s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:56:22 (1709787382) start mds service on oleg242-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 221 (time 1709787438.41 total 10.49 last 21.08) - open/close 437 (time 1709787449.12 total 21.19 last 20.18) - open/close 681 (time 1709787459.37 total 31.45 last 23.79) - open/close 910 (time 1709787469.80 total 41.87 last 21.97) - open/close 1089 (time 1709787479.80 total 51.88 last 17.89) - open/close 1214 (time 1709787489.93 total 62.00 last 12.35) - open/close 1398 (time 1709787500.94 total 73.01 last 16.71) - open/close 1618 (time 1709787511.18 total 83.25 last 21.48) - open/close 1776 (time 1709787521.67 total 93.74 last 15.06) - open/close 2078 (time 1709787531.68 total 103.75 last 30.16) - open/close 2343 (time 1709787542.61 total 114.69 last 24.24) - open/close 2618 (time 1709787552.63 total 124.70 last 27.46) - open/close 2808 (time 1709787562.64 total 134.72 last 18.98) - open/close 3050 (time 1709787573.18 total 145.25 last 22.97) - open/close 3217 (time 1709787583.33 total 155.40 last 16.45) - open/close 3486 (time 1709787593.57 total 165.65 last 26.25) - open/close 3601 (time 1709787603.66 total 175.74 last 11.40) - open/close 3801 (time 1709787613.68 total 185.75 last 19.97) - open/close 4021 (time 1709787623.69 total 195.76 last 21.98) - open/close 4189 (time 1709787633.84 total 205.91 last 16.55) - open/close 4340 (time 1709787644.47 total 216.54 last 14.20) - open/close 4547 (time 1709787654.64 total 226.71 last 20.35) - open/close 4636 (time 1709787665.22 total 237.29 last 8.41) - open/close 4794 (time 1709787675.23 total 247.30 last 15.79) - open/close 5031 (time 1709787685.79 total 257.87 last 22.43) - open/close 5158 (time 1709787695.83 total 267.91 last 12.65) - open/close 5311 (time 1709787705.86 total 277.93 last 15.26) - open/close 5494 (time 1709787716.30 total 288.37 last 17.53) - open/close 5645 (time 1709787726.71 total 298.78 last 14.51) - open/close 5761 (time 1709787737.08 total 309.16 last 11.18) - open/close 5961 (time 1709787747.10 total 319.17 last 19.97) - open/close 6108 (time 1709787757.11 total 329.18 last 14.69) - open/close 6251 (time 1709787767.22 total 339.29 last 14.14) - open/close 6415 (time 1709787778.26 total 350.34 last 14.85) - open/close 6497 (time 1709787788.88 total 360.95 last 7.72) - open/close 6669 (time 1709787799.12 total 371.19 last 16.79) - open/close 6788 (time 1709787809.29 total 381.36 last 11.70) - open/close 6976 (time 1709787820.32 total 392.40 last 17.04) - open/close 7144 (time 1709787831.16 total 403.24 last 15.50) - open/close 7358 (time 1709787841.61 total 413.69 last 20.48) - open/close 7509 (time 1709787852.18 total 424.26 last 14.29) - open/close 7691 (time 1709787862.24 total 434.32 last 18.09) - open/close 7814 (time 1709787872.26 total 444.34 last 12.27) - open/close 8017 (time 1709787883.01 total 455.09 last 18.88) - open/close 8227 (time 1709787893.92 total 465.99 last 19.26) - open/close 8378 (time 1709787904.25 total 476.32 last 14.62) - open/close 8550 (time 1709787914.96 total 487.03 last 16.05) - open/close 8780 (time 1709787924.96 total 497.04 last 22.99) - open/close 9003 (time 1709787935.47 total 507.55 last 21.22) - open/close 9182 (time 1709787945.78 total 517.86 last 17.36) - open/close 9377 (time 1709787956.71 total 528.79 last 17.84) - open/close 9644 (time 1709787966.73 total 538.80 last 26.67) - open/close 9822 (time 1709787976.73 total 548.80 last 17.80) - open/close 10000 (time 1709787982.59 total 554.67 last 30.35) - open/close 10194 (time 1709787992.61 total 564.68 last 19.37) - open/close 10636 (time 1709788002.62 total 574.69 last 44.16) - open/close 11386 (time 1709788012.63 total 584.70 last 74.92) - open/close 12227 (time 1709788022.63 total 594.71 last 84.06) - open/close 13036 (time 1709788032.63 total 604.71 last 80.86) - open/close 13815 (time 1709788042.64 total 614.71 last 77.87) - open/close 14547 (time 1709788052.65 total 624.72 last 73.13) - open/close 15255 (time 1709788062.65 total 634.73 last 70.78) - open/close 15902 (time 1709788072.66 total 644.73 last 64.65) - open/close 16528 (time 1709788082.67 total 654.74 last 62.56) - open/close 17153 (time 1709788092.67 total 664.74 last 62.49) - open/close 17745 (time 1709788102.67 total 674.74 last 59.18) - open/close 18308 (time 1709788112.68 total 684.76 last 56.24) - open/close 18890 (time 1709788122.69 total 694.77 last 58.14) - open/close 19444 (time 1709788132.70 total 704.77 last 55.37) - open/close 19989 (time 1709788142.71 total 714.78 last 54.43) - open/close 20525 (time 1709788152.71 total 724.79 last 53.57) - open/close 21066 (time 1709788162.72 total 734.80 last 54.05) - open/close 21611 (time 1709788172.74 total 744.81 last 54.42) - open/close 22140 (time 1709788182.76 total 754.83 last 52.81) - open/close 22634 (time 1709788192.76 total 764.83 last 49.39) - open/close 23109 (time 1709788202.78 total 774.85 last 47.41) - open/close 23606 (time 1709788212.79 total 784.87 last 49.62) - open/close 24105 (time 1709788222.81 total 794.89 last 49.80) - open/close 24580 (time 1709788232.81 total 804.89 last 47.50) - open/close 25037 (time 1709788242.82 total 814.89 last 45.67) - open/close 25495 (time 1709788252.84 total 824.91 last 45.71) - open/close 25930 (time 1709788262.84 total 834.92 last 43.48) - open/close 26373 (time 1709788272.86 total 844.94 last 44.22) - open/close 26807 (time 1709788282.86 total 854.94 last 43.39) - open/close 27190 (time 1709788292.88 total 864.95 last 38.25) - open/close 27592 (time 1709788302.90 total 874.97 last 40.13) - open/close 27976 (time 1709788312.90 total 884.98 last 38.38) - open/close 28350 (time 1709788322.90 total 894.98 last 37.40) - open/close 28722 (time 1709788332.91 total 904.98 last 37.18) - open/close 29081 (time 1709788342.93 total 915.01 last 35.81) - open/close 29445 (time 1709788352.94 total 925.02 last 36.36) - open/close 29817 (time 1709788362.96 total 935.04 last 37.13) - open/close 30000 (time 1709788367.96 total 940.04 last 36.58) - open/close 30344 (time 1709788377.99 total 950.06 last 34.32) - open/close 30698 (time 1709788388.01 total 960.09 last 35.32) - open/close 31035 (time 1709788398.02 total 970.10 last 33.66) - open/close 31407 (time 1709788408.04 total 980.12 last 37.14) - open/close 31794 (time 1709788418.06 total 990.14 last 38.62) - open/close 32164 (time 1709788428.08 total 1000.16 last 36.93) - open/close 32561 (time 1709788438.10 total 1010.17 last 39.63) - open/close 32947 (time 1709788448.12 total 1020.20 last 38.51) - open/close 33305 (time 1709788458.15 total 1030.22 last 35.72) - open/close 33653 (time 1709788468.17 total 1040.25 last 34.71) - open/close 34015 (time 1709788478.17 total 1050.25 last 36.20) - open/close 34393 (time 1709788488.20 total 1060.27 last 37.71) - open/close 34779 (time 1709788498.20 total 1070.27 last 38.59) - open/close 35161 (time 1709788508.21 total 1080.28 last 38.17) - open/close 35543 (time 1709788518.23 total 1090.31 last 38.11) - open/close 35918 (time 1709788528.25 total 1100.33 last 37.41) - open/close 36288 (time 1709788538.26 total 1110.33 last 36.98) - open/close 36664 (time 1709788548.26 total 1120.34 last 37.59) - open/close 37031 (time 1709788558.27 total 1130.34 last 36.68) - open/close 37383 (time 1709788568.30 total 1140.37 last 35.10) - open/close 37739 (time 1709788578.31 total 1150.39 last 35.54) - open/close 38093 (time 1709788588.32 total 1160.40 last 35.36) - open/close 38443 (time 1709788598.34 total 1170.41 last 34.96) - open/close 38799 (time 1709788608.35 total 1180.42 last 35.56) - open/close 39148 (time 1709788618.37 total 1190.44 last 34.82) - open/close 39492 (time 1709788628.37 total 1200.44 last 34.40) - open/close 39822 (time 1709788638.39 total 1210.47 last 32.93) - open/close 40000 (time 1709788644.05 total 1216.13 last 31.45) - open/close 40302 (time 1709788654.07 total 1226.15 last 30.13) - open/close 40635 (time 1709788664.08 total 1236.15 last 33.30) - open/close 40950 (time 1709788674.09 total 1246.17 last 31.45) - open/close 41270 (time 1709788684.11 total 1256.19 last 31.93) - open/close 41585 (time 1709788694.12 total 1266.19 last 31.49) - open/close 41908 (time 1709788704.13 total 1276.21 last 32.25) - open/close 42227 (time 1709788714.15 total 1286.23 last 31.84) - open/close 42567 (time 1709788724.16 total 1296.24 last 33.97) - open/close 42885 (time 1709788734.17 total 1306.25 last 31.76) - open/close 43210 (time 1709788744.18 total 1316.26 last 32.47) - open/close 43529 (time 1709788754.19 total 1326.27 last 31.87) - open/close 43843 (time 1709788764.21 total 1336.28 last 31.34) - open/close 44159 (time 1709788774.22 total 1346.29 last 31.57) - open/close 44466 (time 1709788784.25 total 1356.32 last 30.62) - open/close 44773 (time 1709788794.26 total 1366.34 last 30.65) - open/close 45085 (time 1709788804.29 total 1376.36 last 31.12) - open/close 45389 (time 1709788814.31 total 1386.38 last 30.34) - open/close 45685 (time 1709788824.32 total 1396.39 last 29.57) - open/close 45974 (time 1709788834.34 total 1406.41 last 28.84) - open/close 46269 (time 1709788844.36 total 1416.44 last 29.43) - open/close 46571 (time 1709788854.36 total 1426.44 last 30.20) - open/close 46866 (time 1709788864.37 total 1436.44 last 29.48) - open/close 47163 (time 1709788874.38 total 1446.45 last 29.68) - open/close 47456 (time 1709788884.38 total 1456.45 last 29.30) - open/close 47748 (time 1709788894.38 total 1466.46 last 29.18) - open/close 48038 (time 1709788904.40 total 1476.47 last 28.95) - open/close 48317 (time 1709788914.41 total 1486.49 last 27.86) - open/close 48593 (time 1709788924.43 total 1496.50 last 27.56) - open/close 48879 (time 1709788934.45 total 1506.52 last 28.54) - open/close 49156 (time 1709788944.45 total 1516.53 last 27.69) - open/close 49427 (time 1709788954.47 total 1526.54 last 27.06) - open/close 49696 (time 1709788964.50 total 1536.57 last 26.81) - open/close 49969 (time 1709788974.53 total 1546.60 last 27.23) total: 50000 open/close in 1547.69 seconds: 32.31 ops/second - unlinked 0 (time 1709788976 ; total 0 ; last 0) - unlinked 10000 (time 1709789402 ; total 426 ; last 426) - unlinked 20000 (time 1709789752 ; total 776 ; last 350) - unlinked 30000 (time 1709789992 ; total 1016 ; last 240) - unlinked 40000 (time 1709790100 ; total 1124 ; last 108) total: 50000 unlinks in 1156 seconds: 43.252594 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server unloading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg242-client: oleg242-client: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-client: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 PASS 101a (2767s) error: set_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: setting 'debug_raw_pointers'='0': No such file or directory oleg242-server: error: set_param: param_path 'debug_raw_pointers': No such file or directory oleg242-server: error: set_param: setting 'debug_raw_pointers'='0': No such file or directory error: get_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: setting 'debug_raw_pointers'='Y': No such file or directory oleg242-server: error: get_param: param_path 'debug_raw_pointers': No such file or directory pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 oleg242-server: error: set_param: param_path 'debug_raw_pointers': No such file or directory oleg242-server: error: set_param: setting 'debug_raw_pointers'='Y': No such file or directory == conf-sanity test 101b: Race events DISCONNECT and ACTIVE in osp ========================================================== 00:42:30 (1709790150) start mds service on oleg242-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing load_modules_local oleg242-server: Loading modules from /home/green/git/lustre-release/lustre oleg242-server: detected 4 online CPUs by sysfs oleg242-server: Force libcfs to create 2 CPU partitions oleg242-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg242-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg242-server Starting mds2: -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg242-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg242-client.virtnet: -o user_xattr,flock oleg242-server@tcp:/lustre /mnt/lustre fail_loc=0x80002107 fail_val=20 stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server start ost1 service on oleg242-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg242-server: oleg242-server.virtnet: executing set_default_debug -1 all pdsh@oleg242-client: oleg242-server: ssh exited with exit code 1 Started lustre-OST0000 oleg242-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 8 sec oleg242-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff88012ab93000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff88012ab93000.ost_server_uuid in FULL state after 0 sec umount lustre on /mnt/lustre..... Stopping client oleg242-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg242-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg242-server stop mds service on oleg242-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg242-server unloading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg242-client: oleg242-client: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-client: ssh exited with exit code 2 pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 PASS 101b (88s) error: set_param: param_path 'debug_raw_pointers': No such file or directory error: set_param: setting 'debug_raw_pointers'='0': No such file or directory oleg242-server: error: set_param: param_path 'debug_raw_pointers': No such file or directory oleg242-server: error: set_param: setting 'debug_raw_pointers'='0': No such file or directory Stopping clients: oleg242-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg242-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg242-client: oleg242-server: ssh exited with exit code 2 oleg242-server: oleg242-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg242-server' oleg242-server: oleg242-server.virtnet: executing load_modules_local oleg242-server: Loading modules from /home/green/git/lustre-release/lustre oleg242-server: detected 4 online CPUs by sysfs oleg242-server: Force libcfs to create 2 CPU partitions oleg242-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg242-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg242-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format mds2: lustre-mdt2/mdt2 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3617 sec ========== 00:44:20 (1709790260) === conf-sanity: start cleanup 00:44:20 (1709790260) === === conf-sanity: finish cleanup 00:44:20 (1709790260) ===