-----============= acceptance-small: conf-sanity ============----- Thu May 1 17:08:04 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg235-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex: No such file or directory excepting tests: 32b 32c 32newtarball Stopping clients: oleg235-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg235-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg235-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg235-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg235-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg235-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg235-server oleg235-server: oleg235-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory loading modules on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing load_modules_local oleg235-server: Loading modules from /home/green/git/lustre-release/lustre oleg235-server: detected 4 online CPUs by sysfs oleg235-server: MODOPTS_LIBCFS= oleg235-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg235-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg235-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg235-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg235-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg235-server: oleg235-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg235-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg235-server: oleg235-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg235-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg235-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg235-server == conf-sanity test 45: long unlink handling in ptlrpcd == 17:09:44 (1746133784) start mds service on oleg235-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg235-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg235-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-OST0000 oleg235-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg235-client.virtnet: -o user_xattr,flock 192.168.202.135@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg235-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg235-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: '/mnt/lustre': Cannot send after transport endpoint shutdown fail_loc=0x0 start mds service on oleg235-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg235-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg235-client.virtnet: -o user_xattr,flock 192.168.202.135@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg235-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg235-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg235-server unloading modules via unload_modules_local on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg235-client: oleg235-server: ssh exited with exit code 2 pdsh@oleg235-client: oleg235-client: ssh exited with exit code 2 pdsh@oleg235-client: oleg235-client: ssh exited with exit code 2 pdsh@oleg235-client: oleg235-server: ssh exited with exit code 2 PASS 45 (177s) == conf-sanity test 69: replace an OST with the same index ========================================================== 17:12:41 (1746133961) start mds service on oleg235-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing load_modules_local oleg235-server: Loading modules from /home/green/git/lustre-release/lustre oleg235-server: detected 4 online CPUs by sysfs oleg235-server: MODOPTS_LIBCFS= oleg235-server: Force libcfs to create 2 CPU partitions oleg235-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg235-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg235-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg235-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-OST0000 oleg235-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg235-client.virtnet: -o user_xattr,flock 192.168.202.135@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49504 inodes available. Want 99872. rc=0 - open/close 974 (time 1746134023.62 total 10.01 last 97.34) - open/close 2061 (time 1746134033.62 total 20.01 last 108.67) - open/close 3195 (time 1746134043.63 total 30.01 last 113.36) - open/close 4264 (time 1746134053.66 total 40.05 last 106.50) - open/close 5265 (time 1746134063.66 total 50.05 last 100.09) - open/close 6532 (time 1746134073.67 total 60.05 last 126.67) - open/close 7645 (time 1746134083.67 total 70.05 last 111.29) - open/close 8680 (time 1746134093.68 total 80.07 last 103.34) - open/close 9661 (time 1746134103.70 total 90.08 last 97.98) total: 10000 open/close in 93.46 seconds: 107.00 ops/second - unlinked 0 (time 1746134108 ; total 0 ; last 0) total: 10000 unlinks in 54 seconds: 185.185181 unlinks/second - open/close 975 (time 1746134174.99 total 10.00 last 97.48) - open/close 1900 (time 1746134185.00 total 20.00 last 92.48) - open/close 2896 (time 1746134195.00 total 30.01 last 99.55) - open/close 3848 (time 1746134205.01 total 40.01 last 95.16) - open/close 4744 (time 1746134215.02 total 50.03 last 89.48) - open/close 5609 (time 1746134225.02 total 60.03 last 86.48) - open/close 6508 (time 1746134235.02 total 70.03 last 89.89) - open/close 7472 (time 1746134245.02 total 80.03 last 96.40) - open/close 8396 (time 1746134255.03 total 90.04 last 92.33) - open/close 9271 (time 1746134265.04 total 100.05 last 87.41) total: 10000 open/close in 108.94 seconds: 91.80 ops/second - unlinked 0 (time 1746134276 ; total 0 ; last 0) total: 10000 unlinks in 64 seconds: 156.250000 unlinks/second - open/close 881 (time 1746134352.70 total 10.01 last 88.04) - open/close 1903 (time 1746134362.70 total 20.01 last 102.16) - open/close 2850 (time 1746134372.71 total 30.02 last 94.65) - open/close 3815 (time 1746134382.71 total 40.02 last 96.43) - open/close 4669 (time 1746134392.72 total 50.03 last 85.36) - open/close 5595 (time 1746134402.73 total 60.04 last 92.53) - open/close 6567 (time 1746134412.73 total 70.04 last 97.20) - open/close 7472 (time 1746134422.74 total 80.05 last 90.39) - open/close 8343 (time 1746134432.74 total 90.05 last 87.07) - open/close 9326 (time 1746134442.74 total 100.05 last 98.30) total: 10000 open/close in 105.52 seconds: 94.77 ops/second - unlinked 0 (time 1746134450 ; total 0 ; last 0) total: 10000 unlinks in 60 seconds: 166.666672 unlinks/second - open/close 1113 (time 1746134522.64 total 10.01 last 111.22) - open/close 2034 (time 1746134532.66 total 20.03 last 91.85) - open/close 2996 (time 1746134542.67 total 30.04 last 96.18) - open/close 4275 (time 1746134552.68 total 40.05 last 127.74) - open/close 5279 (time 1746134562.68 total 50.05 last 100.37) - open/close 6136 (time 1746134572.69 total 60.06 last 85.64) - open/close 7141 (time 1746134582.69 total 70.06 last 100.45) - open/close 8470 (time 1746134592.70 total 80.07 last 132.78) - open/close 9382 (time 1746134602.71 total 90.08 last 91.15) total: 10000 open/close in 97.83 seconds: 102.22 ops/second - unlinked 0 (time 1746134612 ; total 0 ; last 0) total: 10000 unlinks in 57 seconds: 175.438599 unlinks/second - open/close 914 (time 1746134681.63 total 10.01 last 91.35) - open/close 2005 (time 1746134691.64 total 20.01 last 109.04) - open/close 2994 (time 1746134701.64 total 30.01 last 98.88) - open/close 3876 (time 1746134711.65 total 40.03 last 88.08) - open/close 4772 (time 1746134721.66 total 50.03 last 89.56) - open/close 5904 (time 1746134731.66 total 60.03 last 113.20) - open/close 6828 (time 1746134741.66 total 70.03 last 92.39) - open/close 7702 (time 1746134751.67 total 80.04 last 87.33) - open/close 8761 (time 1746134761.67 total 90.04 last 105.86) - open/close 9924 (time 1746134771.68 total 100.05 last 116.19) total: 10000 open/close in 100.84 seconds: 99.17 ops/second - unlinked 0 (time 1746134774 ; total 0 ; last 0) total: 10000 unlinks in 63 seconds: 158.730164 unlinks/second - open/close 1027 (time 1746134849.42 total 10.01 last 102.63) - open/close 1935 (time 1746134859.43 total 20.01 last 90.75) - open/close 2968 (time 1746134869.43 total 30.02 last 103.21) - open/close 3871 (time 1746134879.45 total 40.03 last 90.20) - open/close 4690 (time 1746134889.45 total 50.04 last 81.86) - open/close 5520 (time 1746134899.46 total 60.05 last 82.92) - open/close 6437 (time 1746134909.47 total 70.05 last 91.65) - open/close 7353 (time 1746134919.47 total 80.05 last 91.60) - open/close 8231 (time 1746134929.47 total 90.06 last 87.74) - open/close 9089 (time 1746134939.48 total 100.06 last 85.76) total: 10000 open/close in 109.60 seconds: 91.24 ops/second - unlinked 0 (time 1746134951 ; total 0 ; last 0) total: 10000 unlinks in 65 seconds: 153.846161 unlinks/second - open/close 890 (time 1746135027.82 total 10.01 last 88.92) - open/close 1683 (time 1746135037.84 total 20.03 last 79.15) - open/close 2549 (time 1746135047.84 total 30.03 last 86.59) - open/close 3385 (time 1746135057.84 total 40.03 last 83.60) - open/close 4173 (time 1746135067.85 total 50.04 last 78.75) - open/close 4931 (time 1746135077.85 total 60.04 last 75.79) - open/close 5757 (time 1746135087.86 total 70.04 last 82.57) - open/close 6716 (time 1746135097.86 total 80.04 last 95.88) - open/close 7644 (time 1746135107.87 total 90.05 last 92.70) - open/close 8461 (time 1746135117.87 total 100.06 last 81.66) - open/close 9317 (time 1746135127.88 total 110.06 last 85.56) total: 10000 open/close in 117.60 seconds: 85.03 ops/second - unlinked 0 (time 1746135137 ; total 0 ; last 0) total: 10000 unlinks in 61 seconds: 163.934433 unlinks/second - open/close 924 (time 1746135210.45 total 10.01 last 92.33) - open/close 1853 (time 1746135220.45 total 20.01 last 92.88) - open/close 2862 (time 1746135230.45 total 30.01 last 100.88) - open/close 3954 (time 1746135240.46 total 40.02 last 109.13) - open/close 4971 (time 1746135250.47 total 50.03 last 101.57) - open/close 5918 (time 1746135260.48 total 60.04 last 94.60) - open/close 6926 (time 1746135270.48 total 70.04 last 100.76) - open/close 8008 (time 1746135280.49 total 80.05 last 108.09) - open/close 8916 (time 1746135290.50 total 90.06 last 90.79) - open/close 9940 (time 1746135300.50 total 100.06 last 102.34) total: 10000 open/close in 100.66 seconds: 99.35 ops/second - unlinked 0 (time 1746135302 ; total 0 ; last 0) total: 10000 unlinks in 58 seconds: 172.413788 unlinks/second - open/close 1044 (time 1746135372.88 total 10.00 last 104.37) - open/close 2152 (time 1746135382.88 total 20.01 last 110.75) - open/close 3396 (time 1746135392.89 total 30.01 last 124.35) - open/close 4440 (time 1746135402.89 total 40.01 last 104.38) - open/close 5453 (time 1746135412.90 total 50.03 last 101.18) - open/close 6541 (time 1746135422.90 total 60.03 last 108.78) - open/close 7599 (time 1746135432.91 total 70.04 last 105.68) - open/close 8737 (time 1746135442.92 total 80.05 last 113.72) - open/close 9725 (time 1746135452.92 total 90.05 last 98.77) total: 10000 open/close in 92.61 seconds: 107.98 ops/second - unlinked 0 (time 1746135457 ; total 0 ; last 0) total: 10000 unlinks in 52 seconds: 192.307693 unlinks/second - open/close 1114 (time 1746135521.86 total 10.00 last 111.37) - open/close 2217 (time 1746135531.87 total 20.02 last 110.09) - open/close 3294 (time 1746135541.88 total 30.03 last 107.64) - open/close 4466 (time 1746135551.88 total 40.03 last 117.16) - open/close 5746 (time 1746135561.88 total 50.03 last 127.99) - open/close 6940 (time 1746135571.89 total 60.03 last 119.36) - open/close 8076 (time 1746135581.89 total 70.04 last 113.54) - open/close 9094 (time 1746135591.90 total 80.05 last 101.73) total: 10000 open/close in 86.83 seconds: 115.17 ops/second - unlinked 0 (time 1746135600 ; total 0 ; last 0) total: 10000 unlinks in 47 seconds: 212.765961 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg235-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg235-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg235-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: ,errors=remount-ro Parameters: mgsnode=192.168.202.135@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k Writing CONFIGS/mountdata start ost1 service on oleg235-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Started lustre-OST0000 oleg235-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg235-server: oleg235-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg235-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 4 sec oleg235-server: oleg235-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg235-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg235-client.virtnet: -o user_xattr,flock 192.168.202.135@tcp:/lustre /mnt/lustre On OST0, 18885 used inodes rc=0 umount lustre on /mnt/lustre..... Stopping client oleg235-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg235-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg235-server unloading modules via unload_modules_local on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg235-client: oleg235-client: ssh exited with exit code 2 pdsh@oleg235-client: oleg235-server: ssh exited with exit code 2 pdsh@oleg235-client: oleg235-client: ssh exited with exit code 2 pdsh@oleg235-client: oleg235-server: ssh exited with exit code 2 PASS 69 (1739s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 17:41:40 (1746135700) oleg235-server: debugfs 1.46.2.wc5 (26-Mar-2022) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity Stopping clients: oleg235-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg235-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg235-client: oleg235-server: ssh exited with exit code 2 oleg235-server: oleg235-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing load_modules_local oleg235-server: Loading modules from /home/green/git/lustre-release/lustre oleg235-server: detected 4 online CPUs by sysfs oleg235-server: MODOPTS_LIBCFS= oleg235-server: Force libcfs to create 2 CPU partitions oleg235-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg235-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg235-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg235-client.virtnet /mnt/lustre2 (opts:-f) oleg235-server: oleg235-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing load_modules_local oleg235-server: Loading modules from /home/green/git/lustre-release/lustre oleg235-server: detected 4 online CPUs by sysfs oleg235-server: MODOPTS_LIBCFS= oleg235-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg235-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg235-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg235-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg235-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg235-server: oleg235-server.virtnet: executing set_default_debug -1 all pdsh@oleg235-client: oleg235-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg235-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg235-server: oleg235-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg235-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg235-server: oleg235-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg235-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg235-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg235-server stop mds service on oleg235-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg235-server SKIP 111 (106s) Stopping clients: oleg235-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg235-client.virtnet /mnt/lustre2 (opts:-f) oleg235-server: oleg235-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory loading modules on: 'oleg235-server' oleg235-server: oleg235-server.virtnet: executing load_modules_local oleg235-server: Loading modules from /home/green/git/lustre-release/lustre oleg235-server: detected 4 online CPUs by sysfs oleg235-server: MODOPTS_LIBCFS= oleg235-server: Force libcfs to create 2 CPU partitions oleg235-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 2144 sec ========== 17:43:49 (1746135829) === conf-sanity: start cleanup 17:43:49 (1746135829) === === conf-sanity: finish cleanup 17:43:51 (1746135831) ===