-----============= acceptance-small: conf-sanity ============----- Tue Sep 8 09:53:27 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg441-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683394 >= 34553653) for LU-16938, go 81 - see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683394 >= 34554143) for LU-18348, go 32b 32c - see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683394 >= 34617107) for LU-17920, go 123ae 123ag - see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683394 >= 34681950) for LU-19740, go 115 excepting tests: 32b 32c 32newtarball Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg441-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg441-server oleg441-server: oleg441-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: kmemleak disabled oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server == conf-sanity test 45: long unlink handling in ptlrpcd == 09:56:59 (1788875819) start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server unloading modules via unload_modules_local on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing unload_modules_local oleg441-server: kmemleak disabled modules unloaded. pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 PASS 45 (278s) == conf-sanity test 69: replace an OST with the same index ========================================================== 10:01:37 (1788876097) start mds service on oleg441-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x 1 green green 1921056 Sep 8 06:56 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: kmemleak disabled oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg441-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg441-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg441-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 737 (time 1788876205.33 total 10.00 last 73.67) - open/close 1433 (time 1788876215.33 total 20.01 last 69.57) - open/close 2116 (time 1788876225.34 total 30.01 last 68.27) - open/close 2894 (time 1788876235.36 total 40.03 last 77.66) - open/close 3578 (time 1788876245.36 total 50.03 last 68.38) - open/close 4250 (time 1788876255.40 total 60.07 last 66.93) - open/close 4965 (time 1788876265.40 total 70.08 last 71.46) - open/close 5655 (time 1788876275.42 total 80.09 last 68.91) - open/close 6287 (time 1788876285.42 total 90.10 last 63.16) - open/close 6973 (time 1788876295.42 total 100.10 last 68.60) - open/close 7695 (time 1788876305.44 total 110.11 last 72.08) - open/close 8358 (time 1788876315.46 total 120.13 last 66.19) - open/close 9064 (time 1788876325.46 total 130.14 last 70.57) - open/close 9767 (time 1788876335.47 total 140.15 last 70.21) total: 10000 open/close in 143.28 seconds: 69.79 ops/second - unlinked 0 (time 1788876342 ; total 0 ; last 0) total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second - open/close 803 (time 1788876431.64 total 10.01 last 80.26) - open/close 1541 (time 1788876441.65 total 20.01 last 73.76) - open/close 2315 (time 1788876451.66 total 30.02 last 77.33) - open/close 3053 (time 1788876461.66 total 40.02 last 73.78) - open/close 3827 (time 1788876471.67 total 50.03 last 77.35) - open/close 4636 (time 1788876481.67 total 60.03 last 80.89) - open/close 5457 (time 1788876491.68 total 70.04 last 82.01) - open/close 6272 (time 1788876501.69 total 80.05 last 81.42) - open/close 7046 (time 1788876511.70 total 90.06 last 77.35) - open/close 7838 (time 1788876521.71 total 100.07 last 79.08) - open/close 8594 (time 1788876531.72 total 110.08 last 75.56) - open/close 9326 (time 1788876541.72 total 120.08 last 73.18) total: 10000 open/close in 129.78 seconds: 77.06 ops/second - unlinked 0 (time 1788876555 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 762 (time 1788876647.72 total 10.01 last 76.15) - open/close 1515 (time 1788876657.73 total 20.02 last 75.21) - open/close 2274 (time 1788876667.74 total 30.03 last 75.83) - open/close 3008 (time 1788876677.76 total 40.05 last 73.25) - open/close 3737 (time 1788876687.77 total 50.06 last 72.82) - open/close 4475 (time 1788876697.78 total 60.07 last 73.73) - open/close 5255 (time 1788876707.79 total 70.08 last 77.90) - open/close 5971 (time 1788876717.79 total 80.08 last 71.59) - open/close 6726 (time 1788876727.80 total 90.09 last 75.46) - open/close 7470 (time 1788876737.81 total 100.10 last 74.33) - open/close 8181 (time 1788876747.82 total 110.11 last 71.03) - open/close 8944 (time 1788876757.83 total 120.12 last 76.17) - open/close 9674 (time 1788876767.84 total 130.13 last 72.97) total: 10000 open/close in 134.24 seconds: 74.49 ops/second - unlinked 0 (time 1788876775 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 707 (time 1788876862.50 total 10.01 last 70.61) - open/close 1323 (time 1788876872.51 total 20.02 last 61.56) - open/close 2011 (time 1788876882.52 total 30.03 last 68.72) - open/close 2688 (time 1788876892.52 total 40.03 last 67.68) - open/close 3326 (time 1788876902.53 total 50.04 last 63.77) - open/close 3993 (time 1788876912.53 total 60.05 last 66.64) - open/close 4621 (time 1788876922.54 total 70.06 last 62.74) - open/close 5262 (time 1788876932.56 total 80.07 last 64.02) - open/close 5899 (time 1788876942.57 total 90.08 last 63.62) - open/close 6499 (time 1788876952.58 total 100.09 last 59.93) - open/close 7155 (time 1788876962.59 total 110.10 last 65.55) - open/close 7775 (time 1788876972.59 total 120.10 last 61.99) - open/close 8419 (time 1788876982.61 total 130.12 last 64.27) - open/close 9088 (time 1788876992.61 total 140.13 last 66.88) - open/close 9743 (time 1788877002.62 total 150.14 last 65.43) total: 10000 open/close in 153.98 seconds: 64.94 ops/second - unlinked 0 (time 1788877010 ; total 0 ; last 0) total: 10000 unlinks in 84 seconds: 119.047623 unlinks/second - open/close 598 (time 1788877109.80 total 10.00 last 59.79) - open/close 1242 (time 1788877119.80 total 20.00 last 64.38) - open/close 1907 (time 1788877129.81 total 30.01 last 66.47) - open/close 2528 (time 1788877139.82 total 40.02 last 62.00) - open/close 3179 (time 1788877149.83 total 50.03 last 65.05) - open/close 3895 (time 1788877159.83 total 60.04 last 71.57) - open/close 4538 (time 1788877169.84 total 70.04 last 64.29) - open/close 5212 (time 1788877179.85 total 80.05 last 67.34) - open/close 5949 (time 1788877189.85 total 90.05 last 73.67) - open/close 6673 (time 1788877199.85 total 100.06 last 72.36) - open/close 7411 (time 1788877209.86 total 110.06 last 73.77) - open/close 8164 (time 1788877219.87 total 120.07 last 75.21) - open/close 8843 (time 1788877229.88 total 130.08 last 67.86) - open/close 9558 (time 1788877239.88 total 140.08 last 71.50) total: 10000 open/close in 146.03 seconds: 68.48 ops/second - unlinked 0 (time 1788877249 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 669 (time 1788877339.07 total 10.01 last 66.86) - open/close 1375 (time 1788877349.08 total 20.01 last 70.57) - open/close 2086 (time 1788877359.09 total 30.03 last 70.99) - open/close 2816 (time 1788877369.09 total 40.03 last 73.00) - open/close 3547 (time 1788877379.10 total 50.03 last 73.04) - open/close 4284 (time 1788877389.11 total 60.05 last 73.62) - open/close 5025 (time 1788877399.13 total 70.06 last 74.00) - open/close 5753 (time 1788877409.13 total 80.06 last 72.77) - open/close 6511 (time 1788877419.14 total 90.07 last 75.73) - open/close 7330 (time 1788877429.15 total 100.08 last 81.87) - open/close 8143 (time 1788877439.16 total 110.09 last 81.21) - open/close 8977 (time 1788877449.16 total 120.10 last 83.34) - open/close 9831 (time 1788877459.17 total 130.10 last 85.39) total: 10000 open/close in 132.08 seconds: 75.71 ops/second - unlinked 0 (time 1788877464 ; total 0 ; last 0) total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second - open/close 370 (time 1788877558.28 total 10.07 last 36.75) - open/close 806 (time 1788877568.29 total 20.08 last 43.55) - open/close 1276 (time 1788877578.29 total 30.08 last 46.98) - open/close 1928 (time 1788877588.30 total 40.09 last 65.19) - open/close 2481 (time 1788877598.31 total 50.10 last 55.22) - open/close 3155 (time 1788877608.33 total 60.12 last 67.30) - open/close 3570 (time 1788877618.35 total 70.15 last 41.38) - open/close 4184 (time 1788877628.37 total 80.16 last 61.33) - open/close 4736 (time 1788877638.38 total 90.17 last 55.10) - open/close 5340 (time 1788877648.38 total 100.18 last 60.40) - open/close 6097 (time 1788877658.39 total 110.18 last 75.66) - open/close 6807 (time 1788877668.40 total 120.19 last 70.92) - open/close 7513 (time 1788877678.40 total 130.19 last 70.58) - open/close 8234 (time 1788877688.41 total 140.20 last 72.08) - open/close 8994 (time 1788877698.42 total 150.21 last 75.87) - open/close 9737 (time 1788877708.43 total 160.22 last 74.24) total: 10000 open/close in 163.82 seconds: 61.04 ops/second - unlinked 0 (time 1788877716 ; total 0 ; last 0) total: 10000 unlinks in 79 seconds: 126.582275 unlinks/second - open/close 604 (time 1788877812.53 total 10.00 last 60.40) - open/close 1243 (time 1788877822.54 total 20.01 last 63.85) - open/close 1897 (time 1788877832.54 total 30.01 last 65.39) - open/close 2692 (time 1788877842.55 total 40.02 last 79.41) - open/close 3495 (time 1788877852.56 total 50.03 last 80.24) - open/close 4212 (time 1788877862.56 total 60.03 last 71.68) - open/close 4900 (time 1788877872.57 total 70.04 last 68.75) - open/close 5654 (time 1788877882.58 total 80.05 last 75.28) - open/close 6368 (time 1788877892.60 total 90.08 last 71.24) - open/close 7120 (time 1788877902.62 total 100.09 last 75.10) - open/close 7867 (time 1788877912.62 total 110.09 last 74.68) - open/close 8647 (time 1788877922.62 total 120.09 last 77.99) - open/close 9359 (time 1788877932.62 total 130.10 last 71.19) total: 10000 open/close in 139.49 seconds: 71.69 ops/second - unlinked 0 (time 1788877946 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 746 (time 1788878037.08 total 10.03 last 74.41) - open/close 1513 (time 1788878047.08 total 20.03 last 76.70) - open/close 2233 (time 1788878057.08 total 30.03 last 71.97) - open/close 2955 (time 1788878067.10 total 40.05 last 72.07) - open/close 3563 (time 1788878077.11 total 50.06 last 60.70) - open/close 4248 (time 1788878087.14 total 60.09 last 68.34) - open/close 4727 (time 1788878097.14 total 70.09 last 47.87) - open/close 5231 (time 1788878107.15 total 80.10 last 50.35) - open/close 5940 (time 1788878117.16 total 90.11 last 70.82) - open/close 6638 (time 1788878127.17 total 100.12 last 69.76) - open/close 7293 (time 1788878137.17 total 110.12 last 65.49) - open/close 8017 (time 1788878147.18 total 120.13 last 72.32) - open/close 8780 (time 1788878157.19 total 130.14 last 76.25) - open/close 9543 (time 1788878167.19 total 140.14 last 76.30) total: 10000 open/close in 145.95 seconds: 68.52 ops/second - unlinked 0 (time 1788878177 ; total 0 ; last 0) total: 10000 unlinks in 69 seconds: 144.927536 unlinks/second - open/close 828 (time 1788878260.46 total 10.01 last 82.72) - open/close 1638 (time 1788878270.47 total 20.02 last 80.89) - open/close 2417 (time 1788878280.47 total 30.02 last 77.90) - open/close 3241 (time 1788878290.48 total 40.04 last 82.30) - open/close 4086 (time 1788878300.49 total 50.04 last 84.46) - open/close 4959 (time 1788878310.49 total 60.05 last 87.25) - open/close 5799 (time 1788878320.50 total 70.05 last 83.98) - open/close 6619 (time 1788878330.50 total 80.05 last 81.97) - open/close 7434 (time 1788878340.50 total 90.06 last 81.46) - open/close 8310 (time 1788878350.51 total 100.06 last 87.57) - open/close 9152 (time 1788878360.51 total 110.07 last 84.14) - open/close 9945 (time 1788878370.52 total 120.07 last 79.27) total: 10000 open/close in 120.76 seconds: 82.81 ops/second - unlinked 0 (time 1788878374 ; total 0 ; last 0) total: 10000 unlinks in 63 seconds: 158.730164 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server unloading modules via unload_modules_local on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing unload_modules_local oleg441-server: kmemleak disabled modules unloaded. pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 PASS 69 (2442s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 10:42:19 (1788878539) oleg441-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 oleg441-server: oleg441-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x 1 green green 1921056 Sep 8 06:56 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: kmemleak disabled oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg441-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg441-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg441-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) oleg441-server: oleg441-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: kmemleak disabled oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server SKIP 111 (133s) Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) oleg441-server: oleg441-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: kmemleak disabled oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3093 sec ========== 10:45:02 (1788878702) === conf-sanity: start cleanup 10:45:03 (1788878703) === === conf-sanity: finish cleanup 10:45:05 (1788878705) ===