-----============= acceptance-small: conf-sanity ============----- Thu Sep 3 09:27:58 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg101-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682931 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball Stopping clients: oleg101-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg101-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg101-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg101-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg101-server oleg101-server: oleg101-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing load_modules_local oleg101-server: Loading modules from /home/green/git/lustre-release/lustre oleg101-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg101-server: detected 4 online CPUs by sysfs oleg101-server: MODOPTS_LIBCFS= oleg101-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg101-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg101-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg101-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg101-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg101-server == conf-sanity test 45: long unlink handling in ptlrpcd == 09:32:00 (1788442320) start mds service on oleg101-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg101-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg101-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-OST0000 oleg101-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg101-client.virtnet: -o user_xattr,flock 192.168.201.101@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg101-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg101-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg101-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg101-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg101-client.virtnet: -o user_xattr,flock 192.168.201.101@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg101-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg101-server unloading modules via unload_modules_local on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing unload_modules_local oleg101-server: modules unloaded. pdsh@oleg101-client: oleg101-server: ssh exited with exit code 2 pdsh@oleg101-client: oleg101-client: ssh exited with exit code 2 pdsh@oleg101-client: oleg101-client: ssh exited with exit code 2 pdsh@oleg101-client: oleg101-server: ssh exited with exit code 2 PASS 45 (307s) == conf-sanity test 69: replace an OST with the same index ========================================================== 09:37:07 (1788442627) start mds service on oleg101-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing load_modules_local oleg101-server: Loading modules from /home/green/git/lustre-release/lustre oleg101-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg101-server: detected 4 online CPUs by sysfs oleg101-server: MODOPTS_LIBCFS= oleg101-server: Force libcfs to create 2 CPU partitions oleg101-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg101-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg101-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg101-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg101-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-OST0000 oleg101-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg101-client.virtnet: -o user_xattr,flock 192.168.201.101@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 764 (time 1788442753.50 total 10.00 last 76.37) - open/close 1599 (time 1788442763.50 total 20.00 last 83.50) - open/close 2365 (time 1788442773.52 total 30.03 last 76.43) - open/close 2885 (time 1788442783.53 total 40.03 last 51.97) - open/close 3374 (time 1788442793.53 total 50.04 last 48.88) - open/close 3887 (time 1788442803.54 total 60.04 last 51.29) - open/close 4551 (time 1788442813.54 total 70.05 last 66.36) - open/close 5131 (time 1788442823.56 total 80.06 last 57.90) - open/close 5819 (time 1788442833.58 total 90.08 last 68.67) - open/close 6480 (time 1788442843.59 total 100.09 last 66.02) - open/close 7191 (time 1788442853.60 total 110.10 last 71.07) - open/close 7909 (time 1788442863.60 total 120.10 last 71.77) - open/close 8692 (time 1788442873.61 total 130.12 last 78.19) - open/close 9486 (time 1788442883.62 total 140.13 last 79.33) total: 10000 open/close in 146.50 seconds: 68.26 ops/second - unlinked 0 (time 1788442894 ; total 0 ; last 0) total: 10000 unlinks in 79 seconds: 126.582275 unlinks/second - open/close 847 (time 1788442989.20 total 10.01 last 84.65) - open/close 1389 (time 1788442999.21 total 20.02 last 54.14) - open/close 1977 (time 1788443009.23 total 30.04 last 58.69) - open/close 2556 (time 1788443019.24 total 40.04 last 57.85) - open/close 3209 (time 1788443029.25 total 50.05 last 65.27) - open/close 3807 (time 1788443039.25 total 60.05 last 59.78) - open/close 4595 (time 1788443049.26 total 70.06 last 78.71) - open/close 5419 (time 1788443059.26 total 80.07 last 82.39) - open/close 6084 (time 1788443069.28 total 90.08 last 66.41) - open/close 6836 (time 1788443079.28 total 100.08 last 75.19) - open/close 7545 (time 1788443089.28 total 110.08 last 70.88) - open/close 8261 (time 1788443099.28 total 120.09 last 71.59) - open/close 9122 (time 1788443109.29 total 130.10 last 86.00) - open/close 9806 (time 1788443119.30 total 140.10 last 68.38) total: 10000 open/close in 142.87 seconds: 69.99 ops/second - unlinked 0 (time 1788443126 ; total 0 ; last 0) total: 10000 unlinks in 85 seconds: 117.647057 unlinks/second - open/close 629 (time 1788443227.92 total 10.00 last 62.89) - open/close 1354 (time 1788443237.93 total 20.01 last 72.42) - open/close 2148 (time 1788443247.93 total 30.02 last 79.34) - open/close 3044 (time 1788443257.94 total 40.03 last 89.55) - open/close 3829 (time 1788443267.94 total 50.03 last 78.48) - open/close 4649 (time 1788443277.95 total 60.03 last 81.98) - open/close 5533 (time 1788443287.97 total 70.06 last 88.17) - open/close 6335 (time 1788443297.99 total 80.08 last 80.05) - open/close 7130 (time 1788443308.00 total 90.08 last 79.46) - open/close 7886 (time 1788443318.01 total 100.09 last 75.51) - open/close 8685 (time 1788443328.02 total 110.11 last 79.76) - open/close 9516 (time 1788443338.03 total 120.11 last 83.09) total: 10000 open/close in 126.03 seconds: 79.34 ops/second - unlinked 0 (time 1788443348 ; total 0 ; last 0) total: 10000 unlinks in 89 seconds: 112.359550 unlinks/second - open/close 719 (time 1788443453.33 total 10.00 last 71.87) - open/close 1428 (time 1788443463.33 total 20.00 last 70.90) - open/close 2064 (time 1788443473.35 total 30.02 last 63.49) - open/close 2734 (time 1788443483.35 total 40.03 last 66.95) - open/close 3420 (time 1788443493.36 total 50.04 last 68.52) - open/close 4046 (time 1788443503.37 total 60.05 last 62.53) - open/close 4783 (time 1788443513.38 total 70.06 last 73.63) - open/close 5481 (time 1788443523.39 total 80.06 last 69.77) - open/close 6248 (time 1788443533.42 total 90.09 last 76.48) - open/close 7048 (time 1788443543.43 total 100.11 last 79.88) - open/close 7830 (time 1788443553.44 total 110.12 last 78.13) - open/close 8696 (time 1788443563.44 total 120.12 last 86.59) - open/close 9554 (time 1788443573.45 total 130.12 last 85.76) total: 10000 open/close in 136.00 seconds: 73.53 ops/second - unlinked 0 (time 1788443585 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 766 (time 1788443677.40 total 10.02 last 76.47) - open/close 1502 (time 1788443687.41 total 20.03 last 73.53) - open/close 2223 (time 1788443697.43 total 30.04 last 71.99) - open/close 2894 (time 1788443707.44 total 40.05 last 67.05) - open/close 3556 (time 1788443717.46 total 50.08 last 66.01) - open/close 4382 (time 1788443727.47 total 60.09 last 82.53) - open/close 5026 (time 1788443737.48 total 70.09 last 64.37) - open/close 5763 (time 1788443747.49 total 80.10 last 73.62) - open/close 6513 (time 1788443757.49 total 90.10 last 74.97) - open/close 7285 (time 1788443767.51 total 100.12 last 77.09) - open/close 7994 (time 1788443777.52 total 110.13 last 70.82) - open/close 8729 (time 1788443787.52 total 120.14 last 73.46) - open/close 9581 (time 1788443797.54 total 130.15 last 85.04) total: 10000 open/close in 135.86 seconds: 73.60 ops/second - unlinked 0 (time 1788443807 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second - open/close 737 (time 1788443891.93 total 10.00 last 73.70) - open/close 1575 (time 1788443901.94 total 20.00 last 83.78) - open/close 2431 (time 1788443911.94 total 30.01 last 85.55) - open/close 3277 (time 1788443921.95 total 40.01 last 84.56) - open/close 4167 (time 1788443931.96 total 50.03 last 88.88) - open/close 4900 (time 1788443941.97 total 60.03 last 73.25) - open/close 5598 (time 1788443951.98 total 70.04 last 69.74) - open/close 6117 (time 1788443961.99 total 80.06 last 51.80) - open/close 6715 (time 1788443972.01 total 90.07 last 59.72) - open/close 7497 (time 1788443982.02 total 100.09 last 78.12) - open/close 8054 (time 1788443992.02 total 110.09 last 55.70) - open/close 8670 (time 1788444002.03 total 120.10 last 61.54) - open/close 9194 (time 1788444012.04 total 130.11 last 52.35) total: 10000 open/close in 139.78 seconds: 71.54 ops/second - unlinked 0 (time 1788444026 ; total 0 ; last 0) total: 10000 unlinks in 86 seconds: 116.279068 unlinks/second - open/close 693 (time 1788444129.01 total 10.01 last 69.26) - open/close 1363 (time 1788444139.01 total 20.01 last 66.97) - open/close 2103 (time 1788444149.02 total 30.02 last 73.95) - open/close 2817 (time 1788444159.03 total 40.03 last 71.33) - open/close 3424 (time 1788444169.03 total 50.03 last 60.65) - open/close 4109 (time 1788444179.04 total 60.04 last 68.48) - open/close 4799 (time 1788444189.04 total 70.04 last 68.95) - open/close 5535 (time 1788444199.06 total 80.06 last 73.52) - open/close 6251 (time 1788444209.06 total 90.06 last 71.58) - open/close 6922 (time 1788444219.07 total 100.07 last 66.99) - open/close 7640 (time 1788444229.08 total 110.08 last 71.73) - open/close 8343 (time 1788444239.10 total 120.09 last 70.23) - open/close 9064 (time 1788444249.10 total 130.10 last 72.07) - open/close 9821 (time 1788444259.10 total 140.10 last 75.69) total: 10000 open/close in 142.04 seconds: 70.40 ops/second - unlinked 0 (time 1788444265 ; total 0 ; last 0) total: 10000 unlinks in 82 seconds: 121.951218 unlinks/second - open/close 768 (time 1788444362.95 total 10.02 last 76.65) - open/close 1530 (time 1788444372.95 total 20.02 last 76.18) - open/close 2553 (time 1788444382.96 total 30.03 last 102.22) - open/close 3315 (time 1788444392.98 total 40.04 last 76.10) - open/close 4041 (time 1788444402.99 total 50.05 last 72.52) - open/close 4777 (time 1788444413.00 total 60.06 last 73.52) - open/close 5553 (time 1788444423.00 total 70.07 last 77.58) - open/close 6230 (time 1788444433.01 total 80.08 last 67.61) - open/close 6876 (time 1788444443.02 total 90.08 last 64.58) - open/close 7482 (time 1788444453.04 total 100.10 last 60.48) - open/close 8280 (time 1788444463.05 total 110.12 last 79.71) - open/close 9026 (time 1788444473.06 total 120.12 last 74.54) - open/close 9931 (time 1788444483.07 total 130.13 last 90.40) total: 10000 open/close in 131.18 seconds: 76.23 ops/second - unlinked 0 (time 1788444488 ; total 0 ; last 0) total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second - open/close 733 (time 1788444578.54 total 10.01 last 73.26) - open/close 1564 (time 1788444588.55 total 20.01 last 83.05) - open/close 2202 (time 1788444598.58 total 30.05 last 63.56) - open/close 2841 (time 1788444608.59 total 40.05 last 63.86) - open/close 3538 (time 1788444618.60 total 50.06 last 69.64) - open/close 4168 (time 1788444628.61 total 60.07 last 62.96) - open/close 5015 (time 1788444638.61 total 70.07 last 84.67) - open/close 5882 (time 1788444648.64 total 80.10 last 86.45) - open/close 6666 (time 1788444658.65 total 90.11 last 78.30) - open/close 7470 (time 1788444668.66 total 100.12 last 80.35) - open/close 8171 (time 1788444678.66 total 110.13 last 70.05) - open/close 8809 (time 1788444688.68 total 120.14 last 63.72) - open/close 9518 (time 1788444698.68 total 130.15 last 70.85) total: 10000 open/close in 136.30 seconds: 73.37 ops/second - unlinked 0 (time 1788444710 ; total 0 ; last 0) total: 10000 unlinks in 87 seconds: 114.942528 unlinks/second - open/close 769 (time 1788444811.69 total 10.01 last 76.83) - open/close 1474 (time 1788444821.70 total 20.02 last 70.39) - open/close 2118 (time 1788444831.71 total 30.03 last 64.34) - open/close 2856 (time 1788444841.72 total 40.04 last 73.77) - open/close 3626 (time 1788444851.72 total 50.04 last 76.98) - open/close 4383 (time 1788444861.73 total 60.05 last 75.63) - open/close 4922 (time 1788444871.76 total 70.08 last 53.71) - open/close 5528 (time 1788444881.76 total 80.09 last 60.59) - open/close 6298 (time 1788444891.78 total 90.10 last 76.91) - open/close 7027 (time 1788444901.78 total 100.10 last 72.86) - open/close 7808 (time 1788444911.78 total 110.11 last 78.08) - open/close 8562 (time 1788444921.79 total 120.11 last 75.38) - open/close 9206 (time 1788444931.79 total 130.11 last 64.39) - open/close 9944 (time 1788444941.80 total 140.12 last 73.76) total: 10000 open/close in 140.94 seconds: 70.95 ops/second - unlinked 0 (time 1788444947 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg101-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.201.101@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg101-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-OST0000 oleg101-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg101-client.virtnet: -o user_xattr,flock 192.168.201.101@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg101-client: oleg101-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg101-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.201.101@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.201.101@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.201.101@tcp sys.timeout=20 start ost1 service on oleg101-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Started lustre-OST0000 oleg101-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg101-client.virtnet: -o user_xattr,flock 192.168.201.101@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg101-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg101-server unloading modules via unload_modules_local on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing unload_modules_local oleg101-server: modules unloaded. pdsh@oleg101-client: oleg101-client: ssh exited with exit code 2 pdsh@oleg101-client: oleg101-server: ssh exited with exit code 2 pdsh@oleg101-client: oleg101-client: ssh exited with exit code 2 pdsh@oleg101-client: oleg101-server: ssh exited with exit code 2 PASS 69 (2581s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 10:20:09 (1788445209) oleg101-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg101-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg101-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg101-client: oleg101-server: ssh exited with exit code 2 oleg101-server: oleg101-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing load_modules_local oleg101-server: Loading modules from /home/green/git/lustre-release/lustre oleg101-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg101-server: detected 4 online CPUs by sysfs oleg101-server: MODOPTS_LIBCFS= oleg101-server: Force libcfs to create 2 CPU partitions oleg101-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg101-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg101-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg101-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg101-client.virtnet /mnt/lustre2 (opts:-f) oleg101-server: oleg101-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing load_modules_local oleg101-server: Loading modules from /home/green/git/lustre-release/lustre oleg101-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg101-server: detected 4 online CPUs by sysfs oleg101-server: MODOPTS_LIBCFS= oleg101-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg101-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg101-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg101-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg101-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg101-server: oleg101-server.virtnet: executing set_default_debug -1 all pdsh@oleg101-client: oleg101-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg101-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg101-server: oleg101-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg101-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg101-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg101-server stop mds service on oleg101-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg101-server SKIP 111 (258s) Stopping clients: oleg101-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg101-client.virtnet /mnt/lustre2 (opts:-f) oleg101-server: oleg101-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg101-server' oleg101-server: oleg101-server.virtnet: executing load_modules_local oleg101-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg101-server: Loading modules from /home/green/git/lustre-release/lustre oleg101-server: detected 4 online CPUs by sysfs oleg101-server: MODOPTS_LIBCFS= oleg101-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3445 sec ========== 10:25:27 (1788445527) === conf-sanity: start cleanup 10:25:28 (1788445528) === === conf-sanity: finish cleanup 10:25:31 (1788445531) ===