-----============= acceptance-small: conf-sanity ============----- Mon Jun 29 14:03:19 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg441-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682451 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg441-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg441-server oleg441-server: oleg441-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg441-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server == conf-sanity test 45: long unlink handling in ptlrpcd == 14:05:54 (1782756354) start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server unloading modules via unload_modules_local on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing unload_modules_local oleg441-server: modules unloaded. pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 PASS 45 (290s) == conf-sanity test 69: replace an OST with the same index ========================================================== 14:10:43 (1782756643) start mds service on oleg441-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg441-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg441-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 861 (time 1782756756.45 total 10.00 last 86.09) - open/close 1671 (time 1782756766.46 total 20.01 last 80.96) - open/close 2471 (time 1782756776.46 total 30.01 last 79.99) - open/close 3038 (time 1782756786.48 total 40.03 last 56.58) - open/close 3418 (time 1782756796.49 total 50.04 last 37.95) - open/close 4073 (time 1782756806.50 total 60.05 last 65.46) - open/close 4712 (time 1782756816.52 total 70.07 last 63.75) - open/close 5381 (time 1782756826.52 total 80.07 last 66.87) - open/close 6015 (time 1782756836.54 total 90.09 last 63.28) - open/close 6491 (time 1782756846.55 total 100.10 last 47.57) - open/close 7077 (time 1782756856.56 total 110.11 last 58.53) - open/close 7807 (time 1782756866.56 total 120.11 last 73.00) - open/close 8560 (time 1782756876.57 total 130.12 last 75.24) - open/close 9285 (time 1782756886.58 total 140.13 last 72.41) - open/close 9923 (time 1782756896.58 total 150.13 last 63.79) total: 10000 open/close in 151.03 seconds: 66.21 ops/second - unlinked 0 (time 1782756903 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second - open/close 822 (time 1782756991.65 total 10.01 last 82.13) - open/close 1691 (time 1782757001.65 total 20.01 last 86.87) - open/close 2580 (time 1782757011.66 total 30.02 last 88.86) - open/close 3433 (time 1782757021.66 total 40.02 last 85.29) - open/close 4293 (time 1782757031.67 total 50.03 last 85.93) - open/close 5174 (time 1782757041.67 total 60.03 last 88.06) - open/close 6023 (time 1782757051.68 total 70.04 last 84.82) - open/close 6832 (time 1782757061.68 total 80.04 last 80.89) - open/close 7704 (time 1782757071.69 total 90.05 last 87.13) - open/close 8536 (time 1782757081.69 total 100.05 last 83.17) - open/close 9335 (time 1782757091.70 total 110.06 last 79.84) total: 10000 open/close in 118.62 seconds: 84.31 ops/second - unlinked 0 (time 1782757104 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 858 (time 1782757197.56 total 10.00 last 85.78) - open/close 1577 (time 1782757207.57 total 20.01 last 71.86) - open/close 2243 (time 1782757217.58 total 30.02 last 66.52) - open/close 2769 (time 1782757227.59 total 40.03 last 52.53) - open/close 3242 (time 1782757237.60 total 50.04 last 47.26) - open/close 3941 (time 1782757247.61 total 60.05 last 69.84) - open/close 4774 (time 1782757257.61 total 70.05 last 83.27) - open/close 5545 (time 1782757267.62 total 80.06 last 77.07) - open/close 6325 (time 1782757277.62 total 90.06 last 77.94) - open/close 7083 (time 1782757287.63 total 100.07 last 75.77) - open/close 7771 (time 1782757297.63 total 110.07 last 68.77) - open/close 8442 (time 1782757307.64 total 120.08 last 67.08) - open/close 9156 (time 1782757317.64 total 130.08 last 71.37) - open/close 9828 (time 1782757327.65 total 140.09 last 67.13) total: 10000 open/close in 143.44 seconds: 69.71 ops/second - unlinked 0 (time 1782757335 ; total 0 ; last 0) total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second - open/close 759 (time 1782757425.58 total 10.01 last 75.79) - open/close 1549 (time 1782757435.58 total 20.02 last 78.96) - open/close 2337 (time 1782757445.59 total 30.03 last 78.76) - open/close 3147 (time 1782757455.59 total 40.03 last 80.98) - open/close 3995 (time 1782757465.62 total 50.05 last 84.59) - open/close 4788 (time 1782757475.62 total 60.06 last 79.26) - open/close 5558 (time 1782757485.63 total 70.07 last 76.92) - open/close 6376 (time 1782757495.64 total 80.07 last 81.75) - open/close 7263 (time 1782757505.64 total 90.08 last 88.66) - open/close 8048 (time 1782757515.65 total 100.08 last 78.46) - open/close 8941 (time 1782757525.65 total 110.09 last 89.26) - open/close 9818 (time 1782757535.66 total 120.09 last 87.64) total: 10000 open/close in 122.34 seconds: 81.74 ops/second - unlinked 0 (time 1782757541 ; total 0 ; last 0) total: 10000 unlinks in 80 seconds: 125.000000 unlinks/second - open/close 655 (time 1782757638.73 total 10.00 last 65.50) - open/close 1370 (time 1782757648.73 total 20.00 last 71.49) - open/close 2030 (time 1782757658.73 total 30.01 last 65.95) - open/close 2512 (time 1782757668.74 total 40.01 last 48.18) - open/close 3254 (time 1782757678.76 total 50.03 last 74.08) - open/close 3896 (time 1782757688.76 total 60.03 last 64.19) - open/close 4534 (time 1782757698.77 total 70.05 last 63.69) - open/close 5275 (time 1782757708.78 total 80.05 last 74.05) - open/close 6011 (time 1782757718.78 total 90.06 last 73.57) - open/close 6688 (time 1782757728.80 total 100.07 last 67.62) - open/close 7506 (time 1782757738.80 total 110.07 last 81.79) - open/close 8391 (time 1782757748.80 total 120.08 last 88.48) - open/close 9074 (time 1782757758.84 total 130.12 last 68.03) - open/close 9665 (time 1782757768.85 total 140.13 last 59.04) total: 10000 open/close in 144.81 seconds: 69.05 ops/second - unlinked 0 (time 1782757778 ; total 0 ; last 0) total: 10000 unlinks in 71 seconds: 140.845078 unlinks/second - open/close 847 (time 1782757863.69 total 10.01 last 84.66) - open/close 1673 (time 1782757873.70 total 20.01 last 82.55) - open/close 2391 (time 1782757883.71 total 30.02 last 71.74) - open/close 3222 (time 1782757893.71 total 40.03 last 83.05) - open/close 3896 (time 1782757903.72 total 50.03 last 67.37) - open/close 4729 (time 1782757913.73 total 60.04 last 83.22) - open/close 5591 (time 1782757923.73 total 70.04 last 86.20) - open/close 6398 (time 1782757933.73 total 80.05 last 80.64) - open/close 7250 (time 1782757943.74 total 90.05 last 85.16) - open/close 8017 (time 1782757953.74 total 100.06 last 76.65) - open/close 8902 (time 1782757963.75 total 110.06 last 88.45) - open/close 9713 (time 1782757973.76 total 120.07 last 81.05) total: 10000 open/close in 123.02 seconds: 81.29 ops/second - unlinked 0 (time 1782757981 ; total 0 ; last 0) total: 10000 unlinks in 72 seconds: 138.888885 unlinks/second - open/close 595 (time 1782758071.12 total 10.02 last 59.39) - open/close 1338 (time 1782758081.12 total 20.03 last 74.25) - open/close 2012 (time 1782758091.12 total 30.03 last 67.40) - open/close 2788 (time 1782758101.13 total 40.03 last 77.57) - open/close 3540 (time 1782758111.13 total 50.03 last 75.19) - open/close 4222 (time 1782758121.13 total 60.04 last 68.16) - open/close 4893 (time 1782758131.14 total 70.04 last 67.09) - open/close 5531 (time 1782758141.14 total 80.04 last 63.80) - open/close 6274 (time 1782758151.16 total 90.06 last 74.15) - open/close 6996 (time 1782758161.17 total 100.07 last 72.12) - open/close 7745 (time 1782758171.17 total 110.07 last 74.85) - open/close 8426 (time 1782758181.18 total 120.08 last 68.04) - open/close 9028 (time 1782758191.19 total 130.10 last 60.13) - open/close 9475 (time 1782758201.20 total 140.10 last 44.68) total: 10000 open/close in 148.65 seconds: 67.27 ops/second - unlinked 0 (time 1782758214 ; total 0 ; last 0) total: 10000 unlinks in 79 seconds: 126.582275 unlinks/second - open/close 643 (time 1782758310.20 total 10.01 last 64.21) - open/close 1430 (time 1782758320.21 total 20.02 last 78.66) - open/close 2219 (time 1782758330.22 total 30.03 last 78.80) - open/close 3005 (time 1782758340.24 total 40.05 last 78.45) - open/close 3926 (time 1782758350.24 total 50.05 last 92.09) - open/close 4681 (time 1782758360.24 total 60.05 last 75.48) - open/close 5543 (time 1782758370.25 total 70.06 last 86.17) - open/close 6072 (time 1782758380.25 total 80.06 last 52.88) - open/close 6774 (time 1782758390.26 total 90.07 last 70.16) - open/close 7586 (time 1782758400.27 total 100.08 last 81.07) - open/close 8240 (time 1782758410.27 total 110.09 last 65.38) - open/close 8916 (time 1782758420.29 total 120.10 last 67.49) - open/close 9770 (time 1782758430.30 total 130.11 last 85.35) total: 10000 open/close in 133.05 seconds: 75.16 ops/second - unlinked 0 (time 1782758437 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 874 (time 1782758525.82 total 10.01 last 87.31) - open/close 1738 (time 1782758535.82 total 20.01 last 86.36) - open/close 2516 (time 1782758545.83 total 30.03 last 77.71) - open/close 3346 (time 1782758555.85 total 40.04 last 82.88) - open/close 4128 (time 1782758565.87 total 50.06 last 78.05) - open/close 4911 (time 1782758575.87 total 60.06 last 78.28) - open/close 5828 (time 1782758585.88 total 70.07 last 91.66) - open/close 6697 (time 1782758595.88 total 80.07 last 86.86) - open/close 7566 (time 1782758605.88 total 90.07 last 86.87) - open/close 8401 (time 1782758615.90 total 100.09 last 83.39) - open/close 9153 (time 1782758625.90 total 110.09 last 75.18) - open/close 9867 (time 1782758635.90 total 120.09 last 71.37) total: 10000 open/close in 121.50 seconds: 82.30 ops/second - unlinked 0 (time 1782758641 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second - open/close 780 (time 1782758730.71 total 10.02 last 77.86) - open/close 1441 (time 1782758740.71 total 20.02 last 66.08) - open/close 1961 (time 1782758750.71 total 30.02 last 52.00) - open/close 2642 (time 1782758760.73 total 40.04 last 68.00) - open/close 3341 (time 1782758770.74 total 50.05 last 69.84) - open/close 4001 (time 1782758780.74 total 60.05 last 65.98) - open/close 4811 (time 1782758790.76 total 70.07 last 80.88) - open/close 5563 (time 1782758800.76 total 80.07 last 75.13) - open/close 6236 (time 1782758810.77 total 90.08 last 67.25) - open/close 6938 (time 1782758820.78 total 100.09 last 70.15) - open/close 7682 (time 1782758830.79 total 110.10 last 74.31) - open/close 8397 (time 1782758840.82 total 120.13 last 71.28) - open/close 9151 (time 1782758850.83 total 130.14 last 75.34) - open/close 9961 (time 1782758860.84 total 140.15 last 80.92) total: 10000 open/close in 140.64 seconds: 71.10 ops/second - unlinked 0 (time 1782758866 ; total 0 ; last 0) total: 10000 unlinks in 72 seconds: 138.888885 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.204.141@tcp sys.timeout=20 start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg441-client.virtnet: -o user_xattr,flock 192.168.204.141@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg441-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server unloading modules via unload_modules_local on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing unload_modules_local oleg441-server: modules unloaded. pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-client: ssh exited with exit code 2 pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 PASS 69 (2441s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 14:51:25 (1782759085) oleg441-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg441-client: oleg441-server: ssh exited with exit code 2 oleg441-server: oleg441-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions oleg441-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg441-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg441-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) oleg441-server: oleg441-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg441-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg441-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg441-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg441-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg441-server: oleg441-server.virtnet: executing set_default_debug -1 all pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg441-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg441-server: oleg441-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg441-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg441-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg441-server stop mds service on oleg441-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg441-server SKIP 111 (144s) Stopping clients: oleg441-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg441-client.virtnet /mnt/lustre2 (opts:-f) oleg441-server: oleg441-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg441-server' oleg441-server: oleg441-server.virtnet: executing load_modules_local oleg441-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg441-server: Loading modules from /home/green/git/lustre-release/lustre oleg441-server: detected 4 online CPUs by sysfs oleg441-server: MODOPTS_LIBCFS= oleg441-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3055 sec ========== 14:54:16 (1782759256) === conf-sanity: start cleanup 14:54:17 (1782759257) === === conf-sanity: finish cleanup 14:54:19 (1782759259) ===