-----============= acceptance-small: conf-sanity ============----- Mon Jun 1 13:06:33 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg243-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball Stopping clients: oleg243-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg243-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg243-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg243-server oleg243-server: oleg243-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg243-server: detected 4 online CPUs by sysfs oleg243-server: MODOPTS_LIBCFS= oleg243-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg243-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg243-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg243-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server == conf-sanity test 45: long unlink handling in ptlrpcd == 13:10:48 (1780333848) start mds service on oleg243-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg243-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg243-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-OST0000 oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg243-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg243-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg243-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg243-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server unloading modules via unload_modules_local on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing unload_modules_local oleg243-server: modules unloaded. pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 pdsh@oleg243-client: oleg243-client: ssh exited with exit code 2 pdsh@oleg243-client: oleg243-client: ssh exited with exit code 2 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 PASS 45 (306s) == conf-sanity test 69: replace an OST with the same index ========================================================== 13:15:54 (1780334154) start mds service on oleg243-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg243-server: detected 4 online CPUs by sysfs oleg243-server: MODOPTS_LIBCFS= oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg243-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg243-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg243-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg243-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-OST0000 oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 49503 inodes available. Want 99872. rc=0 - open/close 628 (time 1780334272.85 total 10.02 last 62.68) - open/close 1135 (time 1780334282.87 total 20.04 last 50.59) - open/close 1850 (time 1780334292.87 total 30.04 last 71.50) - open/close 2693 (time 1780334302.88 total 40.05 last 84.21) - open/close 3455 (time 1780334312.91 total 50.08 last 75.97) - open/close 4242 (time 1780334322.92 total 60.10 last 78.60) - open/close 5088 (time 1780334332.94 total 70.11 last 84.50) - open/close 5830 (time 1780334342.95 total 80.12 last 74.11) - open/close 6598 (time 1780334352.95 total 90.12 last 76.79) - open/close 7339 (time 1780334362.96 total 100.13 last 74.03) - open/close 7977 (time 1780334372.97 total 110.14 last 63.71) - open/close 8626 (time 1780334382.98 total 120.15 last 64.87) - open/close 9330 (time 1780334392.99 total 130.16 last 70.30) total: 10000 open/close in 138.46 seconds: 72.22 ops/second - unlinked 0 (time 1780334405 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 720 (time 1780334498.26 total 10.02 last 71.88) - open/close 1476 (time 1780334508.26 total 20.02 last 75.56) - open/close 2080 (time 1780334518.27 total 30.03 last 60.37) - open/close 2776 (time 1780334528.28 total 40.03 last 69.55) - open/close 3363 (time 1780334538.29 total 50.05 last 58.60) - open/close 4039 (time 1780334548.29 total 60.05 last 67.59) - open/close 4733 (time 1780334558.30 total 70.06 last 69.36) - open/close 5407 (time 1780334568.30 total 80.06 last 67.37) - open/close 6147 (time 1780334578.32 total 90.08 last 73.88) - open/close 6663 (time 1780334588.35 total 100.10 last 51.47) - open/close 7057 (time 1780334598.36 total 110.11 last 39.36) - open/close 7529 (time 1780334608.38 total 120.13 last 47.11) - open/close 8159 (time 1780334618.39 total 130.15 last 62.91) - open/close 8859 (time 1780334628.39 total 140.15 last 69.97) - open/close 9609 (time 1780334638.41 total 150.17 last 74.85) total: 10000 open/close in 155.54 seconds: 64.29 ops/second - unlinked 0 (time 1780334648 ; total 0 ; last 0) total: 10000 unlinks in 84 seconds: 119.047623 unlinks/second - open/close 627 (time 1780334747.61 total 10.00 last 62.67) - open/close 1262 (time 1780334757.62 total 20.01 last 63.45) - open/close 1886 (time 1780334767.64 total 30.04 last 62.23) - open/close 2533 (time 1780334777.65 total 40.05 last 64.66) - open/close 3286 (time 1780334787.65 total 50.05 last 75.28) - open/close 4021 (time 1780334797.66 total 60.05 last 73.45) - open/close 4652 (time 1780334807.66 total 70.06 last 63.09) - open/close 5317 (time 1780334817.67 total 80.06 last 66.46) - open/close 6182 (time 1780334827.67 total 90.06 last 86.49) - open/close 6831 (time 1780334837.67 total 100.07 last 64.86) - open/close 7590 (time 1780334847.68 total 110.08 last 75.84) - open/close 8384 (time 1780334857.68 total 120.08 last 79.36) - open/close 9166 (time 1780334867.69 total 130.09 last 78.15) - open/close 9827 (time 1780334877.70 total 140.10 last 66.05) total: 10000 open/close in 142.58 seconds: 70.14 ops/second - unlinked 0 (time 1780334886 ; total 1 ; last 1) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second - open/close 616 (time 1780334983.86 total 10.02 last 61.47) - open/close 1232 (time 1780334993.88 total 20.03 last 61.52) - open/close 1928 (time 1780335003.90 total 30.05 last 69.46) - open/close 2712 (time 1780335013.91 total 40.07 last 78.32) - open/close 3372 (time 1780335023.92 total 50.08 last 65.93) - open/close 4074 (time 1780335033.93 total 60.09 last 70.13) - open/close 4600 (time 1780335043.94 total 70.10 last 52.54) - open/close 5136 (time 1780335053.97 total 80.13 last 53.42) - open/close 5740 (time 1780335063.97 total 90.13 last 60.38) - open/close 6428 (time 1780335073.98 total 100.14 last 68.73) - open/close 7123 (time 1780335083.99 total 110.15 last 69.49) - open/close 7780 (time 1780335093.99 total 120.15 last 65.65) - open/close 8564 (time 1780335104.00 total 130.16 last 78.33) - open/close 9345 (time 1780335114.01 total 140.17 last 78.05) total: 10000 open/close in 148.28 seconds: 67.44 ops/second - unlinked 0 (time 1780335127 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 738 (time 1780335219.68 total 10.00 last 73.79) - open/close 1451 (time 1780335229.70 total 20.02 last 71.19) - open/close 2089 (time 1780335239.71 total 30.03 last 63.72) - open/close 2818 (time 1780335249.72 total 40.04 last 72.80) - open/close 3513 (time 1780335259.72 total 50.04 last 69.49) - open/close 4214 (time 1780335269.73 total 60.05 last 70.07) - open/close 5032 (time 1780335279.73 total 70.05 last 81.78) - open/close 5726 (time 1780335289.73 total 80.05 last 69.37) - open/close 6408 (time 1780335299.75 total 90.07 last 68.09) - open/close 7122 (time 1780335309.76 total 100.08 last 71.32) - open/close 7730 (time 1780335319.78 total 110.10 last 60.66) - open/close 8462 (time 1780335329.79 total 120.11 last 73.18) - open/close 9356 (time 1780335339.79 total 130.11 last 89.37) - open/close 9976 (time 1780335349.80 total 140.12 last 61.96) total: 10000 open/close in 140.51 seconds: 71.17 ops/second - unlinked 0 (time 1780335355 ; total 0 ; last 0) total: 10000 unlinks in 79 seconds: 126.582275 unlinks/second - open/close 716 (time 1780335448.89 total 10.00 last 71.59) - open/close 1500 (time 1780335458.90 total 20.01 last 78.32) - open/close 2244 (time 1780335468.90 total 30.01 last 74.38) - open/close 3076 (time 1780335478.92 total 40.03 last 83.10) - open/close 3908 (time 1780335488.93 total 50.04 last 83.11) - open/close 4720 (time 1780335498.93 total 60.04 last 81.16) - open/close 5588 (time 1780335508.93 total 70.04 last 86.79) - open/close 6197 (time 1780335518.94 total 80.05 last 60.86) - open/close 6896 (time 1780335528.94 total 90.05 last 69.89) - open/close 7624 (time 1780335538.94 total 100.05 last 72.80) - open/close 8375 (time 1780335548.95 total 110.06 last 75.06) - open/close 9233 (time 1780335558.96 total 120.07 last 85.72) total: 10000 open/close in 129.46 seconds: 77.25 ops/second - unlinked 0 (time 1780335572 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second - open/close 760 (time 1780335656.81 total 10.01 last 75.96) - open/close 1563 (time 1780335666.82 total 20.02 last 80.22) - open/close 2375 (time 1780335676.82 total 30.02 last 81.20) - open/close 3153 (time 1780335686.83 total 40.03 last 77.70) - open/close 3853 (time 1780335696.85 total 50.05 last 69.88) - open/close 4480 (time 1780335706.85 total 60.05 last 62.68) - open/close 5103 (time 1780335716.89 total 70.09 last 62.05) - open/close 5907 (time 1780335726.91 total 80.11 last 80.26) - open/close 6791 (time 1780335736.91 total 90.11 last 88.35) - open/close 7697 (time 1780335746.92 total 100.12 last 90.56) - open/close 8454 (time 1780335756.93 total 110.13 last 75.61) - open/close 9124 (time 1780335766.93 total 120.13 last 66.98) - open/close 9965 (time 1780335776.96 total 130.16 last 83.90) total: 10000 open/close in 130.96 seconds: 76.36 ops/second - unlinked 0 (time 1780335783 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 815 (time 1780335872.50 total 10.01 last 81.43) - open/close 1525 (time 1780335882.51 total 20.02 last 70.92) - open/close 2191 (time 1780335892.53 total 30.04 last 66.50) - open/close 2939 (time 1780335902.56 total 40.06 last 74.59) - open/close 3698 (time 1780335912.56 total 50.07 last 75.88) - open/close 4349 (time 1780335922.58 total 60.08 last 65.00) - open/close 5116 (time 1780335932.59 total 70.10 last 76.60) - open/close 5852 (time 1780335942.61 total 80.12 last 73.41) - open/close 6561 (time 1780335952.62 total 90.12 last 70.88) - open/close 7403 (time 1780335962.62 total 100.13 last 84.16) - open/close 8090 (time 1780335972.63 total 110.13 last 68.66) - open/close 8920 (time 1780335982.63 total 120.14 last 82.95) - open/close 9664 (time 1780335992.63 total 130.14 last 74.40) total: 10000 open/close in 134.46 seconds: 74.37 ops/second - unlinked 0 (time 1780336001 ; total 0 ; last 0) total: 10000 unlinks in 75 seconds: 133.333328 unlinks/second - open/close 739 (time 1780336091.39 total 10.03 last 73.69) - open/close 1452 (time 1780336101.39 total 20.04 last 71.24) - open/close 2174 (time 1780336111.40 total 30.04 last 72.18) - open/close 2801 (time 1780336121.41 total 40.05 last 62.65) - open/close 3321 (time 1780336131.42 total 50.06 last 51.92) - open/close 3897 (time 1780336141.42 total 60.07 last 57.58) - open/close 4478 (time 1780336151.44 total 70.08 last 58.01) - open/close 5169 (time 1780336161.44 total 80.08 last 69.07) - open/close 5908 (time 1780336171.45 total 90.09 last 73.85) - open/close 6618 (time 1780336181.47 total 100.11 last 70.86) - open/close 7530 (time 1780336191.48 total 110.12 last 91.10) - open/close 8424 (time 1780336201.48 total 120.12 last 89.38) - open/close 9226 (time 1780336211.50 total 130.14 last 80.10) total: 10000 open/close in 139.14 seconds: 71.87 ops/second - unlinked 0 (time 1780336225 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 899 (time 1780336318.20 total 10.00 last 89.88) - open/close 1595 (time 1780336328.21 total 20.01 last 69.54) - open/close 2374 (time 1780336338.22 total 30.02 last 77.81) - open/close 3230 (time 1780336348.23 total 40.03 last 85.56) - open/close 4103 (time 1780336358.23 total 50.03 last 87.30) - open/close 4879 (time 1780336368.24 total 60.04 last 77.48) - open/close 5496 (time 1780336378.25 total 70.05 last 61.65) - open/close 6242 (time 1780336388.26 total 80.06 last 74.52) - open/close 6900 (time 1780336398.27 total 90.07 last 65.75) - open/close 7541 (time 1780336408.28 total 100.08 last 64.04) - open/close 8240 (time 1780336418.28 total 110.09 last 69.85) - open/close 9035 (time 1780336428.29 total 120.09 last 79.43) - open/close 9723 (time 1780336438.33 total 130.13 last 68.53) total: 10000 open/close in 133.59 seconds: 74.86 ops/second - unlinked 0 (time 1780336447 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg243-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.143@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre-OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre-OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k start ost1 service on oleg243-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-OST0000 oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre On OST0, 20430 used inodes rc=0 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg243-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.143@tcp sys.timeout=20 device size = 4096MB formatting backing filesystem ldiskfs on /dev/mapper/ost1_flakey target name lustre:OST0000 kilobytes 200000 options -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F mkfs_cmd = mke2fs -j -b 4096 -L lustre:OST0000 -b 4096 -I 512 -q -O uninit_bg,extents,dir_nlink,quota,project,huge_file,large_dir,^fast_commit,flex_bg -G 256 -E lazy_itable_init,resize="4290772992",lazy_journal_init,packed_meta_blocks -F /dev/mapper/ost1_flakey 200000k checking for existing Lustre data: found Read previous values: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x62 (OST first_time update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.143@tcp sys.timeout=20 Permanent disk data: Device: /dev/mapper/ost1_flakey Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x42 (OST update ) Persistent mount opts: errors=remount-ro Parameters: mgsnode=192.168.202.143@tcp sys.timeout=20 start ost1 service on oleg243-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Started lustre-OST0000 oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg243-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server unloading modules via unload_modules_local on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing unload_modules_local oleg243-server: modules unloaded. pdsh@oleg243-client: oleg243-client: ssh exited with exit code 2 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 pdsh@oleg243-client: oleg243-client: ssh exited with exit code 2 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 PASS 69 (2542s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 13:58:17 (1780336697) oleg243-server: debugfs 1.47.3-wc2 (11-Nov-2025) Supported features: dir_prealloc imagic_inodes has_journal ext_attr resize_inode dir_index sparse_super2 fast_commit stable_inodes orphan_file filetype needs_recovery journal_dev meta_bg extent 64bit mmp flex_bg ea_inode dirdata metadata_csum_seed large_dir inline_data encrypt casefold sparse_super large_file huge_file uninit_bg dir_nlink extra_isize quota bigalloc metadata_csum read-only project shared_blocks verity orphan_present Stopping clients: oleg243-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg243-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 oleg243-server: oleg243-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg243-server: detected 4 online CPUs by sysfs oleg243-server: MODOPTS_LIBCFS= oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg243-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg243-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 SKIP: conf-sanity test_111 /dev/mapper/mds1_flakey too small for 5000000kB MDS Stopping clients: oleg243-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg243-client.virtnet /mnt/lustre2 (opts:-f) oleg243-server: oleg243-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg243-server: detected 4 online CPUs by sysfs oleg243-server: MODOPTS_LIBCFS= oleg243-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg243-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg243-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg243-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg243-server: oleg243-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg243-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg243-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server stop mds service on oleg243-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server SKIP 111 (239s) Stopping clients: oleg243-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg243-client.virtnet /mnt/lustre2 (opts:-f) oleg243-server: oleg243-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg243-server: detected 4 online CPUs by sysfs oleg243-server: MODOPTS_LIBCFS= oleg243-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 3406 sec ========== 14:03:21 (1780337001) === conf-sanity: start cleanup 14:03:23 (1780337003) === === conf-sanity: finish cleanup 14:03:28 (1780337008) ===