-----============= acceptance-small: conf-sanity ============----- Wed Jul 16 13:44:09 EDT 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg117-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg117-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg117-server oleg117-server: oleg117-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg117-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg117-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg117-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg117-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg117-server: oleg117-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg117-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg117-server: oleg117-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg117-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg117-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 13:45:45 (1752687945) Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) oleg117-server: oleg117-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg117-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg117-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg117-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg117-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg117-server: oleg117-server.virtnet: executing set_default_debug -1 all pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg117-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg117-client.virtnet: -o user_xattr,flock 192.168.201.117@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 3631 (time 1752687997.89 total 10.00 last 363.09) - open/close 7136 (time 1752688007.89 total 20.00 last 350.46) - open/close 10000 (time 1752688015.68 total 27.79 last 367.63) - open/close 13352 (time 1752688025.68 total 37.79 last 335.13) - open/close 15055 (time 1752688035.69 total 47.80 last 170.17) - open/close 16142 (time 1752688045.70 total 57.81 last 108.61) - open/close 17119 (time 1752688055.70 total 67.81 last 97.66) - open/close 18057 (time 1752688065.71 total 77.82 last 93.74) - open/close 19084 (time 1752688075.71 total 87.82 last 102.69) - open/close 20000 (time 1752688084.47 total 96.59 last 104.49) - open/close 21041 (time 1752688094.48 total 106.59 last 104.04) - open/close 21814 (time 1752688104.48 total 116.60 last 77.28) - open/close 22332 (time 1752688114.49 total 126.60 last 51.77) - open/close 22931 (time 1752688124.49 total 136.60 last 59.90) - open/close 23762 (time 1752688134.49 total 146.61 last 83.05) - open/close 24688 (time 1752688144.50 total 156.61 last 92.57) - open/close 25679 (time 1752688154.51 total 166.62 last 99.01) - open/close 26656 (time 1752688164.52 total 176.63 last 97.58) - open/close 27626 (time 1752688174.53 total 186.64 last 96.94) - open/close 28630 (time 1752688184.53 total 196.65 last 100.33) - open/close 29615 (time 1752688194.54 total 206.65 last 98.46) - open/close 30000 (time 1752688198.39 total 210.51 last 99.85) - open/close 30888 (time 1752688208.39 total 220.51 last 88.80) - open/close 31889 (time 1752688218.40 total 230.51 last 100.07) - open/close 32887 (time 1752688228.40 total 240.51 last 99.80) - open/close 33929 (time 1752688238.40 total 250.51 last 104.17) - open/close 34827 (time 1752688248.40 total 260.51 last 89.79) - open/close 35914 (time 1752688258.40 total 270.52 last 108.66) - open/close 36875 (time 1752688268.40 total 280.52 last 96.09) - open/close 37705 (time 1752688278.41 total 290.52 last 82.99) - open/close 38614 (time 1752688288.41 total 300.52 last 90.89) - open/close 39509 (time 1752688298.41 total 310.53 last 89.45) - open/close 40000 (time 1752688304.00 total 316.11 last 87.93) - open/close 40963 (time 1752688314.01 total 326.12 last 96.19) - open/close 41806 (time 1752688324.01 total 336.12 last 84.29) - open/close 42741 (time 1752688334.01 total 346.12 last 93.48) - open/close 43669 (time 1752688344.01 total 356.13 last 92.77) - open/close 44550 (time 1752688354.02 total 366.13 last 88.08) - open/close 45546 (time 1752688364.02 total 376.13 last 99.58) - open/close 46493 (time 1752688374.03 total 386.14 last 94.63) - open/close 47450 (time 1752688384.03 total 396.15 last 95.63) - open/close 48296 (time 1752688394.05 total 406.16 last 84.47) - open/close 49213 (time 1752688404.06 total 416.17 last 91.63) - open/close 50000 (time 1752688411.31 total 423.42 last 108.54) - open/close 51055 (time 1752688421.31 total 433.43 last 105.43) - open/close 52064 (time 1752688431.32 total 443.43 last 100.83) - open/close 53242 (time 1752688441.32 total 453.44 last 117.79) - open/close 54383 (time 1752688451.32 total 463.44 last 114.08) - open/close 55462 (time 1752688461.33 total 473.44 last 107.83) - open/close 56493 (time 1752688471.33 total 483.45 last 103.08) - open/close 57508 (time 1752688481.34 total 493.45 last 101.40) - open/close 58577 (time 1752688491.35 total 503.46 last 106.83) - open/close 59496 (time 1752688501.35 total 513.46 last 91.87) - open/close 60000 (time 1752688506.78 total 518.89 last 92.87) - open/close 61088 (time 1752688516.78 total 528.90 last 108.75) - open/close 62310 (time 1752688526.79 total 538.91 last 122.04) - open/close 63518 (time 1752688536.80 total 548.92 last 120.71) - open/close 64741 (time 1752688546.81 total 558.92 last 122.25) total: 64768 open/close in 559.11 seconds: 115.84 ops/second - /unlink 2327 (time 1752688558.97 total 10.00 last 232.64) - /unlink 4642 (time 1752688568.97 total 20.00 last 231.46) - /unlink 6747 (time 1752688578.97 total 30.00 last 210.49) - /unlink 9614 (time 1752688588.97 total 40.01 last 286.64) - /unlink 12440 (time 1752688598.97 total 50.01 last 282.58) - /unlink 15135 (time 1752688608.97 total 60.01 last 269.44) - /unlink 18312 (time 1752688618.98 total 70.01 last 317.65) - /unlink 20000 (time 1752688624.08 total 75.12 last 330.54) - /unlink 23400 (time 1752688634.09 total 85.12 last 339.91) - /unlink 26288 (time 1752688644.09 total 95.12 last 288.77) - /unlink 28913 (time 1752688654.09 total 105.13 last 262.41) - /unlink 30000 (time 1752688658.30 total 109.33 last 258.33) - /unlink 32670 (time 1752688668.30 total 119.33 last 266.95) - /unlink 35271 (time 1752688678.33 total 129.36 last 259.41) - /unlink 38072 (time 1752688688.33 total 139.36 last 280.08) - /unlink 40000 (time 1752688694.97 total 146.00 last 290.40) - /unlink 42531 (time 1752688704.97 total 156.00 last 253.09) - /unlink 45134 (time 1752688714.97 total 166.01 last 260.11) - /unlink 48162 (time 1752688724.98 total 176.01 last 302.68) - /unlink 50000 (time 1752688731.46 total 182.50 last 283.51) - /unlink 52764 (time 1752688741.46 total 192.50 last 276.39) - /unlink 55583 (time 1752688751.46 total 202.50 last 281.88) - /unlink 58064 (time 1752688761.46 total 212.50 last 248.05) - /unlink 60000 (time 1752688768.55 total 219.59 last 273.15) - /unlink 62737 (time 1752688778.55 total 229.59 last 273.65) total: 64768 /unlink in 237.26 seconds: 272.98 ops/second Waiting for MDT destroys to complete oleg117-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 - open/close 1634 (time 1752688808.57 total 10.00 last 163.36) - open/close 2973 (time 1752688818.57 total 20.01 last 133.86) - open/close 4381 (time 1752688828.57 total 30.01 last 140.78) - open/close 5865 (time 1752688838.58 total 40.01 last 148.29) - open/close 7435 (time 1752688848.59 total 50.02 last 156.89) - open/close 8911 (time 1752688858.59 total 60.02 last 147.55) - open/close 10000 (time 1752688865.68 total 67.11 last 153.59) - open/close 11686 (time 1752688875.69 total 77.12 last 168.52) - open/close 13388 (time 1752688885.69 total 87.12 last 170.17) - open/close 15118 (time 1752688895.69 total 97.12 last 172.96) - open/close 17027 (time 1752688905.69 total 107.12 last 190.89) - open/close 19024 (time 1752688915.69 total 117.13 last 199.64) - open/close 20000 (time 1752688920.79 total 122.22 last 191.71) - open/close 21879 (time 1752688930.82 total 132.25 last 187.33) - open/close 23536 (time 1752688940.82 total 142.25 last 165.68) - open/close 25212 (time 1752688950.82 total 152.25 last 167.58) - open/close 27151 (time 1752688960.82 total 162.25 last 193.83) - open/close 29071 (time 1752688970.83 total 172.26 last 191.88) - open/close 30000 (time 1752688976.18 total 177.61 last 173.61) - open/close 31791 (time 1752688986.18 total 187.61 last 179.09) - open/close 33729 (time 1752688996.19 total 197.62 last 193.63) - open/close 36144 (time 1752689006.19 total 207.62 last 241.41) - open/close 38937 (time 1752689016.20 total 217.63 last 279.21) - open/close 40000 (time 1752689020.04 total 221.48 last 276.22) - open/close 42510 (time 1752689030.05 total 231.48 last 250.94) - open/close 44486 (time 1752689040.05 total 241.48 last 197.55) - open/close 46611 (time 1752689050.05 total 251.48 last 212.44) - open/close 49039 (time 1752689060.05 total 261.48 last 242.78) - open/close 50000 (time 1752689064.01 total 265.44 last 243.15) - open/close 52554 (time 1752689074.01 total 275.44 last 255.40) - open/close 55049 (time 1752689084.01 total 285.44 last 249.49) - open/close 57912 (time 1752689094.01 total 295.44 last 286.26) - open/close 60000 (time 1752689101.29 total 302.72 last 286.66) - open/close 63417 (time 1752689111.29 total 312.73 last 341.61) total: 64768 open/close in 318.60 seconds: 203.29 ops/second - /unlink 4426 (time 1752689128.81 total 10.00 last 442.59) - /unlink 9372 (time 1752689138.81 total 20.00 last 494.58) - /unlink 13172 (time 1752689148.81 total 30.00 last 379.94) - /unlink 17154 (time 1752689158.81 total 40.00 last 398.18) - /unlink 20000 (time 1752689165.27 total 46.47 last 440.41) - /unlink 24018 (time 1752689175.27 total 56.47 last 401.80) - /unlink 27998 (time 1752689185.27 total 66.47 last 397.93) - /unlink 30000 (time 1752689191.60 total 72.79 last 316.44) - /unlink 34145 (time 1752689201.60 total 82.80 last 414.41) - /unlink 37163 (time 1752689211.61 total 92.80 last 301.70) - /unlink 40000 (time 1752689220.15 total 101.34 last 332.21) - /unlink 44150 (time 1752689230.15 total 111.34 last 414.97) - /unlink 47936 (time 1752689240.15 total 121.34 last 378.54) - /unlink 50000 (time 1752689244.40 total 125.59 last 485.58) - /unlink 55101 (time 1752689254.40 total 135.59 last 510.06) - /unlink 58541 (time 1752689264.40 total 145.60 last 343.91) - /unlink 60000 (time 1752689268.62 total 149.81 last 346.22) - /unlink 63039 (time 1752689278.62 total 159.82 last 303.70) total: 64768 /unlink in 164.14 seconds: 394.58 ops/second Waiting for MDT destroys to complete oleg117-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 - open/close 2253 (time 1752689306.58 total 10.00 last 225.28) - open/close 4973 (time 1752689316.58 total 20.00 last 271.96) - open/close 8247 (time 1752689326.58 total 30.00 last 327.39) - open/close 10000 (time 1752689332.95 total 36.37 last 275.20) - open/close 12607 (time 1752689342.95 total 46.37 last 260.68) - open/close 14621 (time 1752689352.95 total 56.38 last 201.35) - open/close 16739 (time 1752689362.96 total 66.38 last 211.72) - open/close 19196 (time 1752689372.96 total 76.38 last 245.65) - open/close 20000 (time 1752689375.56 total 78.99 last 308.59) - open/close 22936 (time 1752689385.57 total 88.99 last 293.52) - open/close 25834 (time 1752689395.57 total 98.99 last 289.76) - open/close 29254 (time 1752689405.57 total 108.99 last 341.96) - open/close 30000 (time 1752689407.58 total 111.00 last 370.96) - open/close 33660 (time 1752689417.58 total 121.00 last 366.00) - open/close 36171 (time 1752689427.59 total 131.01 last 250.92) - open/close 39169 (time 1752689437.59 total 141.01 last 299.78) - open/close 40000 (time 1752689439.99 total 143.41 last 346.15) - open/close 43652 (time 1752689449.99 total 153.41 last 365.15) - open/close 46887 (time 1752689459.99 total 163.41 last 323.47) - open/close 50000 (time 1752689468.64 total 172.06 last 360.01) - open/close 53620 (time 1752689478.64 total 182.06 last 361.93) - open/close 56758 (time 1752689488.64 total 192.06 last 313.74) - open/close 60000 (time 1752689496.76 total 200.19 last 399.12) - open/close 63800 (time 1752689506.77 total 210.19 last 379.84) total: 64768 open/close in 213.04 seconds: 304.02 ops/second - /unlink 6915 (time 1752689520.95 total 10.00 last 691.44) - /unlink 10000 (time 1752689525.20 total 14.25 last 726.33) - /unlink 17713 (time 1752689535.20 total 24.25 last 771.24) - /unlink 20000 (time 1752689538.22 total 27.27 last 757.57) - /unlink 26325 (time 1752689548.22 total 37.27 last 632.47) - /unlink 30000 (time 1752689554.31 total 43.36 last 603.09) - /unlink 36179 (time 1752689564.31 total 53.36 last 617.87) - /unlink 40000 (time 1752689569.56 total 58.61 last 727.97) - /unlink 47918 (time 1752689579.56 total 68.61 last 791.77) - /unlink 50000 (time 1752689582.02 total 71.07 last 848.62) - /unlink 58812 (time 1752689592.02 total 81.07 last 881.16) total: 64768 /unlink in 87.89 seconds: 736.92 ops/second Waiting for MDT destroys to complete oleg117-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 - open/close 4317 (time 1752689647.37 total 10.00 last 431.65) - open/close 8794 (time 1752689657.37 total 20.00 last 447.68) - open/close 10000 (time 1752689659.97 total 22.60 last 464.34) - open/close 13943 (time 1752689669.97 total 32.60 last 394.22) - open/close 18435 (time 1752689679.97 total 42.60 last 449.17) - open/close 20000 (time 1752689683.65 total 46.28 last 425.98) - open/close 24118 (time 1752689693.65 total 56.28 last 411.77) - open/close 28628 (time 1752689703.65 total 66.28 last 450.94) - open/close 30000 (time 1752689706.92 total 69.55 last 419.54) - open/close 34308 (time 1752689716.92 total 79.55 last 430.72) - open/close 38548 (time 1752689726.93 total 89.55 last 423.89) - open/close 40000 (time 1752689730.39 total 93.01 last 419.51) - open/close 44382 (time 1752689740.39 total 103.02 last 438.10) - open/close 48282 (time 1752689750.39 total 113.02 last 389.92) - open/close 50000 (time 1752689756.04 total 118.67 last 304.10) - open/close 54053 (time 1752689766.04 total 128.67 last 405.27) - open/close 57465 (time 1752689776.04 total 138.67 last 341.20) - open/close 60000 (time 1752689783.99 total 146.62 last 318.80) - open/close 63806 (time 1752689794.00 total 156.63 last 380.34) total: 64768 open/close in 159.45 seconds: 406.20 ops/second - /unlink 6761 (time 1752689808.30 total 10.00 last 676.09) - /unlink 10000 (time 1752689812.93 total 14.63 last 699.81) - /unlink 17258 (time 1752689822.93 total 24.63 last 725.78) - /unlink 20000 (time 1752689826.68 total 28.38 last 730.30) - /unlink 27338 (time 1752689836.68 total 38.38 last 733.78) - /unlink 30000 (time 1752689840.72 total 42.41 last 660.50) - /unlink 37666 (time 1752689850.72 total 52.41 last 766.55) - /unlink 40000 (time 1752689853.80 total 55.50 last 757.41) - /unlink 47924 (time 1752689863.80 total 65.50 last 792.36) - /unlink 50000 (time 1752689866.52 total 68.22 last 761.67) - /unlink 57063 (time 1752689876.52 total 78.22 last 706.25) - /unlink 60000 (time 1752689880.06 total 81.76 last 830.24) total: 64768 /unlink in 88.02 seconds: 735.85 ops/second Waiting for MDT destroys to complete oleg117-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 - open/close 4758 (time 1752689940.27 total 10.00 last 475.70) - open/close 8990 (time 1752689950.27 total 20.00 last 423.20) - open/close 10000 (time 1752689952.82 total 22.55 last 396.18) - open/close 14379 (time 1752689962.83 total 32.55 last 437.78) - open/close 18973 (time 1752689972.83 total 42.56 last 459.34) - open/close 20000 (time 1752689974.90 total 44.63 last 495.11) - open/close 25036 (time 1752689984.90 total 54.63 last 503.60) - open/close 29836 (time 1752689994.90 total 64.63 last 479.90) - open/close 34238 (time 1752690004.90 total 74.63 last 440.12) - open/close 38677 (time 1752690014.91 total 84.64 last 443.85) - open/close 40000 (time 1752690017.53 total 87.25 last 505.04) - open/close 44809 (time 1752690027.53 total 97.26 last 480.81) - open/close 49700 (time 1752690037.53 total 107.26 last 489.09) - open/close 54759 (time 1752690047.53 total 117.26 last 505.84) - open/close 59572 (time 1752690057.53 total 127.26 last 481.28) - open/close 63814 (time 1752690067.53 total 137.26 last 424.17) total: 64768 open/close in 139.33 seconds: 464.86 ops/second - /unlink 8099 (time 1752690081.01 total 10.00 last 809.84) - /unlink 10000 (time 1752690083.13 total 12.12 last 898.67) - /unlink 19317 (time 1752690093.13 total 22.12 last 931.66) - /unlink 28463 (time 1752690103.13 total 32.12 last 914.58) - /unlink 30000 (time 1752690105.17 total 34.16 last 750.65) - /unlink 37744 (time 1752690115.18 total 44.16 last 774.36) - /unlink 40000 (time 1752690118.43 total 47.42 last 692.64) - /unlink 47419 (time 1752690128.43 total 57.42 last 741.81) - /unlink 50000 (time 1752690131.71 total 60.70 last 786.78) - /unlink 57815 (time 1752690141.71 total 70.70 last 781.49) - /unlink 60000 (time 1752690144.32 total 73.31 last 839.20) total: 64768 /unlink in 79.32 seconds: 816.56 ops/second Waiting for MDT destroys to complete oleg117-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg117-client: oleg117-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg117-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg117-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg117-server stop mds service on oleg117-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg117-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing unload_modules_local oleg117-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg117-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg117-client: oleg117-client: ssh exited with exit code 2 pdsh@oleg117-client: oleg117-server: ssh exited with exit code 2 pdsh@oleg117-client: oleg117-server: ssh exited with exit code 2 pdsh@oleg117-client: oleg117-client: ssh exited with exit code 2 PASS 106 (2319s) Stopping clients: oleg117-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg117-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg117-client: oleg117-server: ssh exited with exit code 2 oleg117-server: oleg117-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg117-server' oleg117-server: oleg117-server.virtnet: executing load_modules_local oleg117-server: Loading modules from /home/green/git/lustre-release/lustre oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg117-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg117-server: detected 4 online CPUs by sysfs oleg117-server: MODOPTS_LIBCFS= oleg117-server: Force libcfs to create 2 CPU partitions oleg117-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg117-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 2439 sec ========== 14:24:49 (1752690289) === conf-sanity: start cleanup 14:24:49 (1752690289) === === conf-sanity: finish cleanup 14:24:50 (1752690290) ===