-----============= acceptance-small: conf-sanity ============----- Mon Mar 2 02:17:28 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg433-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg433-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg433-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg433-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg433-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg433-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg433-server oleg433-server: oleg433-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg433-server' oleg433-server: oleg433-server.virtnet: executing load_modules_local oleg433-server: Loading modules from /home/green/git/lustre-release/lustre oleg433-server: detected 4 online CPUs by sysfs oleg433-server: MODOPTS_LIBCFS= oleg433-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg433-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg433-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg433-server: oleg433-server.virtnet: executing set_default_debug -1 all pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg433-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg433-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg433-server: oleg433-server.virtnet: executing set_default_debug -1 all pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg433-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg433-server: oleg433-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg433-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg433-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg433-server stop mds service on oleg433-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg433-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 02:19:58 (1772435998) Stopping clients: oleg433-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg433-client.virtnet /mnt/lustre2 (opts:-f) oleg433-server: oleg433-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg433-server' oleg433-server: oleg433-server.virtnet: executing load_modules_local oleg433-server: Loading modules from /home/green/git/lustre-release/lustre oleg433-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg433-server: detected 4 online CPUs by sysfs oleg433-server: MODOPTS_LIBCFS= oleg433-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg433-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg433-server: oleg433-server.virtnet: executing set_default_debug -1 all pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg433-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg433-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg433-server: oleg433-server.virtnet: executing set_default_debug -1 all pdsh@oleg433-client: oleg433-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg433-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg433-client.virtnet: -o user_xattr,flock 192.168.204.133@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 785 (time 1772436096.85 total 10.01 last 78.43) - open/close 1483 (time 1772436106.86 total 20.03 last 69.67) - open/close 2143 (time 1772436116.87 total 30.03 last 65.96) - open/close 2937 (time 1772436126.88 total 40.04 last 79.33) - open/close 3733 (time 1772436136.88 total 50.05 last 79.56) - open/close 4441 (time 1772436146.89 total 60.05 last 70.75) - open/close 5224 (time 1772436156.89 total 70.05 last 78.30) - open/close 6014 (time 1772436166.90 total 80.06 last 78.94) - open/close 6663 (time 1772436176.91 total 90.08 last 64.81) - open/close 7315 (time 1772436186.92 total 100.08 last 65.18) - open/close 8034 (time 1772436196.92 total 110.09 last 71.84) - open/close 8768 (time 1772436206.92 total 120.09 last 73.40) - open/close 9494 (time 1772436216.94 total 130.10 last 72.50) - open/close 10000 (time 1772436223.29 total 136.45 last 79.66) - open/close 10806 (time 1772436233.30 total 146.46 last 80.53) - open/close 11566 (time 1772436243.31 total 156.47 last 75.94) - open/close 12330 (time 1772436253.31 total 166.47 last 76.36) - open/close 13138 (time 1772436263.31 total 176.48 last 80.78) - open/close 13836 (time 1772436273.32 total 186.48 last 69.77) - open/close 14498 (time 1772436283.32 total 196.48 last 66.19) - open/close 15241 (time 1772436293.32 total 206.48 last 74.29) - open/close 15974 (time 1772436303.34 total 216.50 last 73.18) - open/close 16727 (time 1772436313.34 total 226.50 last 75.27) - open/close 17514 (time 1772436323.35 total 236.51 last 78.62) - open/close 18315 (time 1772436333.37 total 246.54 last 79.92) - open/close 19126 (time 1772436343.39 total 256.55 last 81.01) - open/close 19899 (time 1772436353.41 total 266.57 last 77.12) - open/close 20706 (time 1772436363.41 total 276.58 last 80.66) - open/close 21507 (time 1772436373.42 total 286.58 last 80.07) - open/close 22296 (time 1772436383.42 total 296.58 last 78.86) - open/close 23084 (time 1772436393.43 total 306.59 last 78.73) - open/close 23950 (time 1772436403.44 total 316.60 last 86.51) - open/close 24688 (time 1772436413.45 total 326.61 last 73.73) - open/close 25545 (time 1772436423.46 total 336.62 last 85.62) - open/close 26295 (time 1772436433.47 total 346.63 last 74.94) - open/close 27124 (time 1772436443.47 total 356.63 last 82.89) - open/close 27894 (time 1772436453.48 total 366.64 last 76.91) - open/close 28633 (time 1772436463.48 total 376.64 last 73.90) - open/close 29390 (time 1772436473.48 total 386.65 last 75.66) - open/close 30000 (time 1772436482.93 total 396.09 last 64.60) - open/close 30733 (time 1772436492.93 total 406.09 last 73.27) - open/close 31421 (time 1772436502.95 total 416.11 last 68.69) - open/close 32148 (time 1772436512.95 total 426.11 last 72.69) - open/close 32918 (time 1772436522.96 total 436.12 last 76.94) - open/close 33622 (time 1772436532.96 total 446.13 last 70.34) - open/close 34387 (time 1772436542.97 total 456.13 last 76.47) - open/close 35127 (time 1772436552.98 total 466.14 last 73.93) - open/close 35919 (time 1772436562.99 total 476.15 last 79.13) - open/close 36799 (time 1772436572.99 total 486.15 last 87.99) - open/close 37564 (time 1772436582.99 total 496.16 last 76.46) - open/close 38218 (time 1772436593.00 total 506.16 last 65.38) - open/close 38947 (time 1772436603.01 total 516.17 last 72.83) - open/close 39741 (time 1772436613.01 total 526.18 last 79.33) - open/close 40000 (time 1772436616.88 total 530.04 last 67.05) - open/close 40870 (time 1772436626.88 total 540.04 last 87.00) - open/close 41780 (time 1772436636.89 total 550.05 last 90.88) - open/close 42609 (time 1772436646.90 total 560.06 last 82.86) - open/close 43464 (time 1772436656.90 total 570.06 last 85.48) - open/close 44375 (time 1772436666.90 total 580.06 last 91.07) - open/close 45236 (time 1772436676.91 total 590.07 last 86.04) - open/close 46135 (time 1772436686.91 total 600.07 last 89.87) - open/close 46991 (time 1772436696.94 total 610.10 last 85.39) - open/close 47859 (time 1772436706.95 total 620.11 last 86.67) - open/close 48686 (time 1772436716.95 total 630.11 last 82.69) - open/close 49593 (time 1772436726.96 total 640.13 last 90.60) - open/close 50000 (time 1772436731.43 total 644.60 last 91.02) - open/close 50885 (time 1772436741.44 total 654.61 last 88.43) - open/close 51812 (time 1772436751.45 total 664.62 last 92.61) - open/close 52776 (time 1772436761.47 total 674.63 last 96.24) - open/close 53672 (time 1772436771.48 total 684.64 last 89.52) - open/close 54723 (time 1772436781.49 total 694.65 last 105.01) - open/close 55685 (time 1772436791.49 total 704.65 last 96.18) - open/close 56532 (time 1772436801.50 total 714.67 last 84.57) - open/close 57370 (time 1772436811.51 total 724.67 last 83.78) - open/close 58297 (time 1772436821.51 total 734.67 last 92.68) - open/close 59279 (time 1772436831.51 total 744.68 last 98.15) - open/close 60000 (time 1772436838.22 total 751.38 last 107.51) - open/close 60940 (time 1772436848.22 total 761.39 last 93.97) - open/close 61975 (time 1772436858.23 total 771.39 last 103.48) - open/close 62850 (time 1772436868.23 total 781.39 last 87.47) - open/close 63782 (time 1772436878.24 total 791.41 last 93.06) - open/close 64669 (time 1772436888.25 total 801.41 last 88.68) total: 64768 open/close in 802.61 seconds: 80.70 ops/second - /unlink 927 (time 1772436902.73 total 10.00 last 92.67) - /unlink 1867 (time 1772436912.74 total 20.02 last 93.89) - /unlink 2842 (time 1772436922.74 total 30.02 last 97.48) - /unlink 3798 (time 1772436932.75 total 40.03 last 95.53) - /unlink 4789 (time 1772436942.78 total 50.05 last 98.84) - /unlink 5649 (time 1772436952.78 total 60.06 last 85.96) - /unlink 6426 (time 1772436962.79 total 70.06 last 77.66) - /unlink 7239 (time 1772436972.79 total 80.06 last 81.30) - /unlink 8181 (time 1772436982.79 total 90.07 last 94.15) - /unlink 9107 (time 1772436992.80 total 100.07 last 92.56) - /unlink 9873 (time 1772437002.80 total 110.08 last 76.54) - /unlink 10607 (time 1772437012.82 total 120.10 last 73.26) - /unlink 11298 (time 1772437022.83 total 130.10 last 69.07) - /unlink 12154 (time 1772437032.83 total 140.11 last 85.58) - /unlink 13012 (time 1772437042.84 total 150.11 last 85.76) - /unlink 13871 (time 1772437052.84 total 160.12 last 85.83) - /unlink 14752 (time 1772437062.85 total 170.13 last 88.04) - /unlink 15757 (time 1772437072.86 total 180.14 last 100.40) - /unlink 16665 (time 1772437082.87 total 190.15 last 90.69) - /unlink 17593 (time 1772437092.88 total 200.15 last 92.74) - /unlink 18515 (time 1772437102.88 total 210.16 last 92.20) - /unlink 19390 (time 1772437112.90 total 220.17 last 87.36) - /unlink 20000 (time 1772437120.23 total 227.51 last 83.18) - /unlink 20875 (time 1772437130.23 total 237.51 last 87.46) - /unlink 21896 (time 1772437140.24 total 247.51 last 102.07) - /unlink 22918 (time 1772437150.24 total 257.52 last 102.14) - /unlink 23836 (time 1772437160.25 total 267.53 last 91.73) - /unlink 24878 (time 1772437170.26 total 277.54 last 104.10) - /unlink 26101 (time 1772437180.27 total 287.55 last 122.17) - /unlink 27164 (time 1772437190.27 total 297.55 last 106.27) - /unlink 28261 (time 1772437200.27 total 307.55 last 109.70) - /unlink 29354 (time 1772437210.28 total 317.55 last 109.27) - /unlink 30000 (time 1772437216.85 total 324.13 last 98.22) - /unlink 31027 (time 1772437226.86 total 334.13 last 102.65) - /unlink 32302 (time 1772437236.86 total 344.13 last 127.50) - /unlink 33661 (time 1772437246.86 total 354.13 last 135.89) - /unlink 34910 (time 1772437256.87 total 364.14 last 124.79) - /unlink 36021 (time 1772437266.88 total 374.16 last 110.93) - /unlink 37067 (time 1772437276.89 total 384.16 last 104.57) - /unlink 38235 (time 1772437286.89 total 394.16 last 116.75) - /unlink 39407 (time 1772437296.90 total 404.17 last 117.09) - /unlink 40000 (time 1772437302.01 total 409.29 last 115.95) - /unlink 41260 (time 1772437312.02 total 419.30 last 125.90) - /unlink 42570 (time 1772437322.03 total 429.30 last 130.94) - /unlink 43780 (time 1772437332.03 total 439.31 last 120.95) - /unlink 45037 (time 1772437342.04 total 449.31 last 125.61) - /unlink 46277 (time 1772437352.04 total 459.31 last 123.97) - /unlink 47432 (time 1772437362.05 total 469.32 last 115.41) - /unlink 48544 (time 1772437372.06 total 479.33 last 111.09) - /unlink 49871 (time 1772437382.06 total 489.33 last 132.69) - /unlink 51167 (time 1772437392.06 total 499.34 last 129.55) - /unlink 52518 (time 1772437402.06 total 509.34 last 135.07) - /unlink 53921 (time 1772437412.07 total 519.35 last 140.21) - /unlink 55230 (time 1772437422.07 total 529.35 last 130.89) - /unlink 56533 (time 1772437432.09 total 539.36 last 130.11) - /unlink 57894 (time 1772437442.09 total 549.37 last 136.04) - /unlink 59158 (time 1772437452.09 total 559.37 last 126.36) - /unlink 60000 (time 1772437459.49 total 566.76 last 113.91) - /unlink 61186 (time 1772437469.51 total 576.79 last 118.30) - /unlink 62342 (time 1772437479.51 total 586.79 last 115.56) - /unlink 63480 (time 1772437489.52 total 596.79 last 113.76) - /unlink 64656 (time 1772437499.52 total 606.80 last 117.55) total: 64768 /unlink in 607.75 seconds: 106.57 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1175 (time 1772437532.99 total 10.01 last 117.36) - open/close 2625 (time 1772437542.99 total 20.01 last 144.96) - open/close 4347 (time 1772437552.99 total 30.02 last 172.17) - open/close 6195 (time 1772437563.00 total 40.02 last 184.74) - open/close 7794 (time 1772437573.00 total 50.03 last 159.77) - open/close 9479 (time 1772437583.01 total 60.03 last 168.46) - open/close 10000 (time 1772437586.09 total 63.12 last 168.85) - open/close 11991 (time 1772437596.09 total 73.12 last 199.04) - open/close 13830 (time 1772437606.10 total 83.12 last 183.88) - open/close 15666 (time 1772437616.10 total 93.12 last 183.53) - open/close 17167 (time 1772437626.10 total 103.13 last 150.02) - open/close 18547 (time 1772437636.11 total 113.14 last 137.91) - open/close 20000 (time 1772437645.63 total 122.66 last 152.57) - open/close 21993 (time 1772437655.64 total 132.66 last 199.23) - open/close 23646 (time 1772437665.64 total 142.67 last 165.25) - open/close 25159 (time 1772437675.65 total 152.67 last 151.24) - open/close 26960 (time 1772437685.65 total 162.68 last 179.98) - open/close 28961 (time 1772437695.66 total 172.68 last 199.99) - open/close 30000 (time 1772437702.55 total 179.57 last 150.75) - open/close 31583 (time 1772437712.56 total 189.58 last 158.22) - open/close 33420 (time 1772437722.56 total 199.58 last 183.61) - open/close 35122 (time 1772437732.56 total 209.59 last 170.16) - open/close 37013 (time 1772437742.56 total 219.59 last 189.07) - open/close 38903 (time 1772437752.57 total 229.59 last 188.95) - open/close 40000 (time 1772437758.89 total 235.92 last 173.37) - open/close 42052 (time 1772437768.90 total 245.92 last 205.16) - open/close 44874 (time 1772437778.90 total 255.92 last 282.14) - open/close 47369 (time 1772437788.90 total 265.92 last 249.48) - open/close 49670 (time 1772437798.90 total 275.93 last 230.03) - open/close 52169 (time 1772437808.90 total 285.93 last 249.89) - open/close 54386 (time 1772437818.91 total 295.93 last 221.62) - open/close 56335 (time 1772437828.91 total 305.93 last 194.86) - open/close 59145 (time 1772437838.91 total 315.93 last 280.99) - open/close 60000 (time 1772437842.96 total 319.98 last 211.18) - open/close 61899 (time 1772437852.96 total 329.99 last 189.83) - open/close 63787 (time 1772437862.96 total 339.99 last 188.73) total: 64768 open/close in 345.77 seconds: 187.31 ops/second - /unlink 4030 (time 1772437880.70 total 10.00 last 402.93) - /unlink 8749 (time 1772437890.70 total 20.00 last 471.86) - /unlink 10000 (time 1772437894.04 total 23.34 last 374.66) - /unlink 14675 (time 1772437904.04 total 33.34 last 467.45) - /unlink 19205 (time 1772437914.04 total 43.34 last 452.96) - /unlink 24729 (time 1772437924.04 total 53.34 last 552.37) - /unlink 30000 (time 1772437933.84 total 63.14 last 538.06) - /unlink 34664 (time 1772437943.84 total 73.14 last 466.38) - /unlink 40000 (time 1772437953.47 total 82.77 last 554.33) - /unlink 45738 (time 1772437963.47 total 92.77 last 573.77) - /unlink 50000 (time 1772437971.51 total 100.81 last 529.84) - /unlink 54544 (time 1772437981.51 total 110.81 last 454.33) - /unlink 58613 (time 1772437991.51 total 120.81 last 406.85) - /unlink 60000 (time 1772437995.11 total 124.41 last 385.91) - /unlink 64639 (time 1772438005.11 total 134.41 last 463.86) total: 64768 /unlink in 134.78 seconds: 480.56 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2973 (time 1772438037.40 total 10.00 last 297.24) - open/close 5455 (time 1772438047.40 total 20.00 last 248.17) - open/close 8432 (time 1772438057.40 total 30.00 last 297.68) - open/close 10000 (time 1772438061.86 total 34.47 last 351.44) - open/close 13558 (time 1772438071.86 total 44.47 last 355.69) - open/close 17079 (time 1772438081.86 total 54.47 last 352.09) - open/close 20000 (time 1772438089.79 total 62.39 last 368.76) - open/close 23294 (time 1772438099.79 total 72.40 last 329.09) - open/close 25727 (time 1772438109.80 total 82.40 last 243.28) - open/close 28248 (time 1772438119.80 total 92.40 last 252.08) - open/close 30000 (time 1772438126.87 total 99.47 last 247.67) - open/close 32664 (time 1772438136.88 total 109.48 last 266.24) - open/close 34998 (time 1772438146.88 total 119.49 last 233.30) - open/close 37709 (time 1772438156.88 total 129.49 last 271.06) - open/close 40000 (time 1772438164.06 total 136.66 last 319.38) - open/close 43329 (time 1772438174.06 total 146.66 last 332.82) - open/close 46031 (time 1772438184.06 total 156.66 last 270.18) - open/close 48999 (time 1772438194.06 total 166.66 last 296.75) - open/close 50000 (time 1772438198.16 total 170.77 last 244.04) - open/close 52275 (time 1772438208.16 total 180.77 last 227.47) - open/close 54386 (time 1772438218.16 total 190.77 last 211.08) - open/close 56555 (time 1772438228.17 total 200.77 last 216.85) - open/close 59084 (time 1772438238.17 total 210.77 last 252.88) - open/close 60000 (time 1772438242.11 total 214.71 last 232.48) - open/close 62294 (time 1772438252.11 total 224.71 last 229.40) total: 64768 open/close in 233.53 seconds: 277.35 ops/second - /unlink 5508 (time 1772438272.56 total 10.00 last 550.79) - /unlink 9926 (time 1772438282.56 total 20.00 last 441.75) - /unlink 14441 (time 1772438292.56 total 30.00 last 451.49) - /unlink 18535 (time 1772438302.56 total 40.00 last 409.31) - /unlink 20000 (time 1772438306.97 total 44.42 last 331.91) - /unlink 23946 (time 1772438316.98 total 54.42 last 394.55) - /unlink 28855 (time 1772438326.98 total 64.42 last 490.84) - /unlink 30000 (time 1772438329.02 total 66.47 last 559.50) - /unlink 34414 (time 1772438339.03 total 76.47 last 441.27) - /unlink 40000 (time 1772438348.68 total 86.13 last 578.49) - /unlink 46097 (time 1772438358.68 total 96.13 last 609.60) - /unlink 50000 (time 1772438366.26 total 103.71 last 514.94) - /unlink 55061 (time 1772438376.27 total 113.71 last 505.91) - /unlink 60000 (time 1772438385.32 total 122.77 last 545.45) total: 64768 /unlink in 132.13 seconds: 490.19 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2953 (time 1772438422.80 total 10.00 last 295.30) - open/close 5888 (time 1772438432.80 total 20.00 last 293.46) - open/close 8805 (time 1772438442.81 total 30.01 last 291.55) - open/close 10000 (time 1772438446.02 total 33.22 last 371.89) - open/close 13314 (time 1772438456.02 total 43.22 last 331.38) - open/close 16309 (time 1772438466.02 total 53.22 last 299.50) - open/close 19271 (time 1772438476.02 total 63.22 last 296.14) - open/close 20000 (time 1772438478.83 total 66.03 last 259.95) - open/close 23234 (time 1772438488.83 total 76.03 last 323.38) - open/close 27141 (time 1772438498.83 total 86.03 last 390.70) - open/close 30000 (time 1772438507.11 total 94.31 last 345.24) - open/close 33562 (time 1772438517.11 total 104.31 last 356.14) - open/close 37011 (time 1772438527.11 total 114.31 last 344.83) - open/close 40000 (time 1772438535.45 total 122.65 last 358.52) - open/close 42766 (time 1772438545.45 total 132.65 last 276.55) - open/close 45998 (time 1772438555.45 total 142.65 last 323.13) - open/close 49609 (time 1772438565.46 total 152.66 last 361.00) - open/close 52959 (time 1772438575.46 total 162.66 last 334.98) - open/close 56238 (time 1772438585.46 total 172.66 last 327.80) - open/close 60000 (time 1772438595.05 total 182.24 last 392.52) - open/close 63948 (time 1772438605.05 total 192.24 last 394.80) total: 64768 open/close in 194.21 seconds: 333.50 ops/second - /unlink 7023 (time 1772438618.39 total 10.00 last 702.26) - /unlink 10000 (time 1772438622.73 total 14.34 last 685.85) - /unlink 16781 (time 1772438632.73 total 24.34 last 678.06) - /unlink 20000 (time 1772438636.85 total 28.46 last 781.94) - /unlink 26169 (time 1772438646.85 total 38.46 last 616.84) - /unlink 30000 (time 1772438653.63 total 45.24 last 565.21) - /unlink 37574 (time 1772438663.63 total 55.24 last 757.36) - /unlink 40000 (time 1772438666.65 total 58.26 last 803.57) - /unlink 47017 (time 1772438676.65 total 68.26 last 701.63) - /unlink 50000 (time 1772438680.30 total 71.91 last 817.76) - /unlink 57827 (time 1772438690.30 total 81.91 last 782.63) - /unlink 60000 (time 1772438693.01 total 84.62 last 801.98) total: 64768 /unlink in 91.26 seconds: 709.69 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 5044 (time 1772438728.31 total 10.00 last 504.38) - open/close 9612 (time 1772438738.31 total 20.00 last 456.71) - open/close 14637 (time 1772438748.31 total 30.00 last 502.43) - open/close 19978 (time 1772438758.31 total 40.00 last 534.05) - open/close 25140 (time 1772438768.31 total 50.01 last 516.11) - open/close 30000 (time 1772438778.08 total 59.77 last 497.87) - open/close 35306 (time 1772438788.08 total 69.77 last 530.52) - open/close 40000 (time 1772438797.35 total 79.04 last 506.47) - open/close 45224 (time 1772438807.35 total 89.04 last 522.37) - open/close 50000 (time 1772438816.87 total 98.56 last 501.37) - open/close 55338 (time 1772438826.87 total 108.56 last 533.79) - open/close 60000 (time 1772438835.75 total 117.44 last 525.13) total: 64768 open/close in 126.49 seconds: 512.04 ops/second - /unlink 8034 (time 1772438856.11 total 10.00 last 803.38) - /unlink 10000 (time 1772438858.39 total 12.27 last 865.15) - /unlink 18281 (time 1772438868.39 total 22.27 last 828.04) - /unlink 27066 (time 1772438878.39 total 32.27 last 878.47) - /unlink 30000 (time 1772438881.94 total 35.82 last 826.83) - /unlink 38498 (time 1772438891.94 total 45.82 last 849.75) - /unlink 46496 (time 1772438901.94 total 55.82 last 799.70) - /unlink 50000 (time 1772438906.10 total 59.99 last 840.97) - /unlink 58371 (time 1772438916.10 total 69.99 last 837.05) - /unlink 60000 (time 1772438918.17 total 72.05 last 790.25) total: 64768 /unlink in 77.54 seconds: 835.30 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg433-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg433-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg433-server stop mds service on oleg433-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg433-server unloading modules via unload_modules_local on: 'oleg433-server' oleg433-server: oleg433-server.virtnet: executing unload_modules_local oleg433-server: modules unloaded. pdsh@oleg433-client: oleg433-client: ssh exited with exit code 2 pdsh@oleg433-client: oleg433-server: ssh exited with exit code 2 pdsh@oleg433-client: oleg433-client: ssh exited with exit code 2 pdsh@oleg433-client: oleg433-server: ssh exited with exit code 2 PASS 106 (2962s) Stopping clients: oleg433-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg433-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg433-client: oleg433-server: ssh exited with exit code 2 oleg433-server: oleg433-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg433-server' oleg433-server: oleg433-server.virtnet: executing load_modules_local oleg433-server: Loading modules from /home/green/git/lustre-release/lustre oleg433-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg433-server: detected 4 online CPUs by sysfs oleg433-server: MODOPTS_LIBCFS= oleg433-server: Force libcfs to create 2 CPU partitions oleg433-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg433-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg433-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3134 sec ========== 03:09:44 (1772438984) === conf-sanity: start cleanup 03:09:45 (1772438985) === === conf-sanity: finish cleanup 03:09:46 (1772438986) ===