-----============= acceptance-small: conf-sanity ============----- Wed Dec 3 14:44:11 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg351-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg351-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg351-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg351-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg351-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg351-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg351-server oleg351-server: oleg351-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg351-server' oleg351-server: oleg351-server.virtnet: executing load_modules_local oleg351-server: Loading modules from /home/green/git/lustre-release/lustre oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg351-server: detected 4 online CPUs by sysfs oleg351-server: MODOPTS_LIBCFS= oleg351-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg351-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg351-server: oleg351-server.virtnet: executing set_default_debug -1 all pdsh@oleg351-client: oleg351-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg351-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg351-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg351-server: oleg351-server.virtnet: executing set_default_debug -1 all pdsh@oleg351-client: oleg351-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg351-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg351-server: oleg351-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg351-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg351-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg351-server stop mds service on oleg351-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg351-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:45:44 (1764791144) Stopping clients: oleg351-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg351-client.virtnet /mnt/lustre2 (opts:-f) oleg351-server: oleg351-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg351-server' oleg351-server: oleg351-server.virtnet: executing load_modules_local oleg351-server: Loading modules from /home/green/git/lustre-release/lustre oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg351-server: detected 4 online CPUs by sysfs oleg351-server: MODOPTS_LIBCFS= oleg351-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg351-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg351-server: oleg351-server.virtnet: executing set_default_debug -1 all pdsh@oleg351-client: oleg351-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg351-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg351-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg351-server: oleg351-server.virtnet: executing set_default_debug -1 all pdsh@oleg351-client: oleg351-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg351-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg351-client.virtnet: -o user_xattr,flock 192.168.203.151@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 800 (time 1764791235.18 total 10.01 last 79.91) - open/close 1580 (time 1764791245.18 total 20.02 last 77.97) - open/close 2420 (time 1764791255.20 total 30.03 last 83.88) - open/close 3160 (time 1764791265.20 total 40.04 last 73.94) - open/close 4016 (time 1764791275.21 total 50.04 last 85.58) - open/close 4957 (time 1764791285.21 total 60.05 last 94.03) - open/close 5998 (time 1764791295.22 total 70.05 last 104.08) - open/close 7419 (time 1764791305.22 total 80.05 last 142.07) - open/close 8484 (time 1764791315.22 total 90.05 last 106.47) - open/close 9546 (time 1764791325.23 total 100.06 last 106.14) - open/close 10000 (time 1764791332.62 total 107.46 last 61.38) - open/close 10476 (time 1764791342.62 total 117.46 last 47.59) - open/close 10908 (time 1764791352.62 total 127.46 last 43.20) - open/close 11375 (time 1764791362.64 total 137.48 last 46.60) - open/close 12068 (time 1764791372.65 total 147.48 last 69.27) - open/close 12827 (time 1764791382.65 total 157.48 last 75.89) - open/close 13594 (time 1764791392.65 total 167.49 last 76.66) - open/close 14398 (time 1764791402.66 total 177.50 last 80.32) - open/close 15405 (time 1764791412.67 total 187.50 last 100.67) - open/close 16629 (time 1764791422.67 total 197.51 last 122.33) - open/close 17994 (time 1764791432.68 total 207.52 last 136.36) - open/close 18946 (time 1764791442.69 total 217.52 last 95.13) - open/close 20000 (time 1764791451.42 total 226.25 last 120.72) - open/close 21481 (time 1764791461.42 total 236.26 last 148.09) - open/close 23012 (time 1764791471.43 total 246.26 last 153.03) - open/close 25083 (time 1764791481.43 total 256.26 last 207.04) - open/close 27327 (time 1764791491.43 total 266.26 last 224.34) - open/close 29029 (time 1764791501.44 total 276.27 last 170.12) - open/close 30000 (time 1764791508.07 total 282.90 last 146.48) - open/close 31678 (time 1764791518.07 total 292.90 last 167.76) - open/close 33901 (time 1764791528.08 total 302.91 last 222.10) - open/close 36259 (time 1764791538.08 total 312.91 last 235.79) - open/close 39523 (time 1764791548.08 total 322.91 last 326.34) - open/close 43126 (time 1764791558.08 total 332.91 last 360.22) - open/close 47113 (time 1764791568.08 total 342.92 last 398.70) - open/close 48887 (time 1764791578.09 total 352.93 last 177.18) - open/close 49756 (time 1764791588.09 total 362.93 last 86.90) - open/close 50000 (time 1764791590.56 total 365.40 last 98.89) - open/close 50928 (time 1764791600.58 total 375.42 last 92.61) - open/close 51753 (time 1764791610.59 total 385.42 last 82.46) - open/close 52624 (time 1764791620.59 total 395.43 last 87.04) - open/close 53355 (time 1764791630.61 total 405.44 last 73.02) - open/close 54083 (time 1764791640.62 total 415.45 last 72.72) - open/close 55021 (time 1764791650.62 total 425.46 last 93.75) - open/close 56038 (time 1764791660.62 total 435.46 last 101.69) - open/close 57386 (time 1764791670.63 total 445.46 last 134.72) - open/close 58293 (time 1764791680.64 total 455.47 last 90.64) - open/close 58834 (time 1764791690.64 total 465.47 last 54.09) - open/close 59516 (time 1764791700.65 total 475.48 last 68.13) - open/close 60000 (time 1764791709.10 total 483.94 last 57.24) - open/close 60612 (time 1764791719.11 total 493.95 last 61.13) - open/close 61219 (time 1764791729.12 total 503.95 last 60.67) - open/close 61976 (time 1764791739.13 total 513.96 last 75.63) - open/close 62732 (time 1764791749.13 total 523.96 last 75.57) - open/close 63473 (time 1764791759.13 total 533.97 last 74.08) - open/close 63981 (time 1764791769.14 total 543.97 last 50.79) - open/close 64467 (time 1764791779.16 total 554.00 last 48.46) total: 64768 open/close in 560.05 seconds: 115.65 ops/second - /unlink 1111 (time 1764791799.12 total 10.00 last 111.09) - /unlink 2157 (time 1764791809.12 total 20.01 last 104.56) - /unlink 3314 (time 1764791819.13 total 30.01 last 115.63) - /unlink 4416 (time 1764791829.13 total 40.01 last 110.20) - /unlink 5574 (time 1764791839.13 total 50.01 last 115.80) - /unlink 6688 (time 1764791849.13 total 60.01 last 111.37) - /unlink 7823 (time 1764791859.14 total 70.03 last 113.33) - /unlink 8940 (time 1764791869.15 total 80.04 last 111.62) - /unlink 10000 (time 1764791878.53 total 89.42 last 112.99) - /unlink 11123 (time 1764791888.54 total 99.42 last 112.27) - /unlink 12272 (time 1764791898.54 total 109.42 last 114.90) - /unlink 13549 (time 1764791908.54 total 119.43 last 127.60) - /unlink 14804 (time 1764791918.55 total 129.43 last 125.47) - /unlink 15919 (time 1764791928.57 total 139.46 last 111.23) - /unlink 17095 (time 1764791938.58 total 149.46 last 117.53) - /unlink 18245 (time 1764791948.59 total 159.47 last 114.88) - /unlink 19513 (time 1764791958.59 total 169.47 last 126.79) - /unlink 20000 (time 1764791962.45 total 173.33 last 126.27) - /unlink 21200 (time 1764791972.45 total 183.34 last 119.93) - /unlink 22314 (time 1764791982.46 total 193.34 last 111.35) - /unlink 23238 (time 1764791992.46 total 203.34 last 92.40) - /unlink 24252 (time 1764792002.46 total 213.35 last 101.35) - /unlink 25114 (time 1764792012.48 total 223.36 last 86.05) - /unlink 25882 (time 1764792022.49 total 233.38 last 76.69) - /unlink 26599 (time 1764792032.50 total 243.38 last 71.66) - /unlink 27384 (time 1764792042.50 total 253.39 last 78.46) - /unlink 28207 (time 1764792052.51 total 263.40 last 82.24) - /unlink 29389 (time 1764792062.51 total 273.40 last 118.17) - /unlink 30000 (time 1764792068.63 total 279.52 last 99.90) - /unlink 31045 (time 1764792078.65 total 289.53 last 104.30) - /unlink 32067 (time 1764792088.66 total 299.54 last 102.11) - /unlink 33093 (time 1764792098.66 total 309.55 last 102.57) - /unlink 34574 (time 1764792108.66 total 319.55 last 148.08) - /unlink 35850 (time 1764792118.67 total 329.55 last 127.53) - /unlink 36897 (time 1764792128.67 total 339.56 last 104.67) - /unlink 37899 (time 1764792138.73 total 349.62 last 99.60) - /unlink 38998 (time 1764792148.75 total 359.63 last 109.72) - /unlink 39726 (time 1764792158.75 total 369.64 last 72.77) - /unlink 40000 (time 1764792162.56 total 373.45 last 71.88) - /unlink 40686 (time 1764792172.58 total 383.46 last 68.50) - /unlink 41466 (time 1764792182.59 total 393.47 last 77.94) - /unlink 42170 (time 1764792192.60 total 403.49 last 70.28) - /unlink 42837 (time 1764792202.61 total 413.49 last 66.67) - /unlink 43544 (time 1764792212.62 total 423.50 last 70.64) - /unlink 44245 (time 1764792222.64 total 433.52 last 69.98) - /unlink 44900 (time 1764792232.65 total 443.53 last 65.41) - /unlink 45635 (time 1764792242.66 total 453.54 last 73.43) - /unlink 46385 (time 1764792252.66 total 463.55 last 74.96) - /unlink 47115 (time 1764792262.67 total 473.56 last 72.93) - /unlink 47846 (time 1764792272.68 total 483.57 last 73.03) - /unlink 48527 (time 1764792282.70 total 493.59 last 67.96) - /unlink 49246 (time 1764792292.73 total 503.62 last 71.71) - /unlink 49986 (time 1764792302.73 total 513.62 last 73.98) - /unlink 50650 (time 1764792312.73 total 523.62 last 66.40) - /unlink 51254 (time 1764792322.75 total 533.63 last 60.30) - /unlink 51721 (time 1764792332.77 total 543.66 last 46.60) - /unlink 52150 (time 1764792342.78 total 553.66 last 42.87) - /unlink 52625 (time 1764792352.78 total 563.67 last 47.48) - /unlink 53258 (time 1764792362.79 total 573.68 last 63.22) - /unlink 53778 (time 1764792372.81 total 583.69 last 51.94) - /unlink 54198 (time 1764792382.83 total 593.71 last 41.91) - /unlink 54662 (time 1764792392.85 total 603.73 last 46.30) - /unlink 55207 (time 1764792402.86 total 613.74 last 54.44) - /unlink 55784 (time 1764792412.87 total 623.75 last 57.64) - /unlink 56482 (time 1764792422.88 total 633.76 last 69.74) - /unlink 57203 (time 1764792432.89 total 643.77 last 72.03) - /unlink 57848 (time 1764792442.90 total 653.78 last 64.46) - /unlink 58468 (time 1764792452.91 total 663.79 last 61.93) - /unlink 59147 (time 1764792462.92 total 673.81 last 67.78) - /unlink 59813 (time 1764792472.93 total 683.82 last 66.53) - /unlink 60000 (time 1764792476.01 total 686.90 last 60.74) - /unlink 60728 (time 1764792486.02 total 696.91 last 72.73) - /unlink 61379 (time 1764792496.03 total 706.91 last 65.07) - /unlink 62077 (time 1764792506.04 total 716.92 last 69.74) - /unlink 62725 (time 1764792516.04 total 726.92 last 64.79) - /unlink 63400 (time 1764792526.04 total 736.93 last 67.45) - /unlink 64118 (time 1764792536.05 total 746.94 last 71.76) total: 64768 /unlink in 755.74 seconds: 85.70 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 719 (time 1764792578.67 total 10.00 last 71.89) - open/close 1452 (time 1764792588.67 total 20.00 last 73.30) - open/close 2169 (time 1764792598.68 total 30.01 last 71.64) - open/close 2914 (time 1764792608.69 total 40.03 last 74.38) - open/close 3663 (time 1764792618.70 total 50.03 last 74.85) - open/close 4409 (time 1764792628.70 total 60.03 last 74.59) - open/close 5159 (time 1764792638.71 total 70.04 last 74.96) - open/close 5772 (time 1764792648.72 total 80.05 last 61.25) - open/close 6266 (time 1764792658.73 total 90.06 last 49.33) - open/close 6893 (time 1764792668.73 total 100.06 last 62.70) - open/close 7478 (time 1764792678.73 total 110.06 last 58.49) - open/close 8085 (time 1764792688.74 total 120.07 last 60.66) - open/close 8754 (time 1764792698.74 total 130.07 last 66.89) - open/close 9439 (time 1764792708.74 total 140.07 last 68.50) - open/close 10000 (time 1764792716.93 total 148.26 last 68.51) - open/close 10659 (time 1764792726.93 total 158.26 last 65.89) - open/close 11260 (time 1764792736.93 total 168.26 last 60.08) - open/close 11862 (time 1764792746.96 total 178.29 last 60.03) - open/close 12484 (time 1764792756.97 total 188.30 last 62.15) - open/close 13073 (time 1764792766.98 total 198.31 last 58.84) - open/close 13636 (time 1764792776.99 total 208.32 last 56.22) - open/close 14318 (time 1764792786.99 total 218.33 last 68.19) - open/close 15060 (time 1764792797.01 total 228.34 last 74.07) - open/close 15817 (time 1764792807.02 total 238.35 last 75.63) - open/close 16598 (time 1764792817.03 total 248.36 last 78.04) - open/close 17370 (time 1764792827.05 total 258.38 last 77.05) - open/close 18183 (time 1764792837.06 total 268.39 last 81.21) - open/close 18911 (time 1764792847.06 total 278.39 last 72.79) - open/close 19684 (time 1764792857.06 total 288.40 last 77.26) - open/close 20000 (time 1764792861.11 total 292.44 last 78.18) - open/close 20811 (time 1764792871.11 total 302.45 last 81.03) - open/close 21611 (time 1764792881.12 total 312.45 last 79.95) - open/close 22321 (time 1764792891.14 total 322.47 last 70.90) - open/close 23052 (time 1764792901.15 total 332.48 last 73.01) - open/close 23806 (time 1764792911.16 total 342.49 last 75.31) - open/close 24479 (time 1764792921.17 total 352.50 last 67.26) - open/close 25218 (time 1764792931.17 total 362.50 last 73.89) - open/close 25948 (time 1764792941.18 total 372.51 last 72.91) - open/close 26613 (time 1764792951.19 total 382.52 last 66.42) - open/close 27218 (time 1764792961.20 total 392.53 last 60.46) - open/close 27879 (time 1764792971.20 total 402.53 last 66.07) - open/close 28456 (time 1764792981.22 total 412.55 last 57.60) - open/close 29118 (time 1764792991.24 total 422.57 last 66.08) - open/close 29797 (time 1764793001.24 total 432.57 last 67.88) - open/close 30000 (time 1764793004.37 total 435.70 last 64.82) - open/close 30579 (time 1764793014.37 total 445.70 last 57.89) - open/close 31237 (time 1764793024.38 total 455.71 last 65.74) - open/close 31856 (time 1764793034.39 total 465.72 last 61.87) - open/close 32512 (time 1764793044.39 total 475.73 last 65.55) - open/close 33228 (time 1764793054.41 total 485.74 last 71.52) - open/close 33967 (time 1764793064.42 total 495.75 last 73.81) - open/close 34731 (time 1764793074.42 total 505.75 last 76.38) - open/close 35416 (time 1764793084.42 total 515.76 last 68.47) - open/close 36115 (time 1764793094.44 total 525.77 last 69.82) - open/close 36720 (time 1764793104.44 total 535.77 last 60.47) - open/close 37310 (time 1764793114.46 total 545.79 last 58.91) - open/close 37851 (time 1764793124.48 total 555.82 last 53.95) - open/close 38441 (time 1764793134.49 total 565.82 last 58.95) - open/close 38925 (time 1764793144.50 total 575.83 last 48.38) - open/close 39278 (time 1764793154.51 total 585.84 last 35.26) - open/close 39675 (time 1764793164.52 total 595.86 last 39.64) - open/close 40000 (time 1764793173.10 total 604.43 last 37.91) - open/close 40395 (time 1764793183.13 total 614.46 last 39.38) - open/close 40799 (time 1764793193.14 total 624.47 last 40.36) - open/close 41217 (time 1764793203.34 total 634.68 last 40.95) - open/close 41538 (time 1764793213.36 total 644.69 last 32.04) - open/close 41763 (time 1764793223.36 total 654.70 last 22.49) - open/close 42051 (time 1764793233.36 total 664.70 last 28.80) - open/close 42477 (time 1764793243.37 total 674.70 last 42.60) - open/close 42971 (time 1764793253.37 total 684.70 last 49.36) - open/close 43606 (time 1764793263.38 total 694.71 last 63.48) - open/close 44408 (time 1764793273.38 total 704.71 last 80.17) - open/close 45434 (time 1764793283.39 total 714.73 last 102.46) - open/close 46580 (time 1764793293.40 total 724.73 last 114.56) - open/close 47812 (time 1764793303.40 total 734.73 last 123.18) - open/close 48851 (time 1764793313.40 total 744.74 last 103.84) - open/close 49736 (time 1764793323.41 total 754.75 last 88.42) - open/close 50000 (time 1764793326.34 total 757.68 last 90.09) - open/close 51008 (time 1764793336.34 total 767.68 last 100.79) - open/close 51994 (time 1764793346.35 total 777.68 last 98.53) - open/close 53051 (time 1764793356.36 total 787.69 last 105.64) - open/close 54198 (time 1764793366.36 total 797.69 last 114.66) - open/close 55377 (time 1764793376.36 total 807.69 last 117.89) - open/close 56794 (time 1764793386.36 total 817.70 last 141.68) - open/close 57814 (time 1764793396.36 total 827.70 last 101.99) - open/close 58667 (time 1764793406.37 total 837.70 last 85.28) - open/close 59531 (time 1764793416.37 total 847.71 last 86.33) - open/close 60000 (time 1764793421.43 total 852.76 last 92.86) - open/close 60915 (time 1764793431.43 total 862.76 last 91.49) - open/close 61785 (time 1764793441.44 total 872.77 last 86.93) - open/close 62710 (time 1764793451.44 total 882.77 last 92.44) - open/close 63499 (time 1764793461.45 total 892.78 last 78.87) - open/close 64322 (time 1764793471.45 total 902.78 last 82.28) total: 64768 open/close in 907.52 seconds: 71.37 ops/second - /unlink 911 (time 1764793488.96 total 10.00 last 91.07) - /unlink 1754 (time 1764793498.96 total 20.00 last 84.29) - /unlink 2599 (time 1764793508.97 total 30.02 last 84.38) - /unlink 3539 (time 1764793518.98 total 40.03 last 93.90) - /unlink 4525 (time 1764793528.98 total 50.03 last 98.60) - /unlink 5392 (time 1764793538.98 total 60.03 last 86.70) - /unlink 6342 (time 1764793548.99 total 70.03 last 94.98) - /unlink 7292 (time 1764793558.99 total 80.04 last 94.95) - /unlink 8228 (time 1764793568.99 total 90.04 last 93.58) - /unlink 9481 (time 1764793578.99 total 100.04 last 125.28) - /unlink 10000 (time 1764793583.30 total 104.34 last 120.67) - /unlink 11204 (time 1764793593.30 total 114.34 last 120.40) - /unlink 12399 (time 1764793603.30 total 124.35 last 119.45) - /unlink 13365 (time 1764793613.31 total 134.35 last 96.52) - /unlink 14239 (time 1764793623.32 total 144.36 last 87.35) - /unlink 15191 (time 1764793633.32 total 154.36 last 95.19) - /unlink 16185 (time 1764793643.32 total 164.37 last 99.36) - /unlink 17093 (time 1764793653.33 total 174.37 last 90.74) - /unlink 17979 (time 1764793663.33 total 184.37 last 88.57) - /unlink 18942 (time 1764793673.33 total 194.38 last 96.29) - /unlink 19848 (time 1764793683.34 total 204.38 last 90.54) - /unlink 20737 (time 1764793693.35 total 214.39 last 88.79) - /unlink 21994 (time 1764793703.36 total 224.40 last 125.59) - /unlink 23084 (time 1764793713.36 total 234.41 last 108.95) - /unlink 24161 (time 1764793723.36 total 244.41 last 107.68) - /unlink 25095 (time 1764793733.37 total 254.42 last 93.35) - /unlink 26218 (time 1764793743.37 total 264.42 last 112.29) - /unlink 27387 (time 1764793753.37 total 274.42 last 116.88) - /unlink 28426 (time 1764793763.38 total 284.42 last 103.87) - /unlink 29975 (time 1764793773.38 total 294.43 last 154.81) - /unlink 31199 (time 1764793783.39 total 304.43 last 122.32) - /unlink 32207 (time 1764793793.40 total 314.45 last 100.66) - /unlink 33349 (time 1764793803.41 total 324.45 last 114.14) - /unlink 34404 (time 1764793813.41 total 334.46 last 105.43) - /unlink 35519 (time 1764793823.42 total 344.46 last 111.45) - /unlink 36634 (time 1764793833.42 total 354.46 last 111.49) - /unlink 37917 (time 1764793843.42 total 364.46 last 128.29) - /unlink 39285 (time 1764793853.43 total 374.47 last 136.71) - /unlink 40000 (time 1764793858.81 total 379.86 last 132.77) - /unlink 41180 (time 1764793868.81 total 389.86 last 117.99) - /unlink 42378 (time 1764793878.82 total 399.86 last 119.73) - /unlink 43437 (time 1764793888.82 total 409.87 last 105.84) - /unlink 44637 (time 1764793898.83 total 419.87 last 119.97) - /unlink 45925 (time 1764793908.83 total 429.88 last 128.73) - /unlink 47281 (time 1764793918.83 total 439.88 last 135.60) - /unlink 48709 (time 1764793928.83 total 449.88 last 142.79) - /unlink 50000 (time 1764793937.79 total 458.83 last 144.18) - /unlink 51744 (time 1764793947.79 total 468.83 last 174.40) - /unlink 53147 (time 1764793957.79 total 478.83 last 140.26) - /unlink 54835 (time 1764793967.79 total 488.83 last 168.80) - /unlink 57255 (time 1764793977.79 total 498.84 last 241.88) - /unlink 59693 (time 1764793987.80 total 508.84 last 243.74) - /unlink 62198 (time 1764793997.80 total 518.84 last 250.44) - /unlink 64441 (time 1764794007.80 total 528.85 last 224.22) total: 64768 /unlink in 530.01 seconds: 122.20 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1383 (time 1764794041.31 total 10.00 last 138.23) - open/close 2837 (time 1764794051.31 total 20.01 last 145.39) - open/close 4253 (time 1764794061.31 total 30.01 last 141.53) - open/close 5650 (time 1764794071.32 total 40.01 last 139.66) - open/close 7311 (time 1764794081.32 total 50.01 last 166.09) - open/close 8955 (time 1764794091.32 total 60.02 last 164.29) - open/close 10000 (time 1764794097.76 total 66.46 last 162.32) - open/close 11529 (time 1764794107.77 total 76.46 last 152.83) - open/close 12931 (time 1764794117.77 total 86.47 last 140.16) - open/close 13836 (time 1764794127.77 total 96.47 last 90.45) - open/close 14692 (time 1764794137.78 total 106.47 last 85.57) - open/close 15564 (time 1764794147.79 total 116.48 last 87.12) - open/close 16285 (time 1764794157.79 total 126.49 last 72.04) - open/close 17357 (time 1764794167.80 total 136.50 last 107.16) - open/close 18549 (time 1764794177.80 total 146.50 last 119.17) - open/close 19885 (time 1764794187.80 total 156.50 last 133.57) - open/close 21210 (time 1764794197.81 total 166.50 last 132.46) - open/close 22546 (time 1764794207.81 total 176.51 last 133.56) - open/close 23849 (time 1764794217.81 total 186.51 last 130.29) - open/close 25274 (time 1764794227.81 total 196.51 last 142.45) - open/close 26756 (time 1764794237.82 total 206.51 last 148.17) - open/close 28351 (time 1764794247.82 total 216.52 last 159.44) - open/close 30000 (time 1764794257.29 total 225.99 last 174.15) - open/close 31221 (time 1764794267.29 total 235.99 last 122.09) - open/close 32220 (time 1764794277.30 total 246.00 last 99.79) - open/close 33193 (time 1764794287.30 total 256.00 last 97.26) - open/close 34375 (time 1764794297.31 total 266.00 last 118.18) - open/close 36160 (time 1764794307.31 total 276.00 last 178.48) - open/close 37971 (time 1764794317.31 total 286.01 last 181.02) - open/close 39780 (time 1764794327.31 total 296.01 last 180.86) - open/close 41613 (time 1764794337.32 total 306.02 last 183.16) - open/close 43849 (time 1764794347.32 total 316.02 last 223.59) - open/close 46349 (time 1764794357.32 total 326.02 last 249.92) - open/close 48307 (time 1764794367.33 total 336.02 last 195.75) - open/close 50000 (time 1764794373.13 total 341.83 last 291.62) - open/close 52418 (time 1764794383.13 total 351.83 last 241.77) - open/close 54905 (time 1764794393.14 total 361.83 last 248.65) - open/close 57370 (time 1764794403.14 total 371.84 last 246.47) - open/close 59466 (time 1764794413.14 total 381.84 last 209.51) - open/close 62406 (time 1764794423.14 total 391.84 last 293.98) total: 64768 open/close in 400.37 seconds: 161.77 ops/second - /unlink 5580 (time 1764794443.24 total 10.00 last 557.90) - /unlink 10000 (time 1764794453.22 total 19.98 last 442.83) - /unlink 14001 (time 1764794463.22 total 29.98 last 400.09) - /unlink 18077 (time 1764794473.22 total 39.98 last 407.54) - /unlink 20000 (time 1764794477.25 total 44.02 last 477.12) - /unlink 25358 (time 1764794487.25 total 54.02 last 535.72) - /unlink 30000 (time 1764794495.98 total 62.75 last 531.75) - /unlink 34282 (time 1764794505.98 total 72.75 last 428.17) - /unlink 38907 (time 1764794515.98 total 82.75 last 462.43) - /unlink 40000 (time 1764794518.09 total 84.86 last 517.81) - /unlink 44348 (time 1764794528.10 total 94.86 last 434.73) - /unlink 49333 (time 1764794538.10 total 104.86 last 498.45) - /unlink 55079 (time 1764794548.10 total 114.86 last 574.52) - /unlink 60000 (time 1764794557.58 total 124.34 last 519.02) total: 64768 /unlink in 133.64 seconds: 484.66 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 2925 (time 1764794597.03 total 10.00 last 292.50) - open/close 6245 (time 1764794607.03 total 20.00 last 331.93) - open/close 10000 (time 1764794617.01 total 29.98 last 376.53) - open/close 12138 (time 1764794627.02 total 39.99 last 213.59) - open/close 13168 (time 1764794637.02 total 49.99 last 102.92) - open/close 13995 (time 1764794647.04 total 60.00 last 82.61) - open/close 14662 (time 1764794657.05 total 70.01 last 66.63) - open/close 15304 (time 1764794667.07 total 80.04 last 64.03) - open/close 15888 (time 1764794677.11 total 90.08 last 58.21) - open/close 16485 (time 1764794687.11 total 100.08 last 59.66) - open/close 17294 (time 1764794697.12 total 110.08 last 80.87) - open/close 18132 (time 1764794707.12 total 120.09 last 83.76) - open/close 19029 (time 1764794717.12 total 130.09 last 89.68) - open/close 20000 (time 1764794726.68 total 139.64 last 101.64) - open/close 21026 (time 1764794736.68 total 149.64 last 102.60) - open/close 21905 (time 1764794746.69 total 159.66 last 87.77) - open/close 22796 (time 1764794756.70 total 169.66 last 89.05) - open/close 23698 (time 1764794766.70 total 179.67 last 90.15) - open/close 24230 (time 1764794776.73 total 189.70 last 53.04) - open/close 24730 (time 1764794786.75 total 199.72 last 49.92) - open/close 25331 (time 1764794796.76 total 209.72 last 60.04) - open/close 26110 (time 1764794806.76 total 219.73 last 77.90) - open/close 26921 (time 1764794816.76 total 229.73 last 81.06) - open/close 27753 (time 1764794826.77 total 239.73 last 83.17) - open/close 28603 (time 1764794836.78 total 249.75 last 84.89) - open/close 29434 (time 1764794846.79 total 259.76 last 83.03) - open/close 30000 (time 1764794853.45 total 266.42 last 84.94) - open/close 30925 (time 1764794863.45 total 276.42 last 92.48) - open/close 31757 (time 1764794873.46 total 286.43 last 83.10) - open/close 32538 (time 1764794883.47 total 296.44 last 78.05) - open/close 33382 (time 1764794893.49 total 306.45 last 84.27) - open/close 34193 (time 1764794903.49 total 316.45 last 81.09) - open/close 35019 (time 1764794913.49 total 326.46 last 82.53) - open/close 35838 (time 1764794923.50 total 336.46 last 81.89) - open/close 36681 (time 1764794933.52 total 346.48 last 84.12) - open/close 37445 (time 1764794943.52 total 356.49 last 76.34) - open/close 38534 (time 1764794953.53 total 366.50 last 108.86) - open/close 39647 (time 1764794963.53 total 376.50 last 111.29) - open/close 40000 (time 1764794966.58 total 379.54 last 115.85) - open/close 40993 (time 1764794976.58 total 389.55 last 99.29) - open/close 42157 (time 1764794986.58 total 399.55 last 116.34) - open/close 44074 (time 1764794996.59 total 409.56 last 191.61) - open/close 46264 (time 1764795006.59 total 419.56 last 218.92) - open/close 47841 (time 1764795016.60 total 429.57 last 157.50) - open/close 49173 (time 1764795026.61 total 439.58 last 133.12) - open/close 50000 (time 1764795032.68 total 445.65 last 136.28) - open/close 50894 (time 1764795042.69 total 455.66 last 89.31) - open/close 51647 (time 1764795052.69 total 465.66 last 75.25) - open/close 52297 (time 1764795062.70 total 475.67 last 64.96) - open/close 52943 (time 1764795072.71 total 485.68 last 64.50) - open/close 53638 (time 1764795082.73 total 495.69 last 69.41) - open/close 54361 (time 1764795092.74 total 505.71 last 72.22) - open/close 55045 (time 1764795102.74 total 515.71 last 68.37) - open/close 55879 (time 1764795112.75 total 525.72 last 83.31) - open/close 56685 (time 1764795122.76 total 535.73 last 80.53) - open/close 57476 (time 1764795132.76 total 545.73 last 79.08) - open/close 58239 (time 1764795142.77 total 555.74 last 76.26) - open/close 58830 (time 1764795152.77 total 565.74 last 59.08) - open/close 59503 (time 1764795162.77 total 575.74 last 67.29) - open/close 60000 (time 1764795168.94 total 581.91 last 80.59) - open/close 60825 (time 1764795178.94 total 591.91 last 82.50) - open/close 61575 (time 1764795188.94 total 601.91 last 74.99) - open/close 62364 (time 1764795198.95 total 611.91 last 78.87) - open/close 63128 (time 1764795208.95 total 621.92 last 76.34) - open/close 64000 (time 1764795218.96 total 631.93 last 87.12) total: 64768 open/close in 640.89 seconds: 101.06 ops/second - /unlink 816 (time 1764795240.93 total 10.00 last 81.59) - /unlink 1687 (time 1764795250.93 total 20.00 last 87.07) - /unlink 2578 (time 1764795260.94 total 30.01 last 89.05) - /unlink 3478 (time 1764795270.94 total 40.01 last 89.99) - /unlink 4284 (time 1764795280.94 total 50.02 last 80.54) - /unlink 5040 (time 1764795290.95 total 60.02 last 75.57) - /unlink 5900 (time 1764795300.95 total 70.02 last 85.99) - /unlink 6769 (time 1764795310.97 total 80.04 last 86.75) - /unlink 7563 (time 1764795320.97 total 90.04 last 79.38) - /unlink 8389 (time 1764795330.97 total 100.05 last 82.57) - /unlink 9250 (time 1764795340.99 total 110.07 last 85.94) - /unlink 10000 (time 1764795349.91 total 118.99 last 84.09) - /unlink 10861 (time 1764795359.93 total 129.01 last 85.89) - /unlink 11714 (time 1764795369.94 total 139.01 last 85.26) - /unlink 12553 (time 1764795379.95 total 149.02 last 83.83) - /unlink 13336 (time 1764795389.95 total 159.03 last 78.25) - /unlink 14172 (time 1764795399.95 total 169.03 last 83.59) - /unlink 14994 (time 1764795409.96 total 179.04 last 82.14) - /unlink 15860 (time 1764795419.97 total 189.04 last 86.55) - /unlink 16696 (time 1764795429.97 total 199.05 last 83.55) - /unlink 17562 (time 1764795439.99 total 209.06 last 86.50) - /unlink 18344 (time 1764795449.99 total 219.06 last 78.18) - /unlink 19102 (time 1764795459.99 total 229.07 last 75.76) - /unlink 19968 (time 1764795470.00 total 239.07 last 86.55) - /unlink 20843 (time 1764795480.01 total 249.08 last 87.41) - /unlink 21799 (time 1764795490.02 total 259.10 last 95.47) - /unlink 22605 (time 1764795500.03 total 269.11 last 80.55) - /unlink 23442 (time 1764795510.05 total 279.12 last 83.57) - /unlink 24243 (time 1764795520.06 total 289.14 last 79.96) - /unlink 25063 (time 1764795530.09 total 299.16 last 81.79) - /unlink 25900 (time 1764795540.10 total 309.18 last 83.59) - /unlink 26728 (time 1764795550.11 total 319.18 last 82.76) - /unlink 27577 (time 1764795560.11 total 329.18 last 84.90) - /unlink 28375 (time 1764795570.12 total 339.19 last 79.72) - /unlink 29142 (time 1764795580.13 total 349.20 last 76.63) - /unlink 29933 (time 1764795590.13 total 359.21 last 79.06) - /unlink 30792 (time 1764795600.14 total 369.22 last 85.82) - /unlink 31600 (time 1764795610.15 total 379.23 last 80.70) - /unlink 32399 (time 1764795620.16 total 389.23 last 79.87) - /unlink 33206 (time 1764795630.16 total 399.23 last 80.69) - /unlink 34050 (time 1764795640.17 total 409.24 last 84.31) - /unlink 34882 (time 1764795650.18 total 419.25 last 83.13) - /unlink 35711 (time 1764795660.19 total 429.27 last 82.79) - /unlink 36596 (time 1764795670.20 total 439.27 last 88.44) - /unlink 37391 (time 1764795680.21 total 449.28 last 79.45) - /unlink 38237 (time 1764795690.21 total 459.29 last 84.53) - /unlink 38984 (time 1764795700.23 total 469.30 last 74.60) - /unlink 39755 (time 1764795710.24 total 479.31 last 77.02) - /unlink 40000 (time 1764795713.44 total 482.52 last 76.38) - /unlink 40721 (time 1764795723.45 total 492.53 last 72.05) - /unlink 41436 (time 1764795733.46 total 502.54 last 71.42) - /unlink 42250 (time 1764795743.47 total 512.54 last 81.38) - /unlink 43056 (time 1764795753.47 total 522.54 last 80.58) - /unlink 43820 (time 1764795763.47 total 532.55 last 76.39) - /unlink 44622 (time 1764795773.54 total 542.62 last 79.62) - /unlink 45449 (time 1764795783.55 total 552.62 last 82.66) - /unlink 46301 (time 1764795793.56 total 562.63 last 85.11) - /unlink 47201 (time 1764795803.56 total 572.64 last 89.97) - /unlink 48123 (time 1764795813.57 total 582.64 last 92.14) - /unlink 48898 (time 1764795823.57 total 592.65 last 77.46) - /unlink 49687 (time 1764795833.59 total 602.66 last 78.80) - /unlink 50000 (time 1764795837.31 total 606.38 last 84.07) - /unlink 50831 (time 1764795847.31 total 616.39 last 83.07) - /unlink 51699 (time 1764795857.33 total 626.40 last 86.69) - /unlink 52416 (time 1764795867.34 total 636.41 last 71.62) - /unlink 53096 (time 1764795877.35 total 646.42 last 67.94) - /unlink 53763 (time 1764795887.35 total 656.43 last 66.66) - /unlink 54554 (time 1764795897.36 total 666.43 last 79.06) - /unlink 55336 (time 1764795907.36 total 676.43 last 78.18) - /unlink 56121 (time 1764795917.36 total 686.44 last 78.48) - /unlink 56935 (time 1764795927.37 total 696.45 last 81.31) - /unlink 57754 (time 1764795937.38 total 706.45 last 81.84) - /unlink 58571 (time 1764795947.38 total 716.46 last 81.67) - /unlink 59380 (time 1764795957.39 total 726.46 last 80.87) - /unlink 60000 (time 1764795964.95 total 734.03 last 81.95) - /unlink 60856 (time 1764795974.96 total 744.04 last 85.54) - /unlink 61741 (time 1764795984.97 total 754.04 last 88.46) - /unlink 62656 (time 1764795994.98 total 764.05 last 91.41) - /unlink 63498 (time 1764796004.98 total 774.06 last 84.14) - /unlink 64465 (time 1764796014.99 total 784.06 last 96.62) total: 64768 /unlink in 787.19 seconds: 82.28 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 876 (time 1764796047.43 total 10.01 last 87.52) - open/close 1708 (time 1764796057.43 total 20.01 last 83.17) - open/close 2583 (time 1764796067.44 total 30.01 last 87.49) - open/close 3414 (time 1764796077.46 total 40.04 last 82.91) - open/close 4275 (time 1764796087.46 total 50.04 last 86.08) - open/close 5098 (time 1764796097.47 total 60.04 last 82.26) - open/close 5935 (time 1764796107.47 total 70.05 last 83.68) - open/close 6809 (time 1764796117.47 total 80.05 last 87.39) - open/close 7701 (time 1764796127.48 total 90.06 last 89.14) - open/close 8537 (time 1764796137.48 total 100.06 last 83.54) - open/close 9435 (time 1764796147.49 total 110.06 last 89.77) - open/close 10000 (time 1764796153.55 total 116.13 last 93.20) - open/close 10890 (time 1764796163.56 total 126.14 last 88.88) - open/close 11825 (time 1764796173.57 total 136.14 last 93.46) - open/close 12678 (time 1764796183.57 total 146.15 last 85.27) - open/close 13455 (time 1764796193.58 total 156.15 last 77.65) - open/close 14135 (time 1764796203.58 total 166.16 last 67.98) - open/close 14739 (time 1764796213.59 total 176.16 last 60.36) - open/close 15446 (time 1764796223.59 total 186.16 last 70.70) - open/close 16260 (time 1764796233.61 total 196.18 last 81.24) - open/close 17017 (time 1764796243.61 total 206.19 last 75.66) - open/close 17860 (time 1764796253.62 total 216.20 last 84.24) - open/close 18694 (time 1764796263.62 total 226.20 last 83.40) - open/close 19540 (time 1764796273.62 total 236.20 last 84.55) - open/close 20000 (time 1764796279.73 total 242.31 last 75.35) - open/close 20882 (time 1764796289.73 total 252.31 last 88.15) - open/close 21731 (time 1764796299.74 total 262.32 last 84.85) - open/close 22585 (time 1764796309.75 total 272.33 last 85.31) - open/close 23375 (time 1764796319.76 total 282.34 last 78.94) - open/close 24243 (time 1764796329.76 total 292.34 last 86.74) - open/close 25131 (time 1764796339.77 total 302.34 last 88.78) - open/close 26049 (time 1764796349.78 total 312.36 last 91.70) - open/close 26919 (time 1764796359.78 total 322.36 last 86.98) - open/close 27730 (time 1764796369.78 total 332.36 last 81.07) - open/close 28601 (time 1764796379.80 total 342.38 last 86.97) - open/close 29451 (time 1764796389.80 total 352.38 last 85.00) - open/close 30000 (time 1764796396.05 total 358.63 last 87.76) - open/close 30834 (time 1764796406.06 total 368.64 last 83.35) - open/close 31702 (time 1764796416.06 total 378.64 last 86.76) - open/close 32525 (time 1764796426.07 total 388.65 last 82.26) - open/close 33387 (time 1764796436.08 total 398.66 last 86.10) - open/close 34193 (time 1764796446.10 total 408.68 last 80.41) - open/close 34924 (time 1764796456.11 total 418.69 last 73.02) - open/close 35694 (time 1764796466.12 total 428.69 last 76.99) - open/close 36454 (time 1764796476.13 total 438.71 last 75.92) - open/close 37230 (time 1764796486.13 total 448.71 last 77.59) - open/close 38020 (time 1764796496.14 total 458.72 last 78.93) - open/close 38829 (time 1764796506.15 total 468.73 last 80.81) - open/close 39665 (time 1764796516.16 total 478.73 last 83.53) - open/close 40000 (time 1764796520.14 total 482.72 last 84.08) - open/close 40869 (time 1764796530.14 total 492.72 last 86.88) - open/close 41682 (time 1764796540.15 total 502.73 last 81.26) - open/close 42473 (time 1764796550.15 total 512.73 last 79.07) - open/close 43272 (time 1764796560.18 total 522.76 last 79.68) - open/close 44068 (time 1764796570.19 total 532.76 last 79.55) - open/close 44861 (time 1764796580.19 total 542.77 last 79.27) - open/close 45645 (time 1764796590.19 total 552.77 last 78.40) - open/close 46375 (time 1764796600.20 total 562.77 last 72.96) - open/close 47116 (time 1764796610.20 total 572.78 last 74.05) - open/close 47888 (time 1764796620.22 total 582.79 last 77.10) - open/close 48672 (time 1764796630.22 total 592.80 last 78.37) - open/close 49425 (time 1764796640.23 total 602.81 last 75.24) - open/close 50000 (time 1764796648.09 total 610.67 last 73.16) - open/close 50762 (time 1764796658.10 total 620.68 last 76.11) - open/close 51525 (time 1764796668.11 total 630.68 last 76.25) - open/close 52284 (time 1764796678.12 total 640.70 last 75.77) - open/close 52867 (time 1764796688.13 total 650.71 last 58.26) - open/close 53592 (time 1764796698.14 total 660.71 last 72.46) - open/close 54329 (time 1764796708.14 total 670.72 last 73.64) - open/close 55056 (time 1764796718.15 total 680.73 last 72.61) - open/close 55818 (time 1764796728.16 total 690.74 last 76.14) - open/close 56621 (time 1764796738.18 total 700.75 last 80.20) - open/close 57425 (time 1764796748.18 total 710.76 last 80.37) - open/close 58182 (time 1764796758.18 total 720.76 last 75.67) - open/close 58999 (time 1764796768.20 total 730.77 last 81.60) - open/close 59703 (time 1764796778.20 total 740.78 last 70.38) - open/close 60000 (time 1764796782.11 total 744.69 last 75.97) - open/close 60662 (time 1764796792.11 total 754.69 last 66.17) - open/close 61229 (time 1764796802.12 total 764.70 last 56.63) - open/close 61895 (time 1764796812.13 total 774.71 last 66.59) - open/close 62571 (time 1764796822.13 total 784.71 last 67.59) - open/close 63349 (time 1764796832.13 total 794.71 last 77.77) - open/close 64193 (time 1764796842.15 total 804.73 last 84.28) total: 64768 open/close in 811.52 seconds: 79.81 ops/second - /unlink 817 (time 1764796862.40 total 10.00 last 81.66) - /unlink 1649 (time 1764796872.41 total 20.01 last 83.17) - /unlink 2478 (time 1764796882.41 total 30.01 last 82.90) - /unlink 3330 (time 1764796892.41 total 40.01 last 85.19) - /unlink 4157 (time 1764796902.41 total 50.01 last 82.68) - /unlink 4925 (time 1764796912.41 total 60.02 last 76.76) - /unlink 5680 (time 1764796922.43 total 70.03 last 75.40) - /unlink 6472 (time 1764796932.44 total 80.04 last 79.10) - /unlink 7292 (time 1764796942.45 total 90.05 last 81.94) - /unlink 8067 (time 1764796952.46 total 100.06 last 77.42) - /unlink 8830 (time 1764796962.48 total 110.08 last 76.16) - /unlink 9556 (time 1764796972.50 total 120.10 last 72.46) - /unlink 10000 (time 1764796978.17 total 125.77 last 78.28) - /unlink 10777 (time 1764796988.18 total 135.78 last 77.60) - /unlink 11511 (time 1764796998.18 total 145.78 last 73.40) - /unlink 12312 (time 1764797008.19 total 155.79 last 80.03) - /unlink 13087 (time 1764797018.19 total 165.79 last 77.50) - /unlink 13826 (time 1764797028.20 total 175.80 last 73.83) - /unlink 14589 (time 1764797038.20 total 185.80 last 76.28) - /unlink 15364 (time 1764797048.20 total 195.81 last 77.49) - /unlink 16157 (time 1764797058.21 total 205.81 last 79.27) - /unlink 16927 (time 1764797068.21 total 215.81 last 76.96) - /unlink 17716 (time 1764797078.21 total 225.81 last 78.90) - /unlink 18506 (time 1764797088.21 total 235.82 last 78.97) - /unlink 19293 (time 1764797098.22 total 245.82 last 78.66) - /unlink 20000 (time 1764797107.05 total 254.65 last 80.08) - /unlink 20812 (time 1764797117.07 total 264.67 last 81.02) - /unlink 21575 (time 1764797127.08 total 274.68 last 76.26) - /unlink 22362 (time 1764797137.09 total 284.70 last 78.56) - /unlink 23180 (time 1764797147.10 total 294.70 last 81.75) - /unlink 23994 (time 1764797157.10 total 304.71 last 81.37) - /unlink 24836 (time 1764797167.11 total 314.71 last 84.18) - /unlink 25675 (time 1764797177.11 total 324.71 last 83.88) - /unlink 26599 (time 1764797187.11 total 334.71 last 92.39) - /unlink 27444 (time 1764797197.12 total 344.72 last 84.43) - /unlink 28221 (time 1764797207.12 total 354.73 last 77.65) - /unlink 29027 (time 1764797217.13 total 364.73 last 80.58) - /unlink 29870 (time 1764797227.13 total 374.73 last 84.28) - /unlink 30690 (time 1764797237.14 total 384.74 last 81.95) - /unlink 31481 (time 1764797247.15 total 394.75 last 79.02) - /unlink 32328 (time 1764797257.15 total 404.76 last 84.64) - /unlink 33154 (time 1764797267.16 total 414.76 last 82.53) - /unlink 34003 (time 1764797277.18 total 424.78 last 84.76) - /unlink 34875 (time 1764797287.18 total 434.78 last 87.19) - /unlink 35679 (time 1764797297.19 total 444.79 last 80.36) - /unlink 36517 (time 1764797307.19 total 454.79 last 83.75) - /unlink 37380 (time 1764797317.19 total 464.79 last 86.30) - /unlink 38257 (time 1764797327.21 total 474.82 last 87.51) - /unlink 39061 (time 1764797337.24 total 484.84 last 80.21) - /unlink 39862 (time 1764797347.25 total 494.85 last 80.02) - /unlink 40718 (time 1764797357.25 total 504.86 last 85.53) - /unlink 41614 (time 1764797367.26 total 514.86 last 89.55) - /unlink 42513 (time 1764797377.27 total 524.88 last 89.79) - /unlink 43361 (time 1764797387.28 total 534.88 last 84.76) - /unlink 44194 (time 1764797397.29 total 544.90 last 83.18) - /unlink 44935 (time 1764797407.30 total 554.90 last 74.07) - /unlink 45790 (time 1764797417.31 total 564.92 last 85.36) - /unlink 46565 (time 1764797427.32 total 574.93 last 77.43) - /unlink 47401 (time 1764797437.34 total 584.94 last 83.47) - /unlink 48297 (time 1764797447.34 total 594.94 last 89.59) - /unlink 49234 (time 1764797457.34 total 604.94 last 93.68) - /unlink 50000 (time 1764797466.61 total 614.22 last 82.63) - /unlink 50825 (time 1764797476.62 total 624.22 last 82.46) - /unlink 51615 (time 1764797486.62 total 634.22 last 78.97) - /unlink 52486 (time 1764797496.62 total 644.23 last 87.07) - /unlink 53329 (time 1764797506.64 total 654.24 last 84.21) - /unlink 54243 (time 1764797516.64 total 664.24 last 91.38) - /unlink 55069 (time 1764797526.64 total 674.24 last 82.60) - /unlink 55886 (time 1764797536.64 total 684.25 last 81.64) - /unlink 56624 (time 1764797546.65 total 694.26 last 73.74) - /unlink 57437 (time 1764797556.66 total 704.27 last 81.21) - /unlink 58275 (time 1764797566.67 total 714.28 last 83.72) - /unlink 59093 (time 1764797576.68 total 724.28 last 81.78) - /unlink 59897 (time 1764797586.68 total 734.29 last 80.35) - /unlink 60712 (time 1764797596.69 total 744.29 last 81.44) - /unlink 61439 (time 1764797606.69 total 754.30 last 72.68) - /unlink 62260 (time 1764797616.70 total 764.30 last 82.03) - /unlink 63140 (time 1764797626.70 total 774.31 last 87.98) - /unlink 63929 (time 1764797636.71 total 784.31 last 78.86) - /unlink 64722 (time 1764797646.72 total 794.32 last 79.21) total: 64768 /unlink in 794.93 seconds: 81.48 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg351-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg351-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg351-server stop mds service on oleg351-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg351-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg351-server' oleg351-server: oleg351-server.virtnet: executing unload_modules_local oleg351-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg351-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg351-client: oleg351-client: ssh exited with exit code 2 pdsh@oleg351-client: oleg351-server: ssh exited with exit code 2 pdsh@oleg351-client: oleg351-server: ssh exited with exit code 2 pdsh@oleg351-client: oleg351-client: ssh exited with exit code 2 PASS 106 (6554s) Stopping clients: oleg351-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg351-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg351-client: oleg351-server: ssh exited with exit code 2 oleg351-server: oleg351-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg351-server' oleg351-server: oleg351-server.virtnet: executing load_modules_local oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg351-server: Loading modules from /home/green/git/lustre-release/lustre oleg351-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg351-server: detected 4 online CPUs by sysfs oleg351-server: MODOPTS_LIBCFS= oleg351-server: Force libcfs to create 2 CPU partitions oleg351-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg351-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 6701 sec ========== 16:35:53 (1764797753) === conf-sanity: start cleanup 16:35:54 (1764797754) === === conf-sanity: finish cleanup 16:35:57 (1764797757) ===