-----============= acceptance-small: conf-sanity ============----- Sun Nov 16 21:52:48 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg150-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg150-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg150-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg150-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg150-server oleg150-server: oleg150-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg150-server' oleg150-server: oleg150-server.virtnet: executing load_modules_local oleg150-server: Loading modules from /home/green/git/lustre-release/lustre oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg150-server: detected 4 online CPUs by sysfs oleg150-server: MODOPTS_LIBCFS= oleg150-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg150-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg150-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg150-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg150-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg150-server: oleg150-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg150-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg150-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server stop mds service on oleg150-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 21:55:24 (1763348124) Stopping clients: oleg150-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg150-client.virtnet /mnt/lustre2 (opts:-f) oleg150-server: oleg150-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg150-server' oleg150-server: oleg150-server.virtnet: executing load_modules_local oleg150-server: Loading modules from /home/green/git/lustre-release/lustre oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg150-server: detected 4 online CPUs by sysfs oleg150-server: MODOPTS_LIBCFS= oleg150-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg150-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg150-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg150-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg150-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg150-client.virtnet: -o user_xattr,flock 192.168.201.150@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 32648 392 32256 2% /mnt/lustre[OST:0] filesystem_summary: 32585 329 32256 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 676 (time 1763348229.73 total 10.01 last 67.54) - open/close 1371 (time 1763348239.74 total 20.02 last 69.43) - open/close 1983 (time 1763348249.74 total 30.02 last 61.18) - open/close 2742 (time 1763348259.76 total 40.04 last 75.77) - open/close 3503 (time 1763348269.76 total 50.04 last 76.08) - open/close 4233 (time 1763348279.78 total 60.05 last 72.91) - open/close 4897 (time 1763348289.78 total 70.06 last 66.35) - open/close 5606 (time 1763348299.79 total 80.07 last 70.87) - open/close 6259 (time 1763348309.80 total 90.07 last 65.25) - open/close 6958 (time 1763348319.81 total 100.08 last 69.83) - open/close 7606 (time 1763348329.81 total 110.09 last 64.78) - open/close 8289 (time 1763348339.84 total 120.11 last 68.13) - open/close 8962 (time 1763348349.85 total 130.13 last 67.19) - open/close 9600 (time 1763348359.86 total 140.14 last 63.72) - open/close 10000 (time 1763348365.13 total 145.41 last 75.99) - open/close 10697 (time 1763348375.14 total 155.42 last 69.63) - open/close 11398 (time 1763348385.17 total 165.45 last 69.88) - open/close 12097 (time 1763348395.19 total 175.46 last 69.79) - open/close 12723 (time 1763348405.20 total 185.48 last 62.49) - open/close 13477 (time 1763348415.22 total 195.50 last 75.29) - open/close 14176 (time 1763348425.22 total 205.50 last 69.86) - open/close 14924 (time 1763348435.24 total 215.51 last 74.71) - open/close 15640 (time 1763348445.24 total 225.51 last 71.60) - open/close 16313 (time 1763348455.25 total 235.52 last 67.23) - open/close 16975 (time 1763348465.25 total 245.52 last 66.20) - open/close 17670 (time 1763348475.25 total 255.53 last 69.47) - open/close 18308 (time 1763348485.26 total 265.54 last 63.76) - open/close 18957 (time 1763348495.28 total 275.56 last 64.75) - open/close 19675 (time 1763348505.29 total 285.57 last 71.74) - open/close 20000 (time 1763348509.92 total 290.19 last 70.22) - open/close 20684 (time 1763348519.92 total 300.20 last 68.38) - open/close 21408 (time 1763348529.93 total 310.20 last 72.36) - open/close 22100 (time 1763348539.93 total 320.21 last 69.14) - open/close 22756 (time 1763348549.95 total 330.23 last 65.48) - open/close 23428 (time 1763348559.95 total 340.23 last 67.18) - open/close 24112 (time 1763348569.96 total 350.24 last 68.34) - open/close 24850 (time 1763348579.97 total 360.25 last 73.72) - open/close 25559 (time 1763348589.98 total 370.26 last 70.84) - open/close 26252 (time 1763348600.00 total 380.28 last 69.18) - open/close 26887 (time 1763348610.00 total 390.28 last 63.48) - open/close 27631 (time 1763348620.02 total 400.30 last 74.25) - open/close 28366 (time 1763348630.03 total 410.31 last 73.45) - open/close 29067 (time 1763348640.03 total 420.31 last 70.08) - open/close 29739 (time 1763348650.04 total 430.32 last 67.16) - open/close 30000 (time 1763348654.42 total 434.69 last 59.64) - open/close 30667 (time 1763348664.42 total 444.70 last 66.65) - open/close 31398 (time 1763348674.42 total 454.70 last 73.09) - open/close 32144 (time 1763348684.43 total 464.71 last 74.54) - open/close 32851 (time 1763348694.44 total 474.72 last 70.63) - open/close 33546 (time 1763348704.45 total 484.73 last 69.47) - open/close 34219 (time 1763348714.45 total 494.73 last 67.27) - open/close 34943 (time 1763348724.46 total 504.74 last 72.35) - open/close 35681 (time 1763348734.46 total 514.74 last 73.80) - open/close 36456 (time 1763348744.48 total 524.76 last 77.36) - open/close 37222 (time 1763348754.49 total 534.77 last 76.50) - open/close 37903 (time 1763348764.51 total 544.78 last 68.00) - open/close 38584 (time 1763348774.52 total 554.79 last 68.03) - open/close 39313 (time 1763348784.53 total 564.80 last 72.83) - open/close 40000 (time 1763348794.24 total 574.51 last 70.74) - open/close 40719 (time 1763348804.24 total 584.52 last 71.88) - open/close 41407 (time 1763348814.24 total 594.52 last 68.78) - open/close 42105 (time 1763348824.26 total 604.53 last 69.70) - open/close 42798 (time 1763348834.26 total 614.54 last 69.26) - open/close 43481 (time 1763348844.27 total 624.54 last 68.28) - open/close 44178 (time 1763348854.27 total 634.55 last 69.68) - open/close 44829 (time 1763348864.28 total 644.56 last 65.03) - open/close 45484 (time 1763348874.30 total 654.57 last 65.40) - open/close 46120 (time 1763348884.30 total 664.58 last 63.57) - open/close 46768 (time 1763348894.31 total 674.58 last 64.77) - open/close 47439 (time 1763348904.32 total 684.59 last 67.02) - open/close 48102 (time 1763348914.33 total 694.60 last 66.24) - open/close 48750 (time 1763348924.34 total 704.62 last 64.70) - open/close 49427 (time 1763348934.37 total 714.65 last 67.48) - open/close 50000 (time 1763348942.85 total 723.12 last 67.62) - open/close 50636 (time 1763348952.85 total 733.13 last 63.59) - open/close 51306 (time 1763348962.86 total 743.13 last 66.95) - open/close 52031 (time 1763348972.86 total 753.13 last 72.50) - open/close 52730 (time 1763348982.86 total 763.14 last 69.88) - open/close 53400 (time 1763348992.87 total 773.15 last 66.93) - open/close 53990 (time 1763349002.88 total 783.16 last 58.95) - open/close 54765 (time 1763349012.89 total 793.17 last 77.40) - open/close 55528 (time 1763349022.90 total 803.18 last 76.22) - open/close 56261 (time 1763349032.92 total 813.19 last 73.18) - open/close 56941 (time 1763349042.93 total 823.21 last 67.91) - open/close 57609 (time 1763349052.95 total 833.22 last 66.70) - open/close 58250 (time 1763349062.95 total 843.23 last 64.09) - open/close 58948 (time 1763349072.95 total 853.23 last 69.76) - open/close 59682 (time 1763349082.96 total 863.23 last 73.38) - open/close 60000 (time 1763349086.95 total 867.22 last 79.66) - open/close 60761 (time 1763349096.95 total 877.23 last 76.04) - open/close 61498 (time 1763349106.96 total 887.23 last 73.70) - open/close 62230 (time 1763349116.96 total 897.24 last 73.17) - open/close 63015 (time 1763349126.97 total 907.25 last 78.38) - open/close 63740 (time 1763349136.98 total 917.26 last 72.46) - open/close 64427 (time 1763349146.98 total 927.26 last 68.69) total: 64768 open/close in 932.27 seconds: 69.47 ops/second - /unlink 704 (time 1763349166.27 total 10.01 last 70.35) - /unlink 1450 (time 1763349176.28 total 20.02 last 74.51) - /unlink 2132 (time 1763349186.28 total 30.02 last 68.18) - /unlink 2824 (time 1763349196.28 total 40.03 last 69.17) - /unlink 3534 (time 1763349206.29 total 50.04 last 70.93) - /unlink 4202 (time 1763349216.30 total 60.04 last 66.78) - /unlink 4815 (time 1763349226.33 total 70.07 last 61.12) - /unlink 5435 (time 1763349236.34 total 80.08 last 61.94) - /unlink 6092 (time 1763349246.34 total 90.09 last 65.65) - /unlink 6725 (time 1763349256.35 total 100.09 last 63.29) - /unlink 7385 (time 1763349266.36 total 110.11 last 65.89) - /unlink 8066 (time 1763349276.38 total 120.12 last 68.00) - /unlink 8725 (time 1763349286.38 total 130.13 last 65.86) - /unlink 9415 (time 1763349296.40 total 140.14 last 68.90) - /unlink 10000 (time 1763349305.15 total 148.89 last 66.84) - /unlink 10673 (time 1763349315.16 total 158.90 last 67.25) - /unlink 11351 (time 1763349325.17 total 168.92 last 67.69) - /unlink 12045 (time 1763349335.18 total 178.92 last 69.34) - /unlink 12681 (time 1763349345.19 total 188.93 last 63.54) - /unlink 13308 (time 1763349355.20 total 198.94 last 62.68) - /unlink 13955 (time 1763349365.20 total 208.95 last 64.65) - /unlink 14645 (time 1763349375.21 total 218.95 last 68.97) - /unlink 15257 (time 1763349385.22 total 228.96 last 61.12) - /unlink 15833 (time 1763349395.24 total 238.99 last 57.47) - /unlink 16551 (time 1763349405.25 total 248.99 last 71.73) - /unlink 17268 (time 1763349415.27 total 259.01 last 71.57) - /unlink 17921 (time 1763349425.28 total 269.02 last 65.23) - /unlink 18495 (time 1763349435.30 total 279.04 last 57.28) - /unlink 19185 (time 1763349445.31 total 289.05 last 68.92) - /unlink 19805 (time 1763349455.31 total 299.06 last 62.00) - /unlink 20000 (time 1763349458.94 total 302.68 last 53.84) - /unlink 20593 (time 1763349468.94 total 312.68 last 59.28) - /unlink 21207 (time 1763349478.95 total 322.69 last 61.35) - /unlink 21829 (time 1763349488.95 total 332.70 last 62.15) - /unlink 22490 (time 1763349498.97 total 342.71 last 66.02) - /unlink 23139 (time 1763349508.99 total 352.73 last 64.73) - /unlink 23800 (time 1763349519.00 total 362.75 last 66.02) - /unlink 24439 (time 1763349529.01 total 372.76 last 63.84) - /unlink 25109 (time 1763349539.01 total 382.76 last 66.99) - /unlink 25811 (time 1763349549.02 total 392.76 last 70.19) - /unlink 26524 (time 1763349559.02 total 402.77 last 71.24) - /unlink 27186 (time 1763349569.03 total 412.77 last 66.18) - /unlink 27766 (time 1763349579.04 total 422.78 last 57.95) - /unlink 28383 (time 1763349589.05 total 432.79 last 61.63) - /unlink 29008 (time 1763349599.07 total 442.81 last 62.39) - /unlink 29665 (time 1763349609.08 total 452.82 last 65.62) - /unlink 30000 (time 1763349614.11 total 457.85 last 66.63) - /unlink 30629 (time 1763349624.11 total 467.85 last 62.87) - /unlink 31287 (time 1763349634.11 total 477.86 last 65.77) - /unlink 31942 (time 1763349644.12 total 487.86 last 65.49) - /unlink 32603 (time 1763349654.12 total 497.86 last 66.09) - /unlink 33265 (time 1763349664.12 total 507.86 last 66.20) - /unlink 33928 (time 1763349674.12 total 517.86 last 66.30) - /unlink 34607 (time 1763349684.13 total 527.88 last 67.79) - /unlink 35299 (time 1763349694.14 total 537.88 last 69.14) - /unlink 36043 (time 1763349704.15 total 547.89 last 74.35) - /unlink 36767 (time 1763349714.16 total 557.90 last 72.34) - /unlink 37464 (time 1763349724.16 total 567.90 last 69.68) - /unlink 38157 (time 1763349734.17 total 577.91 last 69.22) - /unlink 38808 (time 1763349744.18 total 587.92 last 65.07) - /unlink 39530 (time 1763349754.18 total 597.93 last 72.16) - /unlink 40000 (time 1763349759.48 total 603.22 last 88.75) - /unlink 40767 (time 1763349769.48 total 613.22 last 76.69) - /unlink 41445 (time 1763349779.49 total 623.23 last 67.73) - /unlink 42130 (time 1763349789.49 total 633.23 last 68.49) - /unlink 42876 (time 1763349799.51 total 643.25 last 74.47) - /unlink 43539 (time 1763349809.52 total 653.26 last 66.25) - /unlink 44234 (time 1763349819.52 total 663.26 last 69.47) - /unlink 45023 (time 1763349829.52 total 673.26 last 78.89) - /unlink 45771 (time 1763349839.52 total 683.27 last 74.78) - /unlink 46431 (time 1763349849.54 total 693.28 last 65.92) - /unlink 47068 (time 1763349859.54 total 703.28 last 63.66) - /unlink 47642 (time 1763349869.55 total 713.29 last 57.37) - /unlink 48318 (time 1763349879.56 total 723.30 last 67.53) - /unlink 48961 (time 1763349889.56 total 733.30 last 64.29) - /unlink 49603 (time 1763349899.57 total 743.31 last 64.14) - /unlink 50000 (time 1763349905.39 total 749.13 last 68.16) - /unlink 50645 (time 1763349915.40 total 759.14 last 64.45) - /unlink 51291 (time 1763349925.41 total 769.15 last 64.56) - /unlink 51997 (time 1763349935.41 total 779.15 last 70.57) - /unlink 52670 (time 1763349945.42 total 789.16 last 67.23) - /unlink 53337 (time 1763349955.43 total 799.17 last 66.66) - /unlink 54030 (time 1763349965.44 total 809.18 last 69.25) - /unlink 54778 (time 1763349975.45 total 819.19 last 74.70) - /unlink 55514 (time 1763349985.45 total 829.20 last 73.57) - /unlink 56245 (time 1763349995.46 total 839.21 last 73.03) - /unlink 56917 (time 1763350005.48 total 849.22 last 67.10) - /unlink 57569 (time 1763350015.49 total 859.23 last 65.15) - /unlink 58205 (time 1763350025.50 total 869.24 last 63.54) - /unlink 58889 (time 1763350035.51 total 879.25 last 68.34) - /unlink 59533 (time 1763350045.52 total 889.26 last 64.34) - /unlink 60000 (time 1763350052.02 total 895.76 last 71.84) - /unlink 60689 (time 1763350062.04 total 905.78 last 68.77) - /unlink 61370 (time 1763350072.04 total 915.78 last 68.07) - /unlink 62065 (time 1763350082.05 total 925.79 last 69.45) - /unlink 62817 (time 1763350092.05 total 935.79 last 75.17) - /unlink 63494 (time 1763350102.06 total 945.81 last 67.61) - /unlink 64150 (time 1763350112.10 total 955.84 last 65.38) total: 64768 /unlink in 965.09 seconds: 67.11 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 726 (time 1763350157.82 total 10.01 last 72.52) - open/close 1449 (time 1763350167.82 total 20.01 last 72.28) - open/close 2160 (time 1763350177.83 total 30.02 last 71.03) - open/close 2860 (time 1763350187.83 total 40.02 last 69.99) - open/close 3547 (time 1763350197.84 total 50.03 last 68.68) - open/close 4295 (time 1763350207.85 total 60.04 last 74.71) - open/close 4991 (time 1763350217.86 total 70.05 last 69.55) - open/close 5687 (time 1763350227.87 total 80.06 last 69.50) - open/close 6396 (time 1763350237.88 total 90.07 last 70.80) - open/close 7122 (time 1763350247.89 total 100.08 last 72.54) - open/close 7835 (time 1763350257.90 total 110.09 last 71.24) - open/close 8480 (time 1763350267.91 total 120.10 last 64.45) - open/close 9171 (time 1763350277.92 total 130.11 last 69.02) - open/close 9900 (time 1763350287.93 total 140.12 last 72.84) - open/close 10613 (time 1763350297.95 total 150.14 last 71.18) - open/close 11277 (time 1763350307.95 total 160.14 last 66.35) - open/close 11953 (time 1763350317.97 total 170.16 last 67.49) - open/close 12666 (time 1763350327.97 total 180.16 last 71.28) - open/close 13394 (time 1763350337.98 total 190.17 last 72.74) - open/close 14137 (time 1763350347.98 total 200.17 last 74.29) - open/close 14877 (time 1763350357.99 total 210.18 last 73.97) - open/close 15581 (time 1763350367.99 total 220.18 last 70.39) - open/close 16312 (time 1763350378.00 total 230.19 last 73.04) - open/close 16968 (time 1763350388.00 total 240.19 last 65.58) - open/close 17707 (time 1763350398.00 total 250.19 last 73.89) - open/close 18426 (time 1763350408.01 total 260.20 last 71.86) - open/close 19105 (time 1763350418.01 total 270.20 last 67.88) - open/close 19790 (time 1763350428.01 total 280.20 last 68.49) - open/close 20000 (time 1763350431.17 total 283.36 last 66.61) - open/close 20652 (time 1763350441.17 total 293.36 last 65.16) - open/close 21303 (time 1763350451.19 total 303.38 last 65.01) - open/close 21991 (time 1763350461.19 total 313.38 last 68.76) - open/close 22698 (time 1763350471.20 total 323.39 last 70.67) - open/close 23455 (time 1763350481.20 total 333.39 last 75.67) - open/close 24194 (time 1763350491.20 total 343.39 last 73.90) - open/close 24900 (time 1763350501.21 total 353.40 last 70.53) - open/close 25515 (time 1763350511.23 total 363.42 last 61.40) - open/close 26156 (time 1763350521.23 total 373.42 last 64.07) - open/close 26827 (time 1763350531.24 total 383.44 last 67.01) - open/close 27525 (time 1763350541.25 total 393.44 last 69.75) - open/close 28259 (time 1763350551.26 total 403.45 last 73.36) - open/close 28912 (time 1763350561.26 total 413.46 last 65.24) - open/close 29588 (time 1763350571.27 total 423.46 last 67.55) - open/close 30000 (time 1763350577.23 total 429.42 last 69.15) - open/close 30687 (time 1763350587.27 total 439.46 last 68.41) - open/close 31365 (time 1763350597.28 total 449.48 last 67.73) - open/close 31989 (time 1763350607.30 total 459.49 last 62.33) - open/close 32607 (time 1763350617.30 total 469.49 last 61.75) - open/close 33233 (time 1763350627.32 total 479.51 last 62.51) - open/close 33853 (time 1763350637.32 total 489.51 last 62.00) - open/close 34502 (time 1763350647.34 total 499.53 last 64.75) - open/close 35114 (time 1763350657.35 total 509.54 last 61.16) - open/close 35744 (time 1763350667.36 total 519.55 last 62.95) - open/close 36407 (time 1763350677.37 total 529.56 last 66.22) - open/close 37038 (time 1763350687.38 total 539.57 last 63.02) - open/close 37704 (time 1763350697.39 total 549.59 last 66.51) - open/close 38352 (time 1763350707.40 total 559.59 last 64.76) - open/close 38974 (time 1763350717.41 total 569.60 last 62.16) - open/close 39664 (time 1763350727.42 total 579.61 last 68.89) - open/close 40000 (time 1763350733.03 total 585.22 last 59.92) - open/close 40612 (time 1763350743.05 total 595.24 last 61.10) - open/close 41246 (time 1763350753.05 total 605.24 last 63.39) - open/close 41840 (time 1763350763.07 total 615.26 last 59.29) - open/close 42430 (time 1763350773.08 total 625.27 last 58.91) - open/close 43068 (time 1763350783.10 total 635.29 last 63.68) - open/close 43700 (time 1763350793.11 total 645.31 last 63.11) - open/close 44319 (time 1763350803.12 total 655.31 last 61.86) - open/close 44895 (time 1763350813.13 total 665.32 last 57.56) - open/close 45511 (time 1763350823.13 total 675.32 last 61.59) - open/close 46089 (time 1763350833.13 total 685.32 last 57.79) - open/close 46692 (time 1763350843.13 total 695.33 last 60.28) - open/close 47292 (time 1763350853.15 total 705.35 last 59.88) - open/close 47914 (time 1763350863.16 total 715.35 last 62.16) - open/close 48537 (time 1763350873.17 total 725.36 last 62.27) - open/close 49102 (time 1763350883.18 total 735.37 last 56.40) - open/close 49689 (time 1763350893.19 total 745.38 last 58.66) - open/close 50000 (time 1763350898.57 total 750.76 last 57.79) - open/close 50587 (time 1763350908.58 total 760.77 last 58.66) - open/close 51158 (time 1763350918.60 total 770.79 last 56.99) - open/close 51745 (time 1763350928.61 total 780.80 last 58.63) - open/close 52381 (time 1763350938.62 total 790.81 last 63.52) - open/close 52984 (time 1763350948.63 total 800.83 last 60.22) - open/close 53611 (time 1763350958.64 total 810.83 last 62.68) - open/close 54206 (time 1763350968.65 total 820.84 last 59.43) - open/close 54799 (time 1763350978.67 total 830.86 last 59.18) - open/close 55419 (time 1763350988.69 total 840.88 last 61.89) - open/close 56022 (time 1763350998.69 total 850.88 last 60.29) - open/close 56663 (time 1763351008.69 total 860.88 last 64.10) - open/close 57309 (time 1763351018.70 total 870.89 last 64.52) - open/close 57923 (time 1763351028.71 total 880.90 last 61.34) - open/close 58479 (time 1763351038.72 total 890.91 last 55.55) - open/close 59054 (time 1763351048.73 total 900.93 last 57.43) - open/close 59682 (time 1763351058.74 total 910.93 last 62.76) - open/close 60000 (time 1763351064.15 total 916.34 last 58.76) - open/close 60631 (time 1763351074.17 total 926.36 last 63.02) - open/close 61300 (time 1763351084.18 total 936.37 last 66.82) - open/close 61881 (time 1763351094.20 total 946.39 last 57.96) - open/close 62463 (time 1763351104.23 total 956.42 last 58.02) - open/close 63036 (time 1763351114.23 total 966.42 last 57.30) - open/close 63624 (time 1763351124.24 total 976.43 last 58.75) - open/close 64246 (time 1763351134.25 total 986.44 last 62.15) total: 64768 open/close in 994.52 seconds: 65.12 ops/second - /unlink 601 (time 1763351156.22 total 10.00 last 60.09) - /unlink 1166 (time 1763351166.23 total 20.01 last 56.45) - /unlink 1735 (time 1763351176.26 total 30.04 last 56.75) - /unlink 2348 (time 1763351186.26 total 40.04 last 61.28) - /unlink 2963 (time 1763351196.27 total 50.05 last 61.45) - /unlink 3585 (time 1763351206.27 total 60.05 last 62.18) - /unlink 4223 (time 1763351216.28 total 70.06 last 63.74) - /unlink 4820 (time 1763351226.30 total 80.08 last 59.62) - /unlink 5406 (time 1763351236.33 total 90.11 last 58.40) - /unlink 5975 (time 1763351246.34 total 100.12 last 56.86) - /unlink 6507 (time 1763351256.35 total 110.13 last 53.15) - /unlink 7057 (time 1763351266.36 total 120.14 last 54.94) - /unlink 7651 (time 1763351276.36 total 130.14 last 59.38) - /unlink 8316 (time 1763351286.37 total 140.15 last 66.44) - /unlink 8906 (time 1763351296.37 total 150.15 last 58.99) - /unlink 9526 (time 1763351306.38 total 160.16 last 61.95) - /unlink 10000 (time 1763351314.84 total 168.62 last 56.06) - /unlink 10608 (time 1763351324.85 total 178.63 last 60.74) - /unlink 11228 (time 1763351334.85 total 188.63 last 61.96) - /unlink 11842 (time 1763351344.86 total 198.64 last 61.37) - /unlink 12517 (time 1763351354.87 total 208.65 last 67.41) - /unlink 13200 (time 1763351364.88 total 218.66 last 68.26) - /unlink 13858 (time 1763351374.89 total 228.67 last 65.72) - /unlink 14519 (time 1763351384.90 total 238.68 last 66.04) - /unlink 15187 (time 1763351394.91 total 248.70 last 66.69) - /unlink 15839 (time 1763351404.95 total 258.73 last 64.95) - /unlink 16497 (time 1763351414.99 total 268.77 last 65.54) - /unlink 17113 (time 1763351424.99 total 278.77 last 61.60) - /unlink 17763 (time 1763351435.00 total 288.78 last 64.98) - /unlink 18415 (time 1763351445.01 total 298.79 last 65.14) - /unlink 19053 (time 1763351455.01 total 308.79 last 63.75) - /unlink 19705 (time 1763351465.02 total 318.80 last 65.13) - /unlink 20000 (time 1763351469.59 total 323.38 last 64.54) - /unlink 20662 (time 1763351479.61 total 333.39 last 66.11) - /unlink 21309 (time 1763351489.61 total 343.39 last 64.67) - /unlink 21990 (time 1763351499.63 total 353.41 last 68.01) - /unlink 22719 (time 1763351509.64 total 363.42 last 72.82) - /unlink 23372 (time 1763351519.65 total 373.43 last 65.21) - /unlink 24035 (time 1763351529.66 total 383.44 last 66.22) - /unlink 24710 (time 1763351539.67 total 393.45 last 67.43) - /unlink 25330 (time 1763351549.68 total 403.46 last 61.94) - /unlink 25976 (time 1763351559.69 total 413.47 last 64.54) - /unlink 26578 (time 1763351569.71 total 423.49 last 60.10) - /unlink 27180 (time 1763351579.72 total 433.50 last 60.14) - /unlink 27831 (time 1763351589.72 total 443.50 last 65.06) - /unlink 28388 (time 1763351599.75 total 453.53 last 55.56) - /unlink 28982 (time 1763351609.77 total 463.55 last 59.26) - /unlink 29657 (time 1763351619.78 total 473.56 last 67.44) - /unlink 30000 (time 1763351624.99 total 478.77 last 65.81) - /unlink 30641 (time 1763351635.00 total 488.78 last 64.06) - /unlink 31302 (time 1763351645.01 total 498.79 last 66.02) - /unlink 32013 (time 1763351655.01 total 508.79 last 71.09) - /unlink 32704 (time 1763351665.04 total 518.82 last 68.94) - /unlink 33336 (time 1763351675.04 total 528.82 last 63.17) - /unlink 34029 (time 1763351685.05 total 538.83 last 69.24) - /unlink 34720 (time 1763351695.06 total 548.84 last 69.05) - /unlink 35402 (time 1763351705.07 total 558.85 last 68.11) - /unlink 36087 (time 1763351715.08 total 568.87 last 68.41) - /unlink 36779 (time 1763351725.09 total 578.87 last 69.17) - /unlink 37468 (time 1763351735.09 total 588.87 last 68.86) - /unlink 38176 (time 1763351745.10 total 598.88 last 70.78) - /unlink 38913 (time 1763351755.10 total 608.88 last 73.68) - /unlink 39626 (time 1763351765.12 total 618.90 last 71.18) - /unlink 40000 (time 1763351769.93 total 623.71 last 77.69) - /unlink 40674 (time 1763351779.93 total 633.71 last 67.37) - /unlink 41373 (time 1763351789.94 total 643.72 last 69.88) - /unlink 42070 (time 1763351799.94 total 653.73 last 69.64) - /unlink 42790 (time 1763351809.95 total 663.73 last 71.94) - /unlink 43605 (time 1763351819.96 total 673.74 last 81.46) - /unlink 44626 (time 1763351829.96 total 683.74 last 102.10) - /unlink 45558 (time 1763351839.97 total 693.75 last 93.12) - /unlink 46415 (time 1763351849.97 total 703.75 last 85.69) - /unlink 47183 (time 1763351859.98 total 713.76 last 76.74) - /unlink 47960 (time 1763351869.98 total 723.76 last 77.65) - /unlink 48728 (time 1763351879.99 total 733.77 last 76.79) - /unlink 49450 (time 1763351890.00 total 743.78 last 72.11) - /unlink 50000 (time 1763351897.14 total 750.92 last 76.97) - /unlink 50802 (time 1763351907.15 total 760.93 last 80.16) - /unlink 51672 (time 1763351917.15 total 770.93 last 86.97) - /unlink 52505 (time 1763351927.15 total 780.93 last 83.28) - /unlink 53441 (time 1763351937.16 total 790.94 last 93.52) - /unlink 54416 (time 1763351947.18 total 800.96 last 97.35) - /unlink 55286 (time 1763351957.18 total 810.96 last 86.97) - /unlink 56299 (time 1763351967.19 total 820.97 last 101.27) - /unlink 57212 (time 1763351977.19 total 830.97 last 91.28) - /unlink 58332 (time 1763351987.19 total 840.97 last 111.94) - /unlink 59520 (time 1763351997.20 total 850.98 last 118.71) - /unlink 60000 (time 1763352002.40 total 856.18 last 92.30) - /unlink 60974 (time 1763352012.40 total 866.18 last 97.40) - /unlink 61902 (time 1763352022.42 total 876.20 last 92.67) - /unlink 62940 (time 1763352032.42 total 886.20 last 103.76) - /unlink 63875 (time 1763352042.43 total 896.21 last 93.44) total: 64768 /unlink in 905.88 seconds: 71.50 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1045 (time 1763352087.42 total 10.01 last 104.36) - open/close 2143 (time 1763352097.43 total 20.02 last 109.73) - open/close 3118 (time 1763352107.43 total 30.02 last 97.49) - open/close 4076 (time 1763352117.43 total 40.02 last 95.76) - open/close 5028 (time 1763352127.44 total 50.03 last 95.15) - open/close 5906 (time 1763352137.44 total 60.03 last 87.77) - open/close 6740 (time 1763352147.44 total 70.04 last 83.38) - open/close 7596 (time 1763352157.45 total 80.04 last 85.54) - open/close 8524 (time 1763352167.46 total 90.05 last 92.75) - open/close 9417 (time 1763352177.46 total 100.05 last 89.28) - open/close 10000 (time 1763352183.86 total 106.45 last 91.13) - open/close 11115 (time 1763352193.86 total 116.45 last 111.42) - open/close 12057 (time 1763352203.87 total 126.46 last 94.18) - open/close 13000 (time 1763352213.87 total 136.46 last 94.26) - open/close 14037 (time 1763352223.87 total 146.47 last 103.64) - open/close 14990 (time 1763352233.88 total 156.47 last 95.29) - open/close 15835 (time 1763352243.88 total 166.47 last 84.47) - open/close 16780 (time 1763352253.88 total 176.47 last 94.49) - open/close 17671 (time 1763352263.89 total 186.48 last 89.01) - open/close 18619 (time 1763352273.89 total 196.48 last 94.78) - open/close 19792 (time 1763352283.89 total 206.48 last 117.29) - open/close 20000 (time 1763352285.89 total 208.49 last 103.91) - open/close 20997 (time 1763352295.90 total 218.49 last 99.63) - open/close 22205 (time 1763352305.90 total 228.49 last 120.79) - open/close 23206 (time 1763352315.90 total 238.49 last 100.09) - open/close 24226 (time 1763352325.91 total 248.50 last 101.94) - open/close 25207 (time 1763352335.91 total 258.50 last 98.07) - open/close 26063 (time 1763352345.92 total 268.51 last 85.57) - open/close 27128 (time 1763352355.92 total 278.51 last 106.47) - open/close 28072 (time 1763352365.92 total 288.51 last 94.40) - open/close 29051 (time 1763352375.93 total 298.52 last 97.81) - open/close 30000 (time 1763352385.21 total 307.80 last 102.24) - open/close 31063 (time 1763352395.22 total 317.81 last 106.21) - open/close 32145 (time 1763352405.24 total 327.83 last 108.02) - open/close 33057 (time 1763352415.25 total 337.84 last 91.10) - open/close 33945 (time 1763352425.25 total 347.84 last 88.79) - open/close 34924 (time 1763352435.25 total 357.84 last 97.90) - open/close 35935 (time 1763352445.26 total 367.85 last 101.02) - open/close 36926 (time 1763352455.26 total 377.85 last 99.06) - open/close 37862 (time 1763352465.27 total 387.86 last 93.55) - open/close 38852 (time 1763352475.27 total 397.86 last 98.97) - open/close 39816 (time 1763352485.27 total 407.87 last 96.34) - open/close 40806 (time 1763352495.28 total 417.87 last 98.96) - open/close 41828 (time 1763352505.28 total 427.87 last 102.18) - open/close 42896 (time 1763352515.29 total 437.88 last 106.75) - open/close 43891 (time 1763352525.29 total 447.88 last 99.47) - open/close 44762 (time 1763352535.30 total 457.89 last 86.98) - open/close 45594 (time 1763352545.30 total 467.90 last 83.18) - open/close 46392 (time 1763352555.31 total 477.90 last 79.75) - open/close 47376 (time 1763352565.31 total 487.91 last 98.36) - open/close 48456 (time 1763352575.32 total 497.92 last 107.90) - open/close 49499 (time 1763352585.33 total 507.92 last 104.28) - open/close 50000 (time 1763352590.12 total 512.71 last 104.54) - open/close 51163 (time 1763352600.13 total 522.72 last 116.20) - open/close 52246 (time 1763352610.13 total 532.72 last 108.23) - open/close 53264 (time 1763352620.14 total 542.73 last 101.75) - open/close 54412 (time 1763352630.14 total 552.73 last 114.77) - open/close 55540 (time 1763352640.14 total 562.74 last 112.77) - open/close 56439 (time 1763352650.15 total 572.74 last 89.82) - open/close 57344 (time 1763352660.16 total 582.75 last 90.45) - open/close 58416 (time 1763352670.17 total 592.76 last 107.05) - open/close 59316 (time 1763352680.18 total 602.77 last 89.97) - open/close 60000 (time 1763352687.81 total 610.41 last 89.56) - open/close 60809 (time 1763352697.82 total 620.41 last 80.86) - open/close 61663 (time 1763352707.83 total 630.42 last 85.34) - open/close 62565 (time 1763352717.83 total 640.42 last 90.17) - open/close 63493 (time 1763352727.83 total 650.42 last 92.78) - open/close 64668 (time 1763352737.84 total 660.43 last 117.40) total: 64768 open/close in 661.34 seconds: 97.93 ops/second - /unlink 1107 (time 1763352750.88 total 10.01 last 110.62) - /unlink 1966 (time 1763352760.90 total 20.02 last 85.79) - /unlink 2946 (time 1763352770.90 total 30.02 last 97.97) - /unlink 3885 (time 1763352780.91 total 40.03 last 93.83) - /unlink 4888 (time 1763352790.91 total 50.03 last 100.27) - /unlink 5954 (time 1763352800.92 total 60.04 last 106.53) - /unlink 7146 (time 1763352810.92 total 70.05 last 119.12) - /unlink 8394 (time 1763352820.93 total 80.05 last 124.73) - /unlink 9453 (time 1763352830.94 total 90.06 last 105.79) - /unlink 10000 (time 1763352836.91 total 96.03 last 91.67) - /unlink 10926 (time 1763352846.91 total 106.03 last 92.60) - /unlink 12042 (time 1763352856.91 total 116.03 last 111.55) - /unlink 13349 (time 1763352866.92 total 126.04 last 130.64) - /unlink 14456 (time 1763352876.93 total 136.05 last 110.57) - /unlink 15577 (time 1763352886.93 total 146.05 last 112.09) - /unlink 16862 (time 1763352896.93 total 156.05 last 128.46) - /unlink 18082 (time 1763352906.94 total 166.06 last 121.87) - /unlink 18974 (time 1763352916.95 total 176.07 last 89.12) - /unlink 20000 (time 1763352926.29 total 185.42 last 109.82) - /unlink 21183 (time 1763352936.30 total 195.42 last 118.26) - /unlink 22420 (time 1763352946.30 total 205.42 last 123.68) - /unlink 23635 (time 1763352956.30 total 215.43 last 121.45) - /unlink 24848 (time 1763352966.31 total 225.43 last 121.25) - /unlink 26066 (time 1763352976.31 total 235.43 last 121.79) - /unlink 27502 (time 1763352986.31 total 245.44 last 143.52) - /unlink 28862 (time 1763352996.32 total 255.45 last 135.87) - /unlink 29967 (time 1763353006.32 total 265.45 last 110.50) - /unlink 31308 (time 1763353016.33 total 275.45 last 134.04) - /unlink 32912 (time 1763353026.33 total 285.46 last 160.30) - /unlink 34709 (time 1763353036.34 total 295.46 last 179.65) - /unlink 37314 (time 1763353046.34 total 305.46 last 260.49) - /unlink 40000 (time 1763353055.60 total 314.72 last 290.05) - /unlink 42880 (time 1763353065.60 total 324.72 last 287.89) - /unlink 44936 (time 1763353075.60 total 334.73 last 205.55) - /unlink 47124 (time 1763353085.61 total 344.73 last 218.71) - /unlink 49239 (time 1763353095.61 total 354.73 last 211.44) - /unlink 50000 (time 1763353099.02 total 358.14 last 223.26) - /unlink 52299 (time 1763353109.03 total 368.15 last 229.76) - /unlink 54947 (time 1763353119.03 total 378.15 last 264.78) - /unlink 57736 (time 1763353129.03 total 388.15 last 278.84) - /unlink 60000 (time 1763353136.84 total 395.96 last 290.00) - /unlink 62277 (time 1763353146.84 total 405.96 last 227.68) total: 64768 /unlink in 415.57 seconds: 155.85 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1310 (time 1763353186.96 total 10.00 last 130.96) - open/close 2741 (time 1763353196.97 total 20.01 last 143.03) - open/close 4431 (time 1763353206.97 total 30.01 last 168.97) - open/close 5868 (time 1763353216.98 total 40.02 last 143.54) - open/close 7093 (time 1763353226.98 total 50.02 last 122.50) - open/close 8469 (time 1763353236.99 total 60.03 last 137.50) - open/close 9765 (time 1763353246.99 total 70.04 last 129.48) - open/close 11211 (time 1763353257.00 total 80.04 last 144.59) - open/close 12775 (time 1763353267.00 total 90.04 last 156.35) - open/close 14230 (time 1763353277.01 total 100.05 last 145.39) - open/close 15725 (time 1763353287.01 total 110.05 last 149.42) - open/close 17376 (time 1763353297.01 total 120.05 last 165.07) - open/close 19028 (time 1763353307.02 total 130.06 last 165.06) - open/close 20000 (time 1763353313.32 total 136.36 last 154.42) - open/close 21804 (time 1763353323.32 total 146.36 last 180.32) - open/close 23505 (time 1763353333.32 total 156.36 last 170.06) - open/close 25120 (time 1763353343.33 total 166.37 last 161.46) - open/close 26773 (time 1763353353.33 total 176.37 last 165.28) - open/close 28215 (time 1763353363.36 total 186.41 last 143.67) - open/close 29756 (time 1763353373.37 total 196.41 last 154.08) - open/close 31512 (time 1763353383.37 total 206.41 last 175.56) - open/close 32988 (time 1763353393.37 total 216.41 last 147.58) - open/close 34374 (time 1763353403.37 total 226.41 last 138.57) - open/close 36231 (time 1763353413.37 total 236.41 last 185.70) - open/close 37570 (time 1763353423.37 total 246.41 last 133.89) - open/close 38937 (time 1763353433.37 total 256.41 last 136.69) - open/close 40000 (time 1763353441.45 total 264.49 last 131.61) - open/close 41749 (time 1763353451.45 total 274.49 last 174.86) - open/close 43264 (time 1763353461.45 total 284.50 last 151.46) - open/close 44824 (time 1763353471.46 total 294.50 last 155.98) - open/close 46501 (time 1763353481.46 total 304.50 last 167.70) - open/close 47600 (time 1763353491.46 total 314.50 last 109.82) - open/close 48890 (time 1763353501.47 total 324.51 last 128.95) - open/close 50000 (time 1763353509.01 total 332.05 last 147.16) - open/close 51478 (time 1763353519.02 total 342.06 last 147.70) - open/close 52824 (time 1763353529.02 total 352.06 last 134.56) - open/close 54350 (time 1763353539.02 total 362.07 last 152.53) - open/close 56022 (time 1763353549.03 total 372.07 last 167.13) - open/close 57655 (time 1763353559.03 total 382.07 last 163.28) - open/close 59243 (time 1763353569.03 total 392.07 last 158.79) - open/close 60000 (time 1763353573.20 total 396.24 last 181.63) - open/close 61823 (time 1763353583.20 total 406.24 last 182.28) - open/close 63486 (time 1763353593.21 total 416.25 last 166.19) total: 64768 open/close in 425.37 seconds: 152.26 ops/second - /unlink 2791 (time 1763353614.32 total 10.00 last 279.07) - /unlink 5280 (time 1763353624.32 total 20.00 last 248.88) - /unlink 8205 (time 1763353634.32 total 30.00 last 292.42) - /unlink 10000 (time 1763353641.71 total 37.39 last 242.89) - /unlink 12659 (time 1763353651.71 total 47.40 last 265.86) - /unlink 16002 (time 1763353661.71 total 57.40 last 334.25) - /unlink 19382 (time 1763353671.71 total 67.40 last 337.98) - /unlink 20000 (time 1763353673.98 total 69.66 last 273.14) - /unlink 23112 (time 1763353683.98 total 79.66 last 311.18) - /unlink 26233 (time 1763353693.98 total 89.67 last 311.98) - /unlink 28360 (time 1763353703.98 total 99.67 last 212.63) - /unlink 30000 (time 1763353711.10 total 106.78 last 230.52) - /unlink 32604 (time 1763353721.10 total 116.79 last 260.32) - /unlink 35071 (time 1763353731.10 total 126.79 last 246.64) - /unlink 37795 (time 1763353741.11 total 136.79 last 272.30) - /unlink 40000 (time 1763353749.30 total 144.98 last 269.27) - /unlink 42686 (time 1763353759.30 total 154.98 last 268.52) - /unlink 45068 (time 1763353769.30 total 164.98 last 238.20) - /unlink 47865 (time 1763353779.30 total 174.99 last 279.65) - /unlink 50000 (time 1763353786.74 total 182.43 last 286.81) - /unlink 52453 (time 1763353796.75 total 192.43 last 245.27) - /unlink 55224 (time 1763353806.75 total 202.43 last 277.05) - /unlink 58274 (time 1763353816.75 total 212.43 last 304.95) - /unlink 60000 (time 1763353822.36 total 218.04 last 307.67) - /unlink 63217 (time 1763353832.36 total 228.05 last 321.65) total: 64768 /unlink in 233.11 seconds: 277.84 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete - open/close 1525 (time 1763353867.42 total 10.00 last 152.47) - open/close 3217 (time 1763353877.43 total 20.00 last 169.15) - open/close 4824 (time 1763353887.43 total 30.01 last 160.64) - open/close 6284 (time 1763353897.43 total 40.01 last 145.98) - open/close 7979 (time 1763353907.43 total 50.01 last 169.49) - open/close 9534 (time 1763353917.43 total 60.01 last 155.48) - open/close 10000 (time 1763353920.94 total 63.52 last 132.97) - open/close 11485 (time 1763353930.94 total 73.52 last 148.49) - open/close 13181 (time 1763353940.95 total 83.53 last 169.43) - open/close 15192 (time 1763353950.95 total 93.53 last 201.05) - open/close 17626 (time 1763353960.96 total 103.54 last 243.24) - open/close 20000 (time 1763353969.36 total 111.94 last 282.57) - open/close 22208 (time 1763353979.36 total 121.94 last 220.75) - open/close 24585 (time 1763353989.36 total 131.94 last 237.66) - open/close 26931 (time 1763353999.37 total 141.95 last 234.29) - open/close 28675 (time 1763354009.38 total 151.96 last 174.30) - open/close 30000 (time 1763354016.54 total 159.12 last 185.18) - open/close 31774 (time 1763354026.54 total 169.12 last 177.39) - open/close 33704 (time 1763354036.54 total 179.12 last 192.95) - open/close 35629 (time 1763354046.54 total 189.12 last 192.42) - open/close 37432 (time 1763354056.55 total 199.13 last 180.25) - open/close 39552 (time 1763354066.55 total 209.13 last 211.97) - open/close 40000 (time 1763354068.86 total 211.44 last 193.29) - open/close 41961 (time 1763354078.87 total 221.45 last 196.05) - open/close 43621 (time 1763354088.87 total 231.45 last 165.94) - open/close 45582 (time 1763354098.88 total 241.45 last 196.01) - open/close 47297 (time 1763354108.88 total 251.46 last 171.49) - open/close 49114 (time 1763354118.88 total 261.46 last 181.63) - open/close 50000 (time 1763354123.33 total 265.91 last 199.21) - open/close 51727 (time 1763354133.33 total 275.91 last 172.67) - open/close 53846 (time 1763354143.33 total 285.91 last 211.84) - open/close 55622 (time 1763354153.33 total 295.91 last 177.54) - open/close 57482 (time 1763354163.34 total 305.92 last 185.99) - open/close 59477 (time 1763354173.37 total 315.95 last 198.90) - open/close 60000 (time 1763354176.21 total 318.79 last 183.93) - open/close 61872 (time 1763354186.21 total 328.79 last 187.10) - open/close 63678 (time 1763354196.22 total 338.80 last 180.53) total: 64768 open/close in 344.08 seconds: 188.24 ops/second - /unlink 3798 (time 1763354213.23 total 10.00 last 379.80) - /unlink 7360 (time 1763354223.23 total 20.00 last 356.18) - /unlink 10000 (time 1763354231.08 total 27.85 last 336.41) - /unlink 13458 (time 1763354241.08 total 37.85 last 345.71) - /unlink 16685 (time 1763354251.09 total 47.85 last 322.65) - /unlink 20000 (time 1763354260.62 total 57.39 last 347.74) - /unlink 23649 (time 1763354270.65 total 67.42 last 363.72) - /unlink 27209 (time 1763354280.65 total 77.42 last 355.95) - /unlink 30000 (time 1763354288.59 total 85.35 last 351.74) - /unlink 33396 (time 1763354298.59 total 95.36 last 339.54) - /unlink 36656 (time 1763354308.59 total 105.36 last 325.93) - /unlink 39910 (time 1763354318.59 total 115.36 last 325.35) - /unlink 42669 (time 1763354328.59 total 125.36 last 275.88) - /unlink 45571 (time 1763354338.60 total 135.36 last 290.10) - /unlink 48227 (time 1763354348.60 total 145.37 last 265.52) - /unlink 50000 (time 1763354354.05 total 150.82 last 325.22) - /unlink 52784 (time 1763354364.05 total 160.82 last 278.40) - /unlink 56278 (time 1763354374.05 total 170.82 last 349.33) - /unlink 60000 (time 1763354383.90 total 180.67 last 377.91) - /unlink 63654 (time 1763354393.90 total 190.67 last 365.39) total: 64768 /unlink in 193.09 seconds: 335.44 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg150-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg150-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server stop mds service on oleg150-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg150-server' oleg150-server: oleg150-server.virtnet: executing unload_modules_local oleg150-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg150-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg150-client: oleg150-client: ssh exited with exit code 2 pdsh@oleg150-client: oleg150-server: ssh exited with exit code 2 pdsh@oleg150-client: oleg150-client: ssh exited with exit code 2 pdsh@oleg150-client: oleg150-server: ssh exited with exit code 2 PASS 106 (6306s) Stopping clients: oleg150-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg150-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg150-client: oleg150-server: ssh exited with exit code 2 oleg150-server: oleg150-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg150-server' oleg150-server: oleg150-server.virtnet: executing load_modules_local oleg150-server: Loading modules from /home/green/git/lustre-release/lustre oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg150-server: detected 4 online CPUs by sysfs oleg150-server: MODOPTS_LIBCFS= oleg150-server: Force libcfs to create 2 CPU partitions oleg150-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg150-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 6491 sec ========== 23:41:01 (1763354461) === conf-sanity: start cleanup 23:41:02 (1763354462) === === conf-sanity: finish cleanup 23:41:03 (1763354463) ===