== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 04:31:47 (1769074307) Stopping clients: oleg343-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg343-client.virtnet /mnt/lustre2 (opts:-f) oleg343-server: oleg343-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg343-server' oleg343-server: oleg343-server.virtnet: executing load_modules_local oleg343-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg343-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg343-server: Loading modules from /home/green/git/lustre-release/lustre oleg343-server: detected 4 online CPUs by sysfs oleg343-server: MODOPTS_LIBCFS= oleg343-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg343-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg343-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg343-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg343-server: oleg343-server.virtnet: executing set_default_debug -1 all pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg343-client.virtnet: -o user_xattr,flock 192.168.203.143@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 65808 368 65440 1% /mnt/lustre[OST:0] filesystem_summary: 65969 529 65440 1% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 700 (time 1769074444.02 total 10.00 last 69.99) - open/close 1442 (time 1769074454.02 total 20.01 last 74.17) - open/close 2287 (time 1769074464.02 total 30.01 last 84.48) - open/close 3098 (time 1769074474.04 total 40.02 last 81.00) - open/close 3907 (time 1769074484.04 total 50.03 last 80.85) - open/close 4713 (time 1769074494.05 total 60.03 last 80.57) - open/close 5555 (time 1769074504.05 total 70.04 last 84.15) - open/close 6319 (time 1769074514.06 total 80.04 last 76.37) - open/close 7120 (time 1769074524.06 total 90.04 last 80.07) - open/close 7943 (time 1769074534.07 total 100.05 last 82.25) - open/close 8746 (time 1769074544.08 total 110.06 last 80.20) - open/close 9529 (time 1769074554.11 total 120.09 last 78.08) - open/close 10000 (time 1769074560.30 total 126.28 last 76.11) - open/close 10786 (time 1769074570.30 total 136.28 last 78.59) - open/close 11703 (time 1769074580.30 total 146.29 last 91.64) - open/close 12469 (time 1769074590.31 total 156.29 last 76.55) - open/close 13124 (time 1769074600.32 total 166.30 last 65.47) - open/close 13935 (time 1769074610.32 total 176.30 last 81.05) - open/close 14613 (time 1769074620.33 total 186.31 last 67.77) - open/close 15258 (time 1769074630.33 total 196.32 last 64.46) - open/close 15952 (time 1769074640.35 total 206.33 last 69.31) - open/close 16715 (time 1769074650.35 total 216.34 last 76.23) - open/close 17410 (time 1769074660.36 total 226.35 last 69.44) - open/close 18067 (time 1769074670.37 total 236.35 last 65.68) - open/close 18910 (time 1769074680.37 total 246.36 last 84.23) - open/close 19634 (time 1769074690.38 total 256.36 last 72.36) - open/close 20000 (time 1769074695.48 total 261.46 last 71.74) - open/close 20765 (time 1769074705.49 total 271.48 last 76.41) - open/close 21481 (time 1769074715.50 total 281.49 last 71.52) - open/close 22270 (time 1769074725.51 total 291.49 last 78.88) - open/close 23041 (time 1769074735.51 total 301.49 last 77.07) - open/close 23773 (time 1769074745.52 total 311.50 last 73.16) - open/close 24466 (time 1769074755.52 total 321.50 last 69.27) - open/close 25217 (time 1769074765.52 total 331.51 last 75.08) - open/close 25947 (time 1769074775.54 total 341.53 last 72.84) - open/close 26717 (time 1769074785.55 total 351.53 last 76.97) - open/close 27352 (time 1769074795.55 total 361.53 last 63.48) - open/close 28174 (time 1769074805.56 total 371.54 last 82.16) - open/close 28953 (time 1769074815.56 total 381.54 last 77.87) - open/close 29714 (time 1769074825.57 total 391.56 last 75.98) - open/close 30000 (time 1769074828.82 total 394.81 last 88.02) - open/close 30829 (time 1769074838.83 total 404.81 last 82.85) - open/close 31694 (time 1769074848.84 total 414.83 last 86.40) - open/close 32604 (time 1769074858.85 total 424.83 last 90.97) - open/close 33471 (time 1769074868.85 total 434.84 last 86.62) - open/close 34250 (time 1769074878.86 total 444.84 last 77.85) - open/close 35019 (time 1769074888.87 total 454.85 last 76.85) - open/close 35802 (time 1769074898.87 total 464.85 last 78.30) - open/close 36567 (time 1769074908.87 total 474.85 last 76.48) - open/close 37337 (time 1769074918.87 total 484.86 last 76.98) - open/close 38171 (time 1769074928.91 total 494.89 last 83.12) - open/close 39018 (time 1769074938.91 total 504.89 last 84.69) - open/close 39820 (time 1769074948.91 total 514.90 last 80.14) - open/close 40000 (time 1769074951.14 total 517.12 last 80.86) - open/close 40673 (time 1769074961.15 total 527.14 last 67.22) - open/close 41370 (time 1769074971.16 total 537.14 last 69.68) - open/close 42129 (time 1769074981.16 total 547.14 last 75.87) - open/close 42836 (time 1769074991.17 total 557.15 last 70.64) - open/close 43498 (time 1769075001.18 total 567.17 last 66.09) - open/close 44224 (time 1769075011.19 total 577.18 last 72.54) - open/close 44930 (time 1769075021.20 total 587.18 last 70.54) - open/close 45634 (time 1769075031.21 total 597.19 last 70.36) - open/close 46268 (time 1769075041.22 total 607.21 last 63.29) - open/close 46957 (time 1769075051.25 total 617.24 last 68.69) - open/close 47636 (time 1769075061.26 total 627.24 last 67.89) - open/close 48348 (time 1769075071.26 total 637.24 last 71.17) - open/close 49093 (time 1769075081.27 total 647.25 last 74.41) - open/close 49862 (time 1769075091.27 total 657.26 last 76.88) - open/close 50000 (time 1769075093.38 total 659.37 last 65.45) - open/close 50536 (time 1769075103.38 total 669.37 last 53.59) - open/close 51085 (time 1769075113.39 total 679.38 last 54.85) - open/close 51929 (time 1769075123.41 total 689.39 last 84.29) - open/close 52617 (time 1769075133.42 total 699.41 last 68.68) - open/close 53296 (time 1769075143.44 total 709.43 last 67.78) - open/close 54084 (time 1769075153.45 total 719.43 last 78.77) - open/close 54837 (time 1769075163.46 total 729.44 last 75.22) - open/close 55592 (time 1769075173.47 total 739.45 last 75.41) - open/close 56344 (time 1769075183.47 total 749.45 last 75.20) - open/close 57029 (time 1769075193.48 total 759.46 last 68.44) - open/close 57862 (time 1769075203.50 total 769.48 last 83.14) - open/close 58604 (time 1769075213.50 total 779.48 last 74.18) - open/close 59201 (time 1769075223.53 total 789.51 last 59.52) - open/close 59887 (time 1769075233.54 total 799.52 last 68.56) - open/close 60602 (time 1769075243.54 total 809.53 last 71.45) - open/close 61290 (time 1769075253.56 total 819.55 last 68.66) - open/close 61892 (time 1769075263.57 total 829.56 last 60.14) - open/close 62598 (time 1769075273.58 total 839.57 last 70.54) - open/close 63317 (time 1769075283.59 total 849.57 last 71.85) - open/close 64121 (time 1769075293.60 total 859.58 last 80.36) total: 64768 open/close in 869.05 seconds: 74.53 ops/second - /unlink 634 (time 1769075318.27 total 10.00 last 63.37) - /unlink 1270 (time 1769075328.29 total 20.03 last 63.45) - /unlink 1845 (time 1769075338.29 total 30.03 last 57.48) - /unlink 2465 (time 1769075348.30 total 40.04 last 61.94) - /unlink 3174 (time 1769075358.31 total 50.05 last 70.83) - /unlink 3823 (time 1769075368.32 total 60.06 last 64.87) - /unlink 4424 (time 1769075378.32 total 70.06 last 60.08) - /unlink 5117 (time 1769075388.33 total 80.06 last 69.26) - /unlink 5816 (time 1769075398.33 total 90.07 last 69.86) - /unlink 6595 (time 1769075408.35 total 100.09 last 77.77) - /unlink 7353 (time 1769075418.35 total 110.09 last 75.78) - /unlink 8005 (time 1769075428.36 total 120.10 last 65.12) - /unlink 8675 (time 1769075438.37 total 130.11 last 66.94) - /unlink 9365 (time 1769075448.37 total 140.11 last 68.99) - /unlink 10000 (time 1769075457.47 total 149.21 last 69.77) - /unlink 10659 (time 1769075467.48 total 159.22 last 65.87) - /unlink 11305 (time 1769075477.50 total 169.24 last 64.45) - /unlink 11905 (time 1769075487.51 total 179.25 last 59.94) - /unlink 12690 (time 1769075497.52 total 189.26 last 78.43) - /unlink 13445 (time 1769075507.53 total 199.27 last 75.43) - /unlink 14204 (time 1769075517.53 total 209.27 last 75.89) - /unlink 14957 (time 1769075527.53 total 219.27 last 75.25) - /unlink 15667 (time 1769075537.54 total 229.28 last 70.97) - /unlink 16405 (time 1769075547.54 total 239.28 last 73.79) - /unlink 17020 (time 1769075557.55 total 249.28 last 61.46) - /unlink 17643 (time 1769075567.55 total 259.29 last 62.25) - /unlink 18299 (time 1769075577.56 total 269.30 last 65.54) - /unlink 18948 (time 1769075587.57 total 279.31 last 64.87) - /unlink 19775 (time 1769075597.57 total 289.31 last 82.66) - /unlink 20000 (time 1769075600.29 total 292.03 last 82.86) - /unlink 20748 (time 1769075610.31 total 302.05 last 74.64) - /unlink 21471 (time 1769075620.34 total 312.08 last 72.10) - /unlink 22131 (time 1769075630.36 total 322.10 last 65.81) - /unlink 22668 (time 1769075640.40 total 332.14 last 53.49) - /unlink 23194 (time 1769075650.41 total 342.15 last 52.56) - /unlink 23711 (time 1769075660.44 total 352.18 last 51.57) - /unlink 24291 (time 1769075670.45 total 362.19 last 57.90) - /unlink 24909 (time 1769075680.46 total 372.20 last 61.79) - /unlink 25477 (time 1769075690.47 total 382.21 last 56.72) - /unlink 26004 (time 1769075700.47 total 392.21 last 52.69) - /unlink 26775 (time 1769075710.49 total 402.23 last 76.98) - /unlink 27505 (time 1769075720.49 total 412.23 last 72.99) - /unlink 28195 (time 1769075730.50 total 422.24 last 68.93) - /unlink 29003 (time 1769075740.52 total 432.26 last 80.64) - /unlink 29706 (time 1769075750.52 total 442.26 last 70.25) - /unlink 30000 (time 1769075755.12 total 446.86 last 63.96) - /unlink 30606 (time 1769075765.13 total 456.87 last 60.57) - /unlink 31084 (time 1769075775.16 total 466.90 last 47.62) - /unlink 31863 (time 1769075785.16 total 476.90 last 77.89) - /unlink 32639 (time 1769075795.17 total 486.91 last 77.57) - /unlink 33258 (time 1769075805.18 total 496.92 last 61.85) - /unlink 33871 (time 1769075815.19 total 506.93 last 61.23) - /unlink 34621 (time 1769075825.19 total 516.93 last 74.99) - /unlink 35355 (time 1769075835.20 total 526.94 last 73.32) - /unlink 36045 (time 1769075845.23 total 536.97 last 68.76) - /unlink 36745 (time 1769075855.24 total 546.98 last 69.93) - /unlink 37468 (time 1769075865.25 total 556.99 last 72.28) - /unlink 38167 (time 1769075875.25 total 566.99 last 69.88) - /unlink 38812 (time 1769075885.27 total 577.01 last 64.36) - /unlink 39362 (time 1769075895.28 total 587.02 last 54.97) - /unlink 40000 (time 1769075905.23 total 596.97 last 64.07) - /unlink 40604 (time 1769075915.25 total 606.98 last 60.33) - /unlink 41305 (time 1769075925.25 total 616.99 last 70.08) - /unlink 42171 (time 1769075935.26 total 627.00 last 86.51) - /unlink 42970 (time 1769075945.26 total 637.00 last 79.88) - /unlink 43816 (time 1769075955.27 total 647.01 last 84.52) - /unlink 44646 (time 1769075965.28 total 657.02 last 82.93) - /unlink 45367 (time 1769075975.29 total 667.03 last 72.03) - /unlink 46157 (time 1769075985.29 total 677.03 last 78.96) - /unlink 46837 (time 1769075995.29 total 687.03 last 67.99) - /unlink 47563 (time 1769076005.30 total 697.04 last 72.56) - /unlink 48170 (time 1769076015.30 total 707.04 last 60.68) - /unlink 48916 (time 1769076025.31 total 717.05 last 74.56) - /unlink 49576 (time 1769076035.33 total 727.07 last 65.89) - /unlink 50000 (time 1769076040.86 total 732.59 last 76.68) - /unlink 50699 (time 1769076050.86 total 742.60 last 69.84) - /unlink 51344 (time 1769076060.87 total 752.61 last 64.48) - /unlink 51976 (time 1769076070.87 total 762.61 last 63.18) - /unlink 52620 (time 1769076080.88 total 772.62 last 64.37) - /unlink 53245 (time 1769076090.88 total 782.62 last 62.48) - /unlink 53904 (time 1769076100.89 total 792.63 last 65.84) - /unlink 54544 (time 1769076110.91 total 802.65 last 63.85) - /unlink 55196 (time 1769076120.92 total 812.66 last 65.14) - /unlink 55940 (time 1769076130.93 total 822.67 last 74.34) - /unlink 56773 (time 1769076140.94 total 832.68 last 83.18) - /unlink 57648 (time 1769076150.95 total 842.69 last 87.45) - /unlink 58433 (time 1769076160.95 total 852.69 last 78.46) - /unlink 59254 (time 1769076170.98 total 862.72 last 81.90) - /unlink 59982 (time 1769076180.99 total 872.73 last 72.74) - /unlink 60537 (time 1769076191.00 total 882.74 last 55.43) - /unlink 61166 (time 1769076201.00 total 892.74 last 62.86) - /unlink 61846 (time 1769076211.01 total 902.75 last 67.97) - /unlink 62567 (time 1769076221.01 total 912.75 last 72.09) - /unlink 63329 (time 1769076231.02 total 922.76 last 76.14) - /unlink 64098 (time 1769076241.03 total 932.77 last 76.83) total: 64768 /unlink in 941.99 seconds: 68.76 ops/second Waiting for MDT destroys to complete oleg343-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 - open/close 552 (time 1769076279.55 total 10.03 last 55.02) - open/close 1072 (time 1769076289.55 total 20.03 last 51.99) - open/close 1826 (time 1769076299.55 total 30.04 last 75.35) - open/close 2418 (time 1769076309.55 total 40.04 last 59.19) - open/close 3048 (time 1769076319.56 total 50.05 last 62.98) - open/close 3788 (time 1769076329.57 total 60.05 last 73.95) - open/close 4462 (time 1769076339.58 total 70.06 last 67.33) - open/close 5013 (time 1769076349.59 total 80.07 last 55.04) - open/close 5540 (time 1769076359.59 total 90.08 last 52.68) - open/close 6184 (time 1769076369.60 total 100.08 last 64.36) - open/close 6844 (time 1769076379.60 total 110.08 last 66.00) - open/close 7517 (time 1769076389.60 total 120.09 last 67.28) - open/close 8154 (time 1769076399.61 total 130.09 last 63.66) - open/close 8889 (time 1769076409.61 total 140.10 last 73.46) - open/close 9411 (time 1769076419.63 total 150.12 last 52.09) - open/close 9863 (time 1769076429.64 total 160.13 last 45.15) - open/close 10000 (time 1769076433.19 total 163.68 last 38.62) - open/close 10546 (time 1769076443.21 total 173.70 last 54.46) - open/close 11196 (time 1769076453.22 total 183.70 last 65.00) - open/close 11792 (time 1769076463.22 total 193.71 last 59.59) - open/close 12423 (time 1769076473.23 total 203.71 last 63.05) - open/close 13123 (time 1769076483.24 total 213.73 last 69.90) - open/close 13692 (time 1769076493.24 total 223.73 last 56.88) - open/close 14467 (time 1769076503.25 total 233.73 last 77.49) - open/close 15186 (time 1769076513.25 total 243.73 last 71.89) - open/close 15728 (time 1769076523.27 total 253.76 last 54.06) - open/close 16398 (time 1769076533.27 total 263.76 last 66.99) - open/close 16979 (time 1769076543.27 total 273.76 last 58.10) - open/close 17614 (time 1769076553.29 total 283.78 last 63.38) - open/close 18171 (time 1769076563.30 total 293.79 last 55.67) - open/close 18949 (time 1769076573.30 total 303.79 last 77.79) - open/close 19742 (time 1769076583.30 total 313.79 last 79.26) - open/close 20000 (time 1769076587.71 total 318.20 last 58.51) - open/close 20706 (time 1769076597.72 total 328.20 last 70.57) - open/close 21480 (time 1769076607.73 total 338.22 last 77.26) - open/close 22260 (time 1769076617.74 total 348.23 last 77.95) - open/close 23045 (time 1769076627.75 total 358.24 last 78.44) - open/close 23775 (time 1769076637.77 total 368.26 last 72.83) - open/close 24392 (time 1769076647.77 total 378.26 last 61.69) - open/close 25015 (time 1769076657.79 total 388.27 last 62.23) - open/close 25704 (time 1769076667.79 total 398.28 last 68.86) - open/close 26153 (time 1769076677.79 total 408.28 last 44.90) - open/close 26765 (time 1769076687.79 total 418.28 last 61.18) - open/close 27452 (time 1769076697.80 total 428.28 last 68.68) - open/close 28046 (time 1769076707.80 total 438.29 last 59.36) - open/close 28865 (time 1769076717.81 total 448.29 last 81.88) - open/close 29553 (time 1769076727.81 total 458.30 last 68.74) - open/close 30000 (time 1769076735.51 total 466.00 last 58.05) - open/close 30678 (time 1769076745.53 total 476.02 last 67.70) - open/close 31449 (time 1769076755.53 total 486.02 last 77.08) - open/close 32195 (time 1769076765.53 total 496.02 last 74.58) - open/close 33034 (time 1769076775.54 total 506.02 last 83.89) - open/close 33869 (time 1769076785.54 total 516.03 last 83.46) - open/close 34753 (time 1769076795.54 total 526.03 last 88.39) - open/close 35610 (time 1769076805.55 total 536.04 last 85.63) - open/close 36229 (time 1769076815.55 total 546.04 last 61.88) - open/close 36781 (time 1769076825.58 total 556.06 last 55.07) - open/close 37372 (time 1769076835.59 total 566.08 last 59.03) - open/close 37945 (time 1769076845.60 total 576.08 last 57.26) - open/close 38648 (time 1769076855.60 total 586.09 last 70.27) - open/close 39280 (time 1769076865.61 total 596.10 last 63.15) - open/close 40000 (time 1769076874.24 total 604.72 last 83.45) - open/close 40729 (time 1769076884.26 total 614.74 last 72.76) - open/close 41412 (time 1769076894.27 total 624.75 last 68.23) - open/close 42093 (time 1769076904.27 total 634.76 last 68.07) - open/close 42642 (time 1769076914.29 total 644.78 last 54.78) - open/close 43295 (time 1769076924.30 total 654.79 last 65.24) - open/close 43815 (time 1769076934.32 total 664.80 last 51.94) - open/close 44548 (time 1769076944.32 total 674.81 last 73.26) - open/close 44955 (time 1769076954.33 total 684.81 last 40.67) - open/close 45369 (time 1769076964.34 total 694.83 last 41.35) - open/close 45835 (time 1769076974.35 total 704.83 last 46.57) - open/close 46466 (time 1769076984.35 total 714.84 last 63.06) - open/close 47111 (time 1769076994.35 total 724.84 last 64.50) - open/close 47748 (time 1769077004.37 total 734.85 last 63.62) - open/close 48369 (time 1769077014.37 total 744.86 last 62.08) - open/close 49158 (time 1769077024.38 total 754.87 last 78.78) - open/close 49830 (time 1769077034.39 total 764.87 last 67.19) - open/close 50000 (time 1769077036.68 total 767.17 last 74.06) - open/close 50806 (time 1769077046.69 total 777.18 last 80.55) - open/close 51551 (time 1769077056.70 total 787.19 last 74.41) - open/close 52225 (time 1769077066.71 total 797.20 last 67.33) - open/close 52971 (time 1769077076.71 total 807.20 last 74.57) - open/close 53470 (time 1769077086.74 total 817.22 last 49.79) - open/close 54130 (time 1769077096.74 total 827.23 last 65.98) - open/close 54802 (time 1769077106.75 total 837.24 last 67.10) - open/close 55482 (time 1769077116.76 total 847.25 last 67.92) - open/close 56374 (time 1769077126.77 total 857.25 last 89.18) - open/close 57048 (time 1769077136.79 total 867.27 last 67.28) - open/close 57572 (time 1769077146.79 total 877.27 last 52.39) - open/close 58203 (time 1769077156.81 total 887.29 last 62.98) - open/close 58783 (time 1769077166.81 total 897.30 last 57.95) - open/close 59526 (time 1769077176.82 total 907.31 last 74.22) - open/close 60000 (time 1769077181.68 total 912.17 last 97.64) - open/close 60897 (time 1769077191.68 total 922.17 last 89.65) - open/close 61735 (time 1769077201.69 total 932.18 last 83.74) - open/close 62300 (time 1769077211.71 total 942.19 last 56.43) - open/close 62991 (time 1769077221.71 total 952.20 last 69.05) - open/close 63885 (time 1769077231.73 total 962.22 last 89.27) total: 64768 open/close in 972.12 seconds: 66.63 ops/second - /unlink 766 (time 1769077256.53 total 10.01 last 76.51) - /unlink 1515 (time 1769077266.54 total 20.03 last 74.77) - /unlink 2247 (time 1769077276.55 total 30.03 last 73.18) - /unlink 3060 (time 1769077286.55 total 40.03 last 81.30) - /unlink 3904 (time 1769077296.56 total 50.04 last 84.29) - /unlink 4692 (time 1769077306.57 total 60.06 last 78.71) - /unlink 5495 (time 1769077316.58 total 70.07 last 80.22) - /unlink 6243 (time 1769077326.59 total 80.07 last 74.74) - /unlink 7014 (time 1769077336.59 total 90.08 last 77.08) - /unlink 7897 (time 1769077346.59 total 100.08 last 88.28) - /unlink 8591 (time 1769077356.60 total 110.08 last 69.37) - /unlink 9130 (time 1769077366.60 total 120.08 last 53.90) - /unlink 9770 (time 1769077376.60 total 130.09 last 63.98) - /unlink 10000 (time 1769077379.50 total 132.99 last 79.24) - /unlink 10829 (time 1769077389.51 total 142.99 last 82.89) - /unlink 11639 (time 1769077399.52 total 153.01 last 80.84) - /unlink 12367 (time 1769077409.53 total 163.01 last 72.77) - /unlink 13077 (time 1769077419.53 total 173.02 last 70.98) - /unlink 13909 (time 1769077429.54 total 183.03 last 83.13) - /unlink 14710 (time 1769077439.55 total 193.04 last 80.00) - /unlink 15506 (time 1769077449.55 total 203.04 last 79.59) - /unlink 16205 (time 1769077459.57 total 213.05 last 69.82) - /unlink 16893 (time 1769077469.57 total 223.06 last 68.74) - /unlink 17642 (time 1769077479.58 total 233.07 last 74.83) - /unlink 18585 (time 1769077489.59 total 243.07 last 94.27) - /unlink 19413 (time 1769077499.59 total 253.08 last 82.78) - /unlink 20000 (time 1769077507.20 total 260.68 last 77.14) - /unlink 20799 (time 1769077517.20 total 270.69 last 79.87) - /unlink 21702 (time 1769077527.21 total 280.69 last 90.28) - /unlink 22594 (time 1769077537.21 total 290.69 last 89.17) - /unlink 23447 (time 1769077547.22 total 300.70 last 85.22) - /unlink 24389 (time 1769077557.22 total 310.71 last 94.14) - /unlink 25308 (time 1769077567.23 total 320.71 last 91.86) - /unlink 26260 (time 1769077577.23 total 330.72 last 95.16) - /unlink 27201 (time 1769077587.23 total 340.72 last 94.10) - /unlink 28117 (time 1769077597.24 total 350.72 last 91.57) - /unlink 28892 (time 1769077607.24 total 360.72 last 77.49) - /unlink 29678 (time 1769077617.24 total 370.73 last 78.57) - /unlink 30000 (time 1769077620.92 total 374.40 last 87.64) - /unlink 30823 (time 1769077630.92 total 384.40 last 82.29) - /unlink 31736 (time 1769077640.92 total 394.41 last 91.25) - /unlink 32540 (time 1769077650.92 total 404.41 last 80.40) - /unlink 33380 (time 1769077660.95 total 414.43 last 83.80) - /unlink 34036 (time 1769077670.97 total 424.45 last 65.47) - /unlink 34815 (time 1769077680.97 total 434.46 last 77.88) - /unlink 35574 (time 1769077690.99 total 444.48 last 75.75) - /unlink 36339 (time 1769077700.99 total 454.48 last 76.50) - /unlink 37078 (time 1769077711.01 total 464.49 last 73.77) - /unlink 37984 (time 1769077721.01 total 474.50 last 90.54) - /unlink 38853 (time 1769077731.02 total 484.50 last 86.88) - /unlink 39579 (time 1769077741.02 total 494.51 last 72.56) - /unlink 40000 (time 1769077747.10 total 500.59 last 69.24) - /unlink 40638 (time 1769077757.12 total 510.61 last 63.68) - /unlink 41345 (time 1769077767.13 total 520.61 last 70.67) - /unlink 42179 (time 1769077777.13 total 530.62 last 83.34) - /unlink 43025 (time 1769077787.14 total 540.62 last 84.57) - /unlink 43886 (time 1769077797.14 total 550.62 last 86.09) - /unlink 44682 (time 1769077807.14 total 560.63 last 79.57) - /unlink 45624 (time 1769077817.15 total 570.63 last 94.17) - /unlink 46611 (time 1769077827.15 total 580.64 last 98.63) - /unlink 47546 (time 1769077837.16 total 590.64 last 93.48) - /unlink 48510 (time 1769077847.16 total 600.64 last 96.37) - /unlink 49561 (time 1769077857.16 total 610.64 last 105.09) - /unlink 50000 (time 1769077861.57 total 615.05 last 99.63) - /unlink 50892 (time 1769077871.57 total 625.06 last 89.12) - /unlink 51631 (time 1769077881.58 total 635.07 last 73.85) - /unlink 52634 (time 1769077891.58 total 645.07 last 100.28) - /unlink 53773 (time 1769077901.59 total 655.07 last 113.85) - /unlink 54927 (time 1769077911.59 total 665.07 last 115.37) - /unlink 55847 (time 1769077921.59 total 675.08 last 91.97) - /unlink 56850 (time 1769077931.59 total 685.08 last 100.28) - /unlink 57853 (time 1769077941.60 total 695.08 last 100.26) - /unlink 58744 (time 1769077951.60 total 705.09 last 89.08) - /unlink 59679 (time 1769077961.61 total 715.09 last 93.42) - /unlink 60000 (time 1769077964.42 total 717.91 last 114.05) - /unlink 61060 (time 1769077974.43 total 727.91 last 105.96) - /unlink 62075 (time 1769077984.44 total 737.93 last 101.33) - /unlink 63065 (time 1769077994.45 total 747.94 last 98.93) - /unlink 64101 (time 1769078004.46 total 757.94 last 103.54) total: 64768 /unlink in 765.72 seconds: 84.58 ops/second Waiting for MDT destroys to complete oleg343-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 - open/close 859 (time 1769078040.65 total 10.01 last 85.83) - open/close 1796 (time 1769078050.66 total 20.01 last 93.63) - open/close 2715 (time 1769078060.66 total 30.02 last 91.89) - open/close 3727 (time 1769078070.66 total 40.02 last 101.18) - open/close 4805 (time 1769078080.67 total 50.02 last 107.77) - open/close 5744 (time 1769078090.67 total 60.03 last 93.83) - open/close 6763 (time 1769078100.68 total 70.03 last 101.83) - open/close 7786 (time 1769078110.69 total 80.04 last 102.23) - open/close 8786 (time 1769078120.69 total 90.04 last 100.00) - open/close 9838 (time 1769078130.69 total 100.04 last 105.17) - open/close 10816 (time 1769078140.70 total 110.05 last 97.74) - open/close 11779 (time 1769078150.70 total 120.06 last 96.24) - open/close 12441 (time 1769078160.71 total 130.06 last 66.16) - open/close 12857 (time 1769078170.73 total 140.09 last 41.51) - open/close 13325 (time 1769078180.73 total 150.09 last 46.79) - open/close 13775 (time 1769078190.76 total 160.11 last 44.89) - open/close 14907 (time 1769078200.76 total 170.12 last 113.14) - open/close 15849 (time 1769078210.76 total 180.12 last 94.18) - open/close 16789 (time 1769078220.77 total 190.13 last 93.92) - open/close 17642 (time 1769078230.77 total 200.13 last 85.29) - open/close 18549 (time 1769078240.78 total 210.13 last 90.68) - open/close 19304 (time 1769078250.80 total 220.15 last 75.34) - open/close 20000 (time 1769078258.86 total 228.21 last 86.34) - open/close 21157 (time 1769078268.87 total 238.22 last 115.61) - open/close 21996 (time 1769078278.87 total 248.22 last 83.87) - open/close 22732 (time 1769078288.88 total 258.23 last 73.55) - open/close 23456 (time 1769078298.89 total 268.24 last 72.32) - open/close 24261 (time 1769078308.89 total 278.25 last 80.45) - open/close 25280 (time 1769078318.89 total 288.25 last 101.88) - open/close 26154 (time 1769078328.91 total 298.26 last 87.30) - open/close 27068 (time 1769078338.91 total 308.27 last 91.33) - open/close 27998 (time 1769078348.92 total 318.27 last 92.94) - open/close 29062 (time 1769078358.93 total 328.28 last 106.29) - open/close 30000 (time 1769078367.58 total 336.93 last 108.44) - open/close 31100 (time 1769078377.58 total 346.94 last 109.99) - open/close 32176 (time 1769078387.58 total 356.94 last 107.60) - open/close 33265 (time 1769078397.58 total 366.94 last 108.89) - open/close 34252 (time 1769078407.59 total 376.94 last 98.65) - open/close 35064 (time 1769078417.60 total 386.96 last 81.07) - open/close 35915 (time 1769078427.61 total 396.96 last 85.08) - open/close 36852 (time 1769078437.61 total 406.96 last 93.67) - open/close 37914 (time 1769078447.61 total 416.97 last 106.15) - open/close 38849 (time 1769078457.61 total 426.97 last 93.50) - open/close 39755 (time 1769078467.61 total 436.97 last 90.60) - open/close 40000 (time 1769078470.38 total 439.73 last 88.60) - open/close 41080 (time 1769078480.38 total 449.74 last 107.97) - open/close 42053 (time 1769078490.40 total 459.76 last 97.11) - open/close 42905 (time 1769078500.41 total 469.77 last 85.12) - open/close 43929 (time 1769078510.41 total 479.77 last 102.37) - open/close 44894 (time 1769078520.42 total 489.78 last 96.42) - open/close 45971 (time 1769078530.43 total 499.78 last 107.64) - open/close 46987 (time 1769078540.43 total 509.78 last 101.59) - open/close 48080 (time 1769078550.44 total 519.79 last 109.20) - open/close 49118 (time 1769078560.44 total 529.79 last 103.80) - open/close 50000 (time 1769078567.89 total 537.25 last 118.29) - open/close 51041 (time 1769078577.89 total 547.25 last 104.09) - open/close 52045 (time 1769078587.90 total 557.25 last 100.36) - open/close 53086 (time 1769078597.91 total 567.26 last 104.00) - open/close 54289 (time 1769078607.91 total 577.27 last 120.26) - open/close 55241 (time 1769078617.92 total 587.28 last 95.12) - open/close 56266 (time 1769078627.92 total 597.28 last 102.46) - open/close 57026 (time 1769078637.94 total 607.29 last 75.89) - open/close 57792 (time 1769078647.94 total 617.30 last 76.58) - open/close 58789 (time 1769078657.94 total 627.30 last 99.66) - open/close 59694 (time 1769078667.95 total 637.30 last 90.47) - open/close 60000 (time 1769078671.41 total 640.76 last 88.49) - open/close 61027 (time 1769078681.41 total 650.76 last 102.70) - open/close 62260 (time 1769078691.41 total 660.76 last 123.29) - open/close 63288 (time 1769078701.41 total 670.76 last 102.77) - open/close 64157 (time 1769078711.41 total 680.77 last 86.90) total: 64768 open/close in 689.17 seconds: 93.98 ops/second - /unlink 808 (time 1769078734.87 total 10.01 last 80.75) - /unlink 1720 (time 1769078744.87 total 20.01 last 91.18) - /unlink 2669 (time 1769078754.87 total 30.01 last 94.89) - /unlink 3695 (time 1769078764.87 total 40.01 last 102.53) - /unlink 4660 (time 1769078774.88 total 50.02 last 96.47) - /unlink 5588 (time 1769078784.88 total 60.02 last 92.80) - /unlink 6543 (time 1769078794.89 total 70.03 last 95.39) - /unlink 7393 (time 1769078804.90 total 80.04 last 84.90) - /unlink 8249 (time 1769078814.91 total 90.05 last 85.54) - /unlink 9221 (time 1769078824.92 total 100.06 last 97.09) - /unlink 10000 (time 1769078832.89 total 108.03 last 97.76) - /unlink 10947 (time 1769078842.90 total 118.04 last 94.62) - /unlink 11808 (time 1769078852.93 total 128.07 last 85.83) - /unlink 12605 (time 1769078862.95 total 138.09 last 79.52) - /unlink 13393 (time 1769078872.97 total 148.11 last 78.65) - /unlink 14139 (time 1769078882.99 total 158.13 last 74.45) - /unlink 14809 (time 1769078892.99 total 168.13 last 66.98) - /unlink 15415 (time 1769078903.00 total 178.14 last 60.59) - /unlink 16280 (time 1769078913.00 total 188.15 last 86.42) - /unlink 17150 (time 1769078923.02 total 198.16 last 86.86) - /unlink 17930 (time 1769078933.03 total 208.17 last 77.97) - /unlink 18742 (time 1769078943.03 total 218.17 last 81.14) - /unlink 19421 (time 1769078953.05 total 228.19 last 67.79) - /unlink 20000 (time 1769078960.85 total 235.99 last 74.23) - /unlink 20799 (time 1769078970.86 total 246.00 last 79.79) - /unlink 21543 (time 1769078980.89 total 256.03 last 74.20) - /unlink 22137 (time 1769078990.90 total 266.04 last 59.32) - /unlink 22934 (time 1769079000.92 total 276.06 last 79.60) - /unlink 23828 (time 1769079010.92 total 286.06 last 89.36) - /unlink 24942 (time 1769079020.93 total 296.07 last 111.33) - /unlink 25887 (time 1769079030.94 total 306.08 last 94.41) - /unlink 26820 (time 1769079040.94 total 316.08 last 93.24) - /unlink 27727 (time 1769079050.95 total 326.09 last 90.61) - /unlink 28521 (time 1769079060.96 total 336.10 last 79.36) - /unlink 29357 (time 1769079070.97 total 346.11 last 83.45) - /unlink 29862 (time 1769079080.98 total 356.12 last 50.47) - /unlink 30000 (time 1769079083.21 total 358.35 last 62.00) - /unlink 30737 (time 1769079093.21 total 368.35 last 73.67) - /unlink 31484 (time 1769079103.22 total 378.36 last 74.63) - /unlink 32198 (time 1769079113.22 total 388.36 last 71.38) - /unlink 32827 (time 1769079123.32 total 398.46 last 62.30) - /unlink 33569 (time 1769079133.33 total 408.47 last 74.16) - /unlink 34258 (time 1769079143.33 total 418.47 last 68.87) - /unlink 35035 (time 1769079153.34 total 428.48 last 77.66) - /unlink 35846 (time 1769079163.34 total 438.48 last 81.06) - /unlink 36883 (time 1769079173.35 total 448.49 last 103.61) - /unlink 37870 (time 1769079183.35 total 458.49 last 98.67) - /unlink 38710 (time 1769079193.36 total 468.50 last 83.94) - /unlink 39717 (time 1769079203.37 total 478.51 last 100.61) - /unlink 40000 (time 1769079206.21 total 481.35 last 99.77) - /unlink 40993 (time 1769079216.21 total 491.35 last 99.23) - /unlink 42008 (time 1769079226.22 total 501.36 last 101.43) - /unlink 42871 (time 1769079236.23 total 511.37 last 86.21) - /unlink 43766 (time 1769079246.23 total 521.37 last 89.48) - /unlink 44765 (time 1769079256.24 total 531.38 last 99.85) - /unlink 45672 (time 1769079266.24 total 541.38 last 90.70) - /unlink 46581 (time 1769079276.24 total 551.38 last 90.88) - /unlink 47577 (time 1769079286.25 total 561.39 last 99.55) - /unlink 48499 (time 1769079296.27 total 571.41 last 91.99) - /unlink 49478 (time 1769079306.28 total 581.42 last 97.85) - /unlink 50000 (time 1769079311.58 total 586.72 last 98.48) - /unlink 50963 (time 1769079321.58 total 596.72 last 96.27) - /unlink 51932 (time 1769079331.58 total 606.72 last 96.89) - /unlink 53105 (time 1769079341.58 total 616.72 last 117.28) - /unlink 54175 (time 1769079351.59 total 626.73 last 106.93) - /unlink 55166 (time 1769079361.59 total 636.73 last 99.07) - /unlink 56213 (time 1769079371.60 total 646.74 last 104.61) - /unlink 57132 (time 1769079381.61 total 656.75 last 91.82) - /unlink 58120 (time 1769079391.61 total 666.76 last 98.74) - /unlink 59079 (time 1769079401.62 total 676.76 last 95.82) - /unlink 60000 (time 1769079410.74 total 685.88 last 101.00) - /unlink 61037 (time 1769079420.74 total 695.89 last 103.67) - /unlink 62084 (time 1769079430.75 total 705.89 last 104.62) - /unlink 63096 (time 1769079440.76 total 715.90 last 101.12) - /unlink 64181 (time 1769079450.77 total 725.91 last 108.43) total: 64768 /unlink in 731.73 seconds: 88.51 ops/second Waiting for MDT destroys to complete oleg343-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 - open/close 1053 (time 1769079480.72 total 10.01 last 105.21) - open/close 2161 (time 1769079490.72 total 20.01 last 110.75) - open/close 3342 (time 1769079500.73 total 30.02 last 118.05) - open/close 4494 (time 1769079510.73 total 40.02 last 115.14) - open/close 5583 (time 1769079520.74 total 50.03 last 108.85) - open/close 6575 (time 1769079530.75 total 60.03 last 99.11) - open/close 7638 (time 1769079540.76 total 70.05 last 106.15) - open/close 8748 (time 1769079550.76 total 80.05 last 110.96) - open/close 9767 (time 1769079560.77 total 90.06 last 101.86) - open/close 10928 (time 1769079570.77 total 100.06 last 116.09) - open/close 12008 (time 1769079580.77 total 110.06 last 107.98) - open/close 13104 (time 1769079590.77 total 120.06 last 109.59) - open/close 14162 (time 1769079600.78 total 130.07 last 105.74) - open/close 15298 (time 1769079610.79 total 140.08 last 113.47) - open/close 16376 (time 1769079620.79 total 150.08 last 107.78) - open/close 17542 (time 1769079630.79 total 160.08 last 116.59) - open/close 18762 (time 1769079640.79 total 170.08 last 122.00) - open/close 19881 (time 1769079650.79 total 180.08 last 111.88) - open/close 21040 (time 1769079660.80 total 190.08 last 115.87) - open/close 22366 (time 1769079670.80 total 200.09 last 132.55) - open/close 23664 (time 1769079680.80 total 210.09 last 129.78) - open/close 24830 (time 1769079690.81 total 220.10 last 116.51) - open/close 26081 (time 1769079700.81 total 230.10 last 125.10) - open/close 27311 (time 1769079710.81 total 240.10 last 122.94) - open/close 28490 (time 1769079720.82 total 250.10 last 117.88) - open/close 29724 (time 1769079730.82 total 260.11 last 123.31) - open/close 30000 (time 1769079733.02 total 262.31 last 125.44) - open/close 31229 (time 1769079743.03 total 272.32 last 122.81) - open/close 32403 (time 1769079753.04 total 282.33 last 117.27) - open/close 33655 (time 1769079763.04 total 292.33 last 125.17) - open/close 34795 (time 1769079773.05 total 302.34 last 113.92) - open/close 36048 (time 1769079783.05 total 312.34 last 125.26) - open/close 37292 (time 1769079793.06 total 322.35 last 124.37) - open/close 38553 (time 1769079803.06 total 332.35 last 126.08) - open/close 39877 (time 1769079813.06 total 342.35 last 132.40) - open/close 41135 (time 1769079823.06 total 352.35 last 125.78) - open/close 42499 (time 1769079833.07 total 362.36 last 136.25) - open/close 43671 (time 1769079843.08 total 372.37 last 117.13) - open/close 44792 (time 1769079853.08 total 382.37 last 112.08) - open/close 45967 (time 1769079863.09 total 392.38 last 117.38) - open/close 47088 (time 1769079873.09 total 402.38 last 112.10) - open/close 48191 (time 1769079883.09 total 412.38 last 110.28) - open/close 49379 (time 1769079893.10 total 422.39 last 118.69) - open/close 50000 (time 1769079898.12 total 427.41 last 123.77) - open/close 51306 (time 1769079908.12 total 437.41 last 130.51) - open/close 52561 (time 1769079918.12 total 447.41 last 125.49) - open/close 53848 (time 1769079928.13 total 457.42 last 128.67) - open/close 55118 (time 1769079938.13 total 467.42 last 126.91) - open/close 56234 (time 1769079948.14 total 477.43 last 111.52) - open/close 57352 (time 1769079958.15 total 487.44 last 111.72) - open/close 58594 (time 1769079968.15 total 497.44 last 124.17) - open/close 59860 (time 1769079978.15 total 507.44 last 126.59) - open/close 61105 (time 1769079988.15 total 517.44 last 124.48) - open/close 62512 (time 1769079998.16 total 527.44 last 140.68) - open/close 63805 (time 1769080008.16 total 537.44 last 129.29) total: 64768 open/close in 544.35 seconds: 118.98 ops/second - /unlink 2403 (time 1769080027.25 total 10.00 last 240.26) - /unlink 4685 (time 1769080037.25 total 20.00 last 228.19) - /unlink 7103 (time 1769080047.25 total 30.00 last 241.76) - /unlink 9635 (time 1769080057.25 total 40.00 last 253.19) - /unlink 12313 (time 1769080067.26 total 50.01 last 267.74) - /unlink 14991 (time 1769080077.26 total 60.01 last 267.73) - /unlink 17932 (time 1769080087.26 total 70.01 last 294.10) - /unlink 20000 (time 1769080094.28 total 77.03 last 294.54) - /unlink 22376 (time 1769080104.29 total 87.04 last 237.47) - /unlink 25012 (time 1769080114.31 total 97.06 last 262.87) - /unlink 27488 (time 1769080124.32 total 107.07 last 247.52) - /unlink 30000 (time 1769080132.35 total 115.10 last 312.67) - /unlink 33631 (time 1769080142.35 total 125.10 last 363.05) - /unlink 37088 (time 1769080152.35 total 135.10 last 345.65) - /unlink 39891 (time 1769080162.35 total 145.10 last 280.27) - /unlink 43052 (time 1769080172.35 total 155.10 last 316.09) - /unlink 46181 (time 1769080182.36 total 165.11 last 312.76) - /unlink 48167 (time 1769080192.36 total 175.11 last 198.58) - /unlink 50000 (time 1769080201.41 total 184.16 last 202.50) - /unlink 51889 (time 1769080211.41 total 194.16 last 188.88) - /unlink 54041 (time 1769080221.41 total 204.16 last 215.16) - /unlink 56270 (time 1769080231.42 total 214.17 last 222.86) - /unlink 58899 (time 1769080241.42 total 224.17 last 262.86) - /unlink 60000 (time 1769080246.17 total 228.92 last 231.59) - /unlink 62218 (time 1769080256.18 total 238.93 last 221.73) - /unlink 64372 (time 1769080266.18 total 248.93 last 215.34) total: 64768 /unlink in 250.57 seconds: 258.49 ops/second Waiting for MDT destroys to complete oleg343-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 - open/close 1709 (time 1769080291.60 total 10.00 last 170.89) - open/close 3049 (time 1769080301.60 total 20.00 last 133.95) - open/close 4794 (time 1769080311.60 total 30.01 last 174.40) - open/close 6505 (time 1769080321.62 total 40.02 last 170.86) - open/close 7896 (time 1769080331.62 total 50.03 last 139.06) - open/close 9203 (time 1769080341.63 total 60.03 last 130.64) - open/close 10000 (time 1769080347.76 total 66.17 last 129.87) - open/close 11407 (time 1769080357.77 total 76.17 last 140.64) - open/close 12868 (time 1769080367.77 total 86.18 last 146.05) - open/close 14531 (time 1769080377.78 total 96.18 last 166.20) - open/close 16123 (time 1769080387.78 total 106.19 last 159.15) - open/close 18165 (time 1769080397.78 total 116.19 last 204.20) - open/close 19963 (time 1769080407.79 total 126.19 last 179.69) - open/close 21466 (time 1769080417.80 total 136.20 last 150.16) - open/close 23011 (time 1769080427.80 total 146.20 last 154.47) - open/close 24478 (time 1769080437.80 total 156.20 last 146.70) - open/close 25994 (time 1769080447.81 total 166.21 last 151.48) - open/close 27529 (time 1769080457.81 total 176.21 last 153.44) - open/close 29395 (time 1769080467.81 total 186.22 last 186.55) - open/close 30000 (time 1769080470.65 total 189.05 last 213.25) - open/close 31675 (time 1769080480.65 total 199.06 last 167.48) - open/close 33341 (time 1769080490.65 total 209.06 last 166.55) - open/close 35070 (time 1769080500.65 total 219.06 last 172.90) - open/close 36970 (time 1769080510.66 total 229.06 last 189.94) - open/close 38995 (time 1769080520.66 total 239.07 last 202.38) - open/close 40000 (time 1769080525.95 total 244.35 last 190.14) - open/close 42100 (time 1769080535.95 total 254.35 last 209.99) - open/close 43833 (time 1769080545.96 total 264.37 last 173.10) - open/close 45411 (time 1769080555.97 total 274.37 last 157.73) - open/close 47262 (time 1769080565.97 total 284.37 last 185.05) - open/close 49238 (time 1769080575.97 total 294.37 last 197.58) - open/close 50000 (time 1769080579.51 total 297.91 last 215.29) - open/close 52259 (time 1769080589.51 total 307.92 last 225.80) - open/close 54730 (time 1769080599.52 total 317.92 last 247.02) - open/close 57455 (time 1769080609.52 total 327.92 last 272.43) - open/close 59558 (time 1769080619.52 total 337.93 last 210.21) - open/close 60000 (time 1769080621.79 total 340.20 last 194.95) - open/close 61685 (time 1769080631.79 total 350.20 last 168.48) - open/close 63475 (time 1769080641.79 total 360.20 last 178.95) total: 64768 open/close in 368.16 seconds: 175.92 ops/second - /unlink 3872 (time 1769080661.68 total 10.00 last 387.18) - /unlink 7322 (time 1769080671.68 total 20.00 last 344.88) - /unlink 10000 (time 1769080680.74 total 29.06 last 295.60) - /unlink 13317 (time 1769080690.74 total 39.06 last 331.68) - /unlink 17308 (time 1769080700.75 total 49.07 last 398.95) - /unlink 20000 (time 1769080708.20 total 56.52 last 361.03) - /unlink 23662 (time 1769080718.20 total 66.52 last 366.18) - /unlink 26901 (time 1769080728.20 total 76.53 last 323.85) - /unlink 30000 (time 1769080736.65 total 84.98 last 366.76) - /unlink 34121 (time 1769080746.65 total 94.98 last 412.06) - /unlink 38068 (time 1769080756.65 total 104.98 last 394.70) - /unlink 40000 (time 1769080764.07 total 112.39 last 260.50) - /unlink 43713 (time 1769080774.07 total 122.40 last 371.16) - /unlink 47585 (time 1769080784.08 total 132.40 last 387.15) - /unlink 50000 (time 1769080791.37 total 139.69 last 331.23) - /unlink 53125 (time 1769080801.37 total 149.69 last 312.42) - /unlink 56529 (time 1769080811.37 total 159.70 last 340.29) - /unlink 60000 (time 1769080820.33 total 168.66 last 387.35) - /unlink 63662 (time 1769080830.33 total 178.66 last 366.16) total: 64768 /unlink in 181.08 seconds: 357.68 ops/second Waiting for MDT destroys to complete oleg343-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg343-client: oleg343-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg343-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg343-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg343-server stop mds service on oleg343-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg343-server stop mds service on oleg343-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg343-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg343-server' oleg343-server: oleg343-server.virtnet: executing unload_modules_local oleg343-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg343-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg343-client: oleg343-client: ssh exited with exit code 2 pdsh@oleg343-client: oleg343-server: ssh exited with exit code 2 pdsh@oleg343-client: oleg343-client: ssh exited with exit code 2 pdsh@oleg343-client: oleg343-server: ssh exited with exit code 2