== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 02:32:57 (1727764377) Stopping clients: oleg160-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg160-client.virtnet /mnt/lustre2 (opts:-f) oleg160-server: oleg160-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory loading modules on: 'oleg160-server' oleg160-server: oleg160-server.virtnet: executing load_modules_local oleg160-server: Loading modules from /home/green/git/lustre-release/lustre oleg160-server: detected 4 online CPUs by sysfs oleg160-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg160-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg160-server: oleg160-server.virtnet: executing set_default_debug -1 all pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg160-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg160-server: oleg160-server.virtnet: executing set_default_debug -1 all pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg160-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg160-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg160-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg160-server: oleg160-server.virtnet: executing set_default_debug -1 all pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg160-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg160-client.virtnet: -o user_xattr,flock 192.168.201.160@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 368 32528 2% /mnt/lustre[OST:0] filesystem_summary: 33057 529 32528 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 1119 (time 1727764449.97 total 10.00 last 111.87) - open/close 2323 (time 1727764459.97 total 20.01 last 120.36) - open/close 3517 (time 1727764469.98 total 30.01 last 119.30) - open/close 4660 (time 1727764479.98 total 40.02 last 114.27) - open/close 5901 (time 1727764489.98 total 50.02 last 124.08) - open/close 7163 (time 1727764499.98 total 60.02 last 126.17) - open/close 8273 (time 1727764509.99 total 70.03 last 110.96) - open/close 9571 (time 1727764519.99 total 80.03 last 129.71) - open/close 10000 (time 1727764522.91 total 82.95 last 147.05) - open/close 11143 (time 1727764532.92 total 92.96 last 114.23) - open/close 12297 (time 1727764542.92 total 102.96 last 115.34) - open/close 13473 (time 1727764552.93 total 112.97 last 117.54) - open/close 14547 (time 1727764562.93 total 122.97 last 107.37) - open/close 15669 (time 1727764572.94 total 132.98 last 112.09) - open/close 16728 (time 1727764582.94 total 142.98 last 105.85) - open/close 17845 (time 1727764592.94 total 152.98 last 111.70) - open/close 18943 (time 1727764602.95 total 162.99 last 109.71) - open/close 20000 (time 1727764612.70 total 172.74 last 108.39) - open/close 21142 (time 1727764622.71 total 182.75 last 114.14) - open/close 22284 (time 1727764632.71 total 192.75 last 114.18) - open/close 23370 (time 1727764642.71 total 202.75 last 108.59) - open/close 24479 (time 1727764652.71 total 212.75 last 110.89) - open/close 25638 (time 1727764662.72 total 222.76 last 115.79) - open/close 26798 (time 1727764672.72 total 232.76 last 116.00) - open/close 27934 (time 1727764682.73 total 242.77 last 113.47) - open/close 29108 (time 1727764692.74 total 252.78 last 117.34) - open/close 30000 (time 1727764700.53 total 260.56 last 114.54) - open/close 31132 (time 1727764710.54 total 270.57 last 113.09) - open/close 32208 (time 1727764720.55 total 280.58 last 107.49) open(/mnt/lustre/d106.conf-sanity/f-32560) error: No space left on device total: 32560 open/close in 283.93 seconds: 114.68 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32835 47157 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33090 33090 0 100% /mnt/lustre - /unlink 1972 (time 1727764736.18 total 10.00 last 197.18) - /unlink 3984 (time 1727764746.18 total 20.00 last 201.19) - /unlink 6026 (time 1727764756.18 total 30.00 last 204.16) - /unlink 7975 (time 1727764766.19 total 40.01 last 194.80) - /unlink 10000 (time 1727764775.67 total 49.49 last 213.56) - /unlink 11828 (time 1727764785.67 total 59.49 last 182.76) - /unlink 13900 (time 1727764795.67 total 69.49 last 207.18) - /unlink 16013 (time 1727764805.67 total 79.49 last 211.29) - /unlink 18179 (time 1727764815.67 total 89.50 last 216.58) - /unlink 20000 (time 1727764825.27 total 99.10 last 189.68) - /unlink 22133 (time 1727764835.28 total 109.10 last 213.25) - /unlink 24179 (time 1727764845.28 total 119.10 last 204.51) - /unlink 26141 (time 1727764855.28 total 129.11 last 196.12) - /unlink 28129 (time 1727764865.29 total 139.11 last 198.74) - /unlink 30000 (time 1727764873.80 total 147.63 last 219.70) - /unlink 32041 (time 1727764883.80 total 157.63 last 204.09) unlink(/mnt/lustre/d106.conf-sanity/f-32560) error: No such file or directory total: 32560 /unlink in 160.22 seconds: 203.21 ops/second Waiting for MDT destroys to complete oleg160-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg160-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 - open/close 1160 (time 1727764905.86 total 10.00 last 115.96) - open/close 2287 (time 1727764915.87 total 20.01 last 112.58) - open/close 3341 (time 1727764925.89 total 30.03 last 105.28) - open/close 4452 (time 1727764935.89 total 40.03 last 111.09) - open/close 5578 (time 1727764945.89 total 50.03 last 112.58) - open/close 6689 (time 1727764955.89 total 60.03 last 111.07) - open/close 7816 (time 1727764965.89 total 70.03 last 112.68) - open/close 9081 (time 1727764975.90 total 80.03 last 126.49) - open/close 10000 (time 1727764983.36 total 87.50 last 123.15) - open/close 11144 (time 1727764993.37 total 97.50 last 114.31) - open/close 12280 (time 1727765003.37 total 107.51 last 113.59) - open/close 13394 (time 1727765013.37 total 117.51 last 111.39) - open/close 14537 (time 1727765023.37 total 127.51 last 114.22) - open/close 15683 (time 1727765033.39 total 137.53 last 114.46) - open/close 16935 (time 1727765043.39 total 147.53 last 125.19) - open/close 18015 (time 1727765053.40 total 157.54 last 107.85) - open/close 19137 (time 1727765063.41 total 167.55 last 112.08) - open/close 20000 (time 1727765070.89 total 175.03 last 115.43) - open/close 21127 (time 1727765080.89 total 185.03 last 112.65) - open/close 22212 (time 1727765090.90 total 195.04 last 108.45) - open/close 23259 (time 1727765100.91 total 205.04 last 104.60) - open/close 24350 (time 1727765110.91 total 215.05 last 109.03) - open/close 25481 (time 1727765120.92 total 225.06 last 113.04) - open/close 26660 (time 1727765130.92 total 235.06 last 117.88) - open/close 27751 (time 1727765140.92 total 245.06 last 109.05) - open/close 28996 (time 1727765150.92 total 255.06 last 124.50) - open/close 30000 (time 1727765159.14 total 263.28 last 122.13) - open/close 31140 (time 1727765169.15 total 273.29 last 113.96) - open/close 32298 (time 1727765179.15 total 283.29 last 115.76) open(/mnt/lustre/d106.conf-sanity/f-32560) error: No space left on device total: 32560 open/close in 285.51 seconds: 114.04 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32835 47157 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33090 33090 0 100% /mnt/lustre - /unlink 2279 (time 1727765193.17 total 10.00 last 227.90) - /unlink 4365 (time 1727765203.17 total 20.00 last 208.57) - /unlink 6169 (time 1727765213.17 total 30.00 last 180.36) - /unlink 8048 (time 1727765223.18 total 40.01 last 187.77) - /unlink 9879 (time 1727765233.18 total 50.01 last 183.07) - /unlink 11853 (time 1727765243.19 total 60.02 last 197.34) - /unlink 13838 (time 1727765253.19 total 70.02 last 198.48) - /unlink 15799 (time 1727765263.19 total 80.02 last 196.05) - /unlink 17674 (time 1727765273.19 total 90.02 last 187.44) - /unlink 19577 (time 1727765283.21 total 100.03 last 190.05) - /unlink 20000 (time 1727765285.38 total 102.21 last 194.66) - /unlink 22050 (time 1727765295.38 total 112.21 last 205.00) - /unlink 23958 (time 1727765305.38 total 122.21 last 190.76) - /unlink 25887 (time 1727765315.38 total 132.21 last 192.85) - /unlink 27993 (time 1727765325.39 total 142.22 last 210.52) - /unlink 30000 (time 1727765332.88 total 149.71 last 267.78) - /unlink 32425 (time 1727765342.89 total 159.72 last 242.38) unlink(/mnt/lustre/d106.conf-sanity/f-32560) error: No such file or directory total: 32560 /unlink in 160.42 seconds: 202.97 ops/second Waiting for MDT destroys to complete oleg160-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 oleg160-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 - open/close 1189 (time 1727765363.88 total 10.01 last 118.81) - open/close 2490 (time 1727765373.89 total 20.01 last 130.03) - open/close 3808 (time 1727765383.89 total 30.02 last 131.75) - open/close 5263 (time 1727765393.90 total 40.02 last 145.40) - open/close 7004 (time 1727765403.90 total 50.03 last 174.05) - open/close 8367 (time 1727765413.90 total 60.03 last 136.28) - open/close 9627 (time 1727765423.91 total 70.03 last 125.93) - open/close 10000 (time 1727765426.55 total 72.68 last 141.14) - open/close 11328 (time 1727765436.56 total 82.68 last 132.72) - open/close 12530 (time 1727765446.56 total 92.68 last 120.18) - open/close 13550 (time 1727765456.57 total 102.69 last 101.93) - open/close 14599 (time 1727765466.57 total 112.69 last 104.89) - open/close 15810 (time 1727765476.58 total 122.70 last 120.97) - open/close 16834 (time 1727765486.59 total 132.71 last 102.34) - open/close 17849 (time 1727765496.59 total 142.71 last 101.48) - open/close 18833 (time 1727765506.59 total 152.71 last 98.36) - open/close 19932 (time 1727765516.59 total 162.72 last 109.88) - open/close 21001 (time 1727765526.60 total 172.72 last 106.83) - open/close 22008 (time 1727765536.60 total 182.73 last 100.66) - open/close 23089 (time 1727765546.60 total 192.73 last 108.09) - open/close 24299 (time 1727765556.61 total 202.74 last 120.91) - open/close 25334 (time 1727765566.62 total 212.74 last 103.44) - open/close 26273 (time 1727765576.62 total 222.74 last 93.89) - open/close 27280 (time 1727765586.62 total 232.74 last 100.70) - open/close 28363 (time 1727765596.62 total 242.75 last 108.24) - open/close 29477 (time 1727765606.63 total 252.75 last 111.35) - open/close 30000 (time 1727765611.02 total 257.14 last 119.25) - open/close 31055 (time 1727765621.02 total 267.15 last 105.41) - open/close 32061 (time 1727765631.03 total 277.15 last 100.57) open(/mnt/lustre/d106.conf-sanity/f-32560) error: No space left on device total: 32560 open/close in 281.82 seconds: 115.53 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32835 47157 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33090 33090 0 100% /mnt/lustre - /unlink 1824 (time 1727765647.73 total 10.00 last 182.39) - /unlink 3528 (time 1727765657.73 total 20.00 last 170.36) - /unlink 5375 (time 1727765667.74 total 30.00 last 184.67) - /unlink 7249 (time 1727765677.74 total 40.01 last 187.39) - /unlink 9365 (time 1727765687.74 total 50.01 last 211.55) - /unlink 10000 (time 1727765691.59 total 53.86 last 164.98) - /unlink 11702 (time 1727765701.59 total 63.86 last 170.10) - /unlink 13599 (time 1727765711.59 total 73.86 last 189.68) - /unlink 15554 (time 1727765721.60 total 83.86 last 195.47) - /unlink 17594 (time 1727765731.60 total 93.87 last 203.92) - /unlink 19434 (time 1727765741.60 total 103.87 last 183.96) - /unlink 20000 (time 1727765744.82 total 107.09 last 175.62) - /unlink 21809 (time 1727765754.83 total 117.10 last 180.80) - /unlink 23543 (time 1727765764.83 total 127.10 last 173.36) - /unlink 25294 (time 1727765774.84 total 137.11 last 174.98) - /unlink 26940 (time 1727765784.84 total 147.11 last 164.51) - /unlink 28705 (time 1727765794.85 total 157.12 last 176.39) - /unlink 30000 (time 1727765802.30 total 164.57 last 173.89) - /unlink 31787 (time 1727765812.30 total 174.57 last 178.69) unlink(/mnt/lustre/d106.conf-sanity/f-32560) error: No such file or directory total: 32560 /unlink in 178.38 seconds: 182.54 ops/second Waiting for MDT destroys to complete oleg160-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg160-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 - open/close 956 (time 1727765840.50 total 10.00 last 95.58) - open/close 1976 (time 1727765850.51 total 20.01 last 101.93) - open/close 3057 (time 1727765860.52 total 30.02 last 108.01) - open/close 4193 (time 1727765870.52 total 40.02 last 113.55) - open/close 5298 (time 1727765880.53 total 50.03 last 110.42) - open/close 6296 (time 1727765890.54 total 60.04 last 99.74) - open/close 7286 (time 1727765900.54 total 70.04 last 98.94) - open/close 8451 (time 1727765910.54 total 80.04 last 116.49) - open/close 9518 (time 1727765920.55 total 90.05 last 106.63) - open/close 10000 (time 1727765925.25 total 94.75 last 102.44) - open/close 11062 (time 1727765935.26 total 104.76 last 106.15) - open/close 12056 (time 1727765945.26 total 114.76 last 99.34) - open/close 13242 (time 1727765955.27 total 124.77 last 118.57) - open/close 14273 (time 1727765965.27 total 134.77 last 103.08) - open/close 15265 (time 1727765975.27 total 144.77 last 99.15) - open/close 16288 (time 1727765985.28 total 154.78 last 102.24) - open/close 17375 (time 1727765995.29 total 164.79 last 108.64) - open/close 18486 (time 1727766005.29 total 174.79 last 111.02) - open/close 19483 (time 1727766015.29 total 184.79 last 99.70) - open/close 20000 (time 1727766020.79 total 190.29 last 94.11) - open/close 21055 (time 1727766030.79 total 200.29 last 105.43) - open/close 22192 (time 1727766040.80 total 210.30 last 113.66) - open/close 23226 (time 1727766050.80 total 220.30 last 103.33) - open/close 24272 (time 1727766060.81 total 230.31 last 104.56) - open/close 25380 (time 1727766070.81 total 240.31 last 110.80) - open/close 26440 (time 1727766080.81 total 250.31 last 105.94) - open/close 27797 (time 1727766090.82 total 260.32 last 135.65) - open/close 28916 (time 1727766100.82 total 270.32 last 111.86) - open/close 30000 (time 1727766110.44 total 279.94 last 112.74) - open/close 31162 (time 1727766120.44 total 289.94 last 116.17) - open/close 32464 (time 1727766130.45 total 299.95 last 130.09) open(/mnt/lustre/d106.conf-sanity/f-32560) error: No space left on device total: 32560 open/close in 300.66 seconds: 108.29 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32835 47157 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33090 33090 0 100% /mnt/lustre - /unlink 1951 (time 1727766143.05 total 10.00 last 195.09) - /unlink 3849 (time 1727766153.05 total 20.01 last 189.71) - /unlink 5944 (time 1727766163.05 total 30.01 last 209.46) - /unlink 8096 (time 1727766173.06 total 40.01 last 215.10) - /unlink 10000 (time 1727766182.81 total 49.76 last 195.26) - /unlink 11652 (time 1727766192.81 total 59.76 last 165.18) - /unlink 13509 (time 1727766202.81 total 69.77 last 185.65) - /unlink 15484 (time 1727766212.81 total 79.77 last 197.48) - /unlink 17453 (time 1727766222.82 total 89.77 last 196.80) - /unlink 19359 (time 1727766232.82 total 99.78 last 190.52) - /unlink 20000 (time 1727766236.27 total 103.22 last 185.95) - /unlink 21585 (time 1727766246.28 total 113.23 last 158.40) - /unlink 23337 (time 1727766256.28 total 123.23 last 175.18) - /unlink 25200 (time 1727766266.28 total 133.23 last 186.29) - /unlink 26990 (time 1727766276.28 total 143.24 last 178.93) - /unlink 28844 (time 1727766286.28 total 153.24 last 185.40) - /unlink 30000 (time 1727766293.05 total 160.00 last 170.83) - /unlink 31598 (time 1727766303.06 total 170.01 last 159.69) unlink(/mnt/lustre/d106.conf-sanity/f-32560) error: No such file or directory total: 32560 /unlink in 176.38 seconds: 184.61 ops/second Waiting for MDT destroys to complete oleg160-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 oleg160-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 - open/close 1039 (time 1727766331.89 total 10.00 last 103.89) - open/close 2075 (time 1727766341.90 total 20.01 last 103.50) - open/close 3025 (time 1727766351.91 total 30.02 last 94.96) - open/close 3964 (time 1727766361.91 total 40.02 last 93.89) - open/close 4833 (time 1727766371.91 total 50.02 last 86.87) - open/close 5689 (time 1727766381.91 total 60.02 last 85.57) - open/close 6449 (time 1727766391.92 total 70.03 last 75.98) - open/close 7522 (time 1727766401.92 total 80.03 last 107.22) - open/close 8463 (time 1727766411.93 total 90.04 last 94.07) - open/close 9403 (time 1727766421.93 total 100.04 last 93.93) - open/close 10000 (time 1727766428.19 total 106.30 last 95.46) - open/close 10904 (time 1727766438.19 total 116.30 last 90.40) - open/close 11941 (time 1727766448.19 total 126.30 last 103.67) - open/close 13029 (time 1727766458.21 total 136.32 last 108.63) - open/close 14018 (time 1727766468.21 total 146.32 last 98.90) - open/close 14922 (time 1727766478.22 total 156.33 last 90.30) - open/close 15816 (time 1727766488.22 total 166.33 last 89.35) - open/close 16687 (time 1727766498.23 total 176.34 last 87.03) - open/close 17762 (time 1727766508.23 total 186.34 last 107.48) - open/close 18745 (time 1727766518.24 total 196.35 last 98.22) - open/close 19598 (time 1727766528.25 total 206.36 last 85.26) - open/close 20000 (time 1727766532.62 total 210.73 last 92.00) - open/close 20894 (time 1727766542.62 total 220.73 last 89.35) - open/close 21825 (time 1727766552.63 total 230.74 last 93.05) - open/close 22766 (time 1727766562.63 total 240.74 last 94.06) - open/close 23809 (time 1727766572.64 total 250.75 last 104.18) - open/close 24764 (time 1727766582.66 total 260.77 last 95.33) - open/close 25717 (time 1727766592.67 total 270.78 last 95.26) - open/close 26678 (time 1727766602.67 total 280.78 last 96.08) - open/close 27651 (time 1727766612.67 total 290.78 last 97.30) - open/close 28719 (time 1727766622.67 total 300.78 last 106.75) - open/close 29683 (time 1727766632.67 total 310.78 last 96.40) - open/close 30000 (time 1727766636.21 total 314.32 last 89.65) - open/close 30935 (time 1727766646.22 total 324.33 last 93.38) - open/close 31904 (time 1727766656.22 total 334.33 last 96.89) open(/mnt/lustre/d106.conf-sanity/f-32560) error: No space left on device total: 32560 open/close in 340.92 seconds: 95.51 ops/second UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 32835 47157 42% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 32896 32896 0 100% /mnt/lustre[OST:0] filesystem_summary: 33090 33090 0 100% /mnt/lustre - /unlink 1717 (time 1727766675.45 total 10.01 last 171.61) - /unlink 3430 (time 1727766685.45 total 20.01 last 171.26) - /unlink 4969 (time 1727766695.46 total 30.01 last 153.85) - /unlink 6604 (time 1727766705.46 total 40.02 last 163.42) - /unlink 8341 (time 1727766715.47 total 50.02 last 173.61) - /unlink 10000 (time 1727766724.11 total 58.66 last 192.01) - /unlink 11782 (time 1727766734.11 total 68.66 last 178.16) - /unlink 13372 (time 1727766744.11 total 78.67 last 158.96) - /unlink 15171 (time 1727766754.11 total 88.67 last 179.86) - /unlink 17165 (time 1727766764.12 total 98.67 last 199.31) - /unlink 18793 (time 1727766774.12 total 108.68 last 162.71) - /unlink 20000 (time 1727766781.38 total 115.94 last 166.21) - /unlink 21697 (time 1727766791.39 total 125.94 last 169.62) - /unlink 23560 (time 1727766801.39 total 135.95 last 186.21) - /unlink 25401 (time 1727766811.40 total 145.95 last 184.08) - /unlink 27104 (time 1727766821.40 total 155.96 last 170.15) - /unlink 28753 (time 1727766831.41 total 165.96 last 164.83) - /unlink 30000 (time 1727766839.01 total 173.57 last 164.00) - /unlink 31743 (time 1727766849.01 total 183.57 last 174.28) unlink(/mnt/lustre/d106.conf-sanity/f-32560) error: No such file or directory total: 32560 /unlink in 187.81 seconds: 173.37 ops/second Waiting for MDT destroys to complete oleg160-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 oleg160-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg160-client: oleg160-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg160-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg160-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg160-server stop mds service on oleg160-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg160-server stop mds service on oleg160-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg160-server unloading modules on: 'oleg160-server' oleg160-server: oleg160-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg160-client: oleg160-client: ssh exited with exit code 2 pdsh@oleg160-client: oleg160-server: ssh exited with exit code 2 pdsh@oleg160-client: oleg160-client: ssh exited with exit code 2 pdsh@oleg160-client: oleg160-server: ssh exited with exit code 2