-----============= acceptance-small: conf-sanity ============----- Wed Jul 15 09:59:43 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg448-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682531 > 34553653) for LU-16938, go 81 excepting tests: 32newtarball Stopping clients: oleg448-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg448-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg448-server oleg448-server: oleg448-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg448-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg448-server: oleg448-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg448-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg448-server: oleg448-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg448-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg448-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 10:01:41 (1784124101) start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg448-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 401 49599 1% /mnt/lustre[OST:0] filesystem_summary: 50128 529 49599 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 668 (time 1784124156.99 total 10.00 last 66.77) - open/close/unlink 1366 (time 1784124166.99 total 20.00 last 69.79) - open/close/unlink 1987 (time 1784124177.00 total 30.01 last 62.05) - open/close/unlink 2549 (time 1784124187.00 total 40.01 last 56.19) - open/close/unlink 3049 (time 1784124197.00 total 50.01 last 50.00) - open/close/unlink 3750 (time 1784124207.02 total 60.03 last 69.99) - open/close/unlink 4307 (time 1784124217.03 total 70.05 last 55.60) - open/close/unlink 4891 (time 1784124227.04 total 80.05 last 58.37) - open/close/unlink 5577 (time 1784124237.05 total 90.06 last 68.55) - open/close/unlink 6128 (time 1784124247.05 total 100.07 last 55.05) - open/close/unlink 6962 (time 1784124257.06 total 110.07 last 83.35) - open/close/unlink 7829 (time 1784124267.06 total 120.07 last 86.70) - open/close/unlink 8769 (time 1784124277.08 total 130.09 last 93.85) - open/close/unlink 9856 (time 1784124287.08 total 140.09 last 108.66) - open/close/unlink 11067 (time 1784124297.08 total 150.10 last 121.06) - open/close/unlink 12159 (time 1784124307.08 total 160.10 last 109.18) - open/close/unlink 13403 (time 1784124317.09 total 170.10 last 124.36) - open/close/unlink 14846 (time 1784124327.09 total 180.10 last 144.28) - open/close/unlink 16015 (time 1784124337.10 total 190.11 last 116.76) - open/close/unlink 17234 (time 1784124347.10 total 200.12 last 121.85) - open/close/unlink 18423 (time 1784124357.11 total 210.12 last 118.90) - open/close/unlink 19680 (time 1784124367.11 total 220.12 last 125.65) - open/close/unlink 20000 (time 1784124369.45 total 222.46 last 136.97) - open/close/unlink 21252 (time 1784124379.45 total 232.47 last 125.12) - open/close/unlink 22565 (time 1784124389.46 total 242.48 last 131.14) - open/close/unlink 23906 (time 1784124399.47 total 252.48 last 134.04) - open/close/unlink 25275 (time 1784124409.47 total 262.49 last 136.81) - open/close/unlink 26681 (time 1784124419.48 total 272.50 last 140.51) - open/close/unlink 27987 (time 1784124429.50 total 282.52 last 130.32) - open/close/unlink 29252 (time 1784124439.51 total 292.53 last 126.35) - open/close/unlink 30000 (time 1784124444.85 total 297.86 last 140.29) - open/close/unlink 31265 (time 1784124454.85 total 307.86 last 126.48) - open/close/unlink 32567 (time 1784124464.85 total 317.86 last 130.17) - open/close/unlink 33902 (time 1784124474.85 total 327.87 last 133.45) - open/close/unlink 34323 (time 1784124484.88 total 337.89 last 42.00) - open/close/unlink 34604 (time 1784124494.90 total 347.91 last 28.05) - open/close/unlink 34924 (time 1784124504.91 total 357.93 last 31.95) - open/close/unlink 35182 (time 1784124514.94 total 367.95 last 25.74) - open/close/unlink 35494 (time 1784124524.95 total 377.97 last 31.15) - open/close/unlink 35987 (time 1784124534.99 total 388.01 last 49.11) - open/close/unlink 36370 (time 1784124545.00 total 398.02 last 38.26) - open/close/unlink 36846 (time 1784124555.00 total 408.02 last 47.60) - open/close/unlink 37509 (time 1784124565.01 total 418.02 last 66.26) - open/close/unlink 38198 (time 1784124575.02 total 428.03 last 68.82) - open/close/unlink 38849 (time 1784124585.03 total 438.04 last 65.04) - open/close/unlink 39604 (time 1784124595.05 total 448.06 last 75.35) - open/close/unlink 40000 (time 1784124601.00 total 454.01 last 66.53) - open/close/unlink 40637 (time 1784124611.01 total 464.03 last 63.62) - open/close/unlink 41271 (time 1784124621.02 total 474.03 last 63.36) - open/close/unlink 42001 (time 1784124631.03 total 484.05 last 72.89) - open/close/unlink 42689 (time 1784124641.05 total 494.06 last 68.71) - open/close/unlink 43349 (time 1784124651.05 total 504.06 last 65.99) - open/close/unlink 43967 (time 1784124661.05 total 514.06 last 61.79) - open/close/unlink 44664 (time 1784124671.06 total 524.07 last 69.65) - open/close/unlink 45370 (time 1784124681.06 total 534.07 last 70.58) - open/close/unlink 46260 (time 1784124691.07 total 544.08 last 88.92) - open/close/unlink 47141 (time 1784124701.07 total 554.09 last 88 - open/close/unlink 669 (time 1784124156.92 total 10.00 last 66.87) - open/close/unlink 1377 (time 1784124166.94 total 20.02 last 70.68) - open/close/unlink 1995 (time 1784124176.97 total 30.05 last 61.59) - open/close/unlink 2562 (time 1784124186.98 total 40.06 last 56.65) - open/close/unlink 3060 (time 1784124197.00 total 50.08 last 49.72) - open/close/unlink 3759 (time 1784124207.00 total 60.08 last 69.86) - open/close/unlink 4320 (time 1784124217.01 total 70.09 last 56.07) - open/close/unlink 4904 (time 1784124227.01 total 80.09 last 58.37) - open/close/unlink 5581 (time 1784124237.03 total 90.11 last 67.59) - open/close/unlink 6129 (time 1784124247.03 total 100.12 last 54.78) - open/close/unlink 6964 (time 1784124257.04 total 110.12 last 83.46) - open/close/unlink 7826 (time 1784124267.04 total 120.13 last 86.13) - open/close/unlink 8774 (time 1784124277.05 total 130.14 last 94.73) - open/close/unlink 9862 (time 1784124287.06 total 140.14 last 108.76) - open/close/unlink 11067 (time 1784124297.06 total 150.15 last 120.43) - open/close/unlink 12155 (time 1784124307.07 total 160.15 last 108.71) - open/close/unlink 13406 (time 1784124317.07 total 170.16 last 125.06) - open/close/unlink 14859 (time 1784124327.08 total 180.16 last 145.20) - open/close/unlink 16033 (time 1784124337.09 total 190.17 last 117.30) - open/close/unlink 17243 (time 1784124347.09 total 200.17 last 120.98) - open/close/unlink 18436 (time 1784124357.10 total 210.18 last 119.22) - open/close/unlink 19680 (time 1784124367.10 total 220.18 last 124.37) - open/close/unlink 20000 (time 1784124369.46 total 222.54 last 135.63) - open/close/unlink 21255 (time 1784124379.46 total 232.55 last 125.47) - open/close/unlink 22549 (time 1784124389.46 total 242.55 last 129.39) - open/close/unlink 23880 (time 1784124399.47 total 252.55 last 133.06) - open/close/unlink 25245 (time 1784124409.47 total 262.55 last 136.48) - open/close/unlink 26650 (time 1784124419.47 total 272.56 last 140.39) - open/close/unlink 27949 (time 1784124429.50 total 282.58 last 129.58) - open/close/unlink 29218 (time 1784124439.51 total 292.60 last 126.71) - open/close/unlink 30000 (time 1784124445.19 total 298.28 last 137.69) - open/close/unlink 31271 (time 1784124455.20 total 308.28 last 127.01) - open/close/unlink 32558 (time 1784124465.20 total 318.29 last 128.68) - open/close/unlink 33863 (time 1784124475.21 total 328.29 last 130.39) - open/close/unlink 34275 (time 1784124485.21 total 338.30 last 41.19) - open/close/unlink 34559 (time 1784124495.23 total 348.31 last 28.35) - open/close/unlink 34876 (time 1784124505.24 total 358.33 last 31.66) - open/close/unlink 35139 (time 1784124515.25 total 368.33 last 26.28) - open/close/unlink 35452 (time 1784124525.27 total 378.35 last 31.25) - open/close/unlink 35947 (time 1784124535.29 total 388.37 last 49.39) - open/close/unlink 36333 (time 1784124545.29 total 398.38 last 38.58) - open/close/unlink 36820 (time 1784124555.29 total 408.38 last 48.69) - open/close/unlink 37485 (time 1784124565.31 total 418.39 last 66.42) - open/close/unlink 38171 (time 1784124575.32 total 428.40 last 68.52) - open/close/unlink 38821 (time 1784124585.33 total 438.42 last 64.89) - open/close/unlink 39567 (time 1784124595.35 total 448.43 last 74.51) - open/close/unlink 40000 (time 1784124602.00 total 455.09 last 65.06) - open/close/unlink 40642 (time 1784124612.01 total 465.09 last 64.15) - open/close/unlink 41285 (time 1784124622.02 total 475.11 last 64.20) - open/close/unlink 42039 (time 1784124632.03 total 485.12 last 75.35) - open/close/unlink 42714 (time 1784124642.05 total 495.14 last 67.37) - open/close/unlink 43390 (time 1784124652.06 total 505.14 last 67.57) - open/close/unlink 43991 (time 1784124662.06 total 515.14 last 60.09) - open/close/unlink 44701 (time 1784124672.07 total 525.15 last 70.92) - open/close/unlink 45433 (time 1784124682.07 total 535.16 last 73.17) - open/close/unlink 46315 (time 1784124692.08 total 545.16 last 88.16) - open/close/unlink 47224 (time 1784124702.08 total 555.17 last 90 - open/close/unlink 664 (time 1784124156.78 total 10.01 last 66.34) - open/close/unlink 1364 (time 1784124166.79 total 20.01 last 69.97) - open/close/unlink 1981 (time 1784124176.79 total 30.02 last 61.67) - open/close/unlink 2544 (time 1784124186.80 total 40.03 last 56.25) - open/close/unlink 3037 (time 1784124196.80 total 50.03 last 49.27) - open/close/unlink 3746 (time 1784124206.81 total 60.03 last 70.90) - open/close/unlink 4307 (time 1784124216.81 total 70.03 last 56.08) - open/close/unlink 4889 (time 1784124226.82 total 80.05 last 58.13) - open/close/unlink 5564 (time 1784124236.82 total 90.05 last 67.47) - open/close/unlink 6123 (time 1784124246.83 total 100.06 last 55.87) - open/close/unlink 6955 (time 1784124256.84 total 110.06 last 83.15) - open/close/unlink 7814 (time 1784124266.84 total 120.07 last 85.88) - open/close/unlink 8756 (time 1784124276.84 total 130.07 last 94.16) - open/close/unlink 9828 (time 1784124286.85 total 140.08 last 107.12) - open/close/unlink 11056 (time 1784124296.86 total 150.08 last 122.70) - open/close/unlink 12140 (time 1784124306.86 total 160.09 last 108.35) - open/close/unlink 13388 (time 1784124316.87 total 170.09 last 124.77) - open/close/unlink 14831 (time 1784124326.87 total 180.10 last 144.25) - open/close/unlink 16009 (time 1784124336.87 total 190.10 last 117.73) - open/close/unlink 17214 (time 1784124346.88 total 200.11 last 120.44) - open/close/unlink 18409 (time 1784124356.88 total 210.11 last 119.46) - open/close/unlink 19634 (time 1784124366.89 total 220.11 last 122.46) - open/close/unlink 20000 (time 1784124369.69 total 222.92 last 130.51) - open/close/unlink 21248 (time 1784124379.69 total 232.92 last 124.77) - open/close/unlink 22533 (time 1784124389.69 total 242.92 last 128.48) - open/close/unlink 23877 (time 1784124399.70 total 252.92 last 134.38) - open/close/unlink 25255 (time 1784124409.70 total 262.93 last 137.73) - open/close/unlink 26644 (time 1784124419.71 total 272.93 last 138.84) - open/close/unlink 27941 (time 1784124429.71 total 282.93 last 129.68) - open/close/unlink 29193 (time 1784124439.71 total 292.94 last 125.14) - open/close/unlink 30000 (time 1784124445.48 total 298.71 last 139.79) - open/close/unlink 31272 (time 1784124455.49 total 308.71 last 127.16) - open/close/unlink 32571 (time 1784124465.49 total 318.72 last 129.88) - open/close/unlink 33853 (time 1784124475.50 total 328.73 last 128.01) - open/close/unlink 34263 (time 1784124485.53 total 338.76 last 40.89) - open/close/unlink 34544 (time 1784124495.55 total 348.77 last 28.06) - open/close/unlink 34868 (time 1784124505.57 total 358.80 last 32.32) - open/close/unlink 35126 (time 1784124515.61 total 368.83 last 25.71) - open/close/unlink 35444 (time 1784124525.61 total 378.84 last 31.78) - open/close/unlink 35943 (time 1784124535.62 total 388.84 last 49.88) - open/close/unlink 36333 (time 1784124545.63 total 398.86 last 38.95) - open/close/unlink 36824 (time 1784124555.64 total 408.87 last 49.05) - open/close/unlink 37499 (time 1784124565.65 total 418.87 last 67.46) - open/close/unlink 38181 (time 1784124575.65 total 428.88 last 68.17) - open/close/unlink 38835 (time 1784124585.66 total 438.88 last 65.36) - open/close/unlink 39581 (time 1784124595.67 total 448.89 last 74.54) - open/close/unlink 40000 (time 1784124602.07 total 455.29 last 65.46) - open/close/unlink 40643 (time 1784124612.08 total 465.31 last 64.23) - open/close/unlink 41287 (time 1784124622.09 total 475.32 last 64.31) - open/close/unlink 42044 (time 1784124632.11 total 485.33 last 75.61) - open/close/unlink 42715 (time 1784124642.12 total 495.34 last 67.03) - open/close/unlink 43400 (time 1784124652.13 total 505.35 last 68.41) - open/close/unlink 43998 (time 1784124662.13 total 515.36 last 59.78) - open/close/unlink 44699 (time 1784124672.14 total 525.37 last 70.05) - open/close/unlink 45425 (time 1784124682.14 total 535.37 last 72.59) - open/close/unlink 46307 (time 1784124692.15 total 545.38 last 88.13) - open/close/unlink 47218 (time 1784124702.16 total 555.39 last 91 - open/close/unlink 668 (time 1784124156.77 total 10.00 last 66.79) - open/close/unlink 1374 (time 1784124166.78 total 20.01 last 70.57) - open/close/unlink 1991 (time 1784124176.78 total 30.01 last 61.66) - open/close/unlink 2542 (time 1784124186.80 total 40.02 last 55.04) - open/close/unlink 3035 (time 1784124196.80 total 50.03 last 49.27) - open/close/unlink 3736 (time 1784124206.82 total 60.05 last 69.99) - open/close/unlink 4299 (time 1784124216.84 total 70.06 last 56.21) - open/close/unlink 4879 (time 1784124226.85 total 80.07 last 57.94) - open/close/unlink 5555 (time 1784124236.85 total 90.08 last 67.58) - open/close/unlink 6105 (time 1784124246.85 total 100.08 last 54.97) - open/close/unlink 6941 (time 1784124256.86 total 110.08 last 83.58) - open/close/unlink 7798 (time 1784124266.86 total 120.09 last 85.68) - open/close/unlink 8744 (time 1784124276.88 total 130.10 last 94.43) - open/close/unlink 9809 (time 1784124286.89 total 140.11 last 106.40) - open/close/unlink 11036 (time 1784124296.89 total 150.12 last 122.66) - open/close/unlink 12102 (time 1784124306.89 total 160.12 last 106.59) - open/close/unlink 13357 (time 1784124316.89 total 170.12 last 125.45) - open/close/unlink 14788 (time 1784124326.90 total 180.12 last 143.07) - open/close/unlink 15968 (time 1784124336.90 total 190.12 last 117.99) - open/close/unlink 17165 (time 1784124346.90 total 200.13 last 119.64) - open/close/unlink 18355 (time 1784124356.90 total 210.13 last 118.97) - open/close/unlink 19578 (time 1784124366.91 total 220.13 last 122.28) - open/close/unlink 20000 (time 1784124370.14 total 223.37 last 130.53) - open/close/unlink 21282 (time 1784124380.15 total 233.38 last 128.05) - open/close/unlink 22550 (time 1784124390.16 total 243.39 last 126.69) - open/close/unlink 23905 (time 1784124400.16 total 253.39 last 135.45) - open/close/unlink 25284 (time 1784124410.16 total 263.39 last 137.88) - open/close/unlink 26666 (time 1784124420.16 total 273.39 last 138.20) - open/close/unlink 27979 (time 1784124430.17 total 283.39 last 131.26) - open/close/unlink 29243 (time 1784124440.17 total 293.40 last 126.38) - open/close/unlink 30000 (time 1784124445.66 total 298.89 last 137.81) - open/close/unlink 31253 (time 1784124455.67 total 308.89 last 125.24) - open/close/unlink 32536 (time 1784124465.67 total 318.90 last 128.22) - open/close/unlink 33808 (time 1784124475.68 total 328.91 last 127.07) - open/close/unlink 34211 (time 1784124485.69 total 338.92 last 40.27) - open/close/unlink 34493 (time 1784124495.70 total 348.93 last 28.16) - open/close/unlink 34804 (time 1784124505.72 total 358.95 last 31.05) - open/close/unlink 35072 (time 1784124515.76 total 368.98 last 26.70) - open/close/unlink 35398 (time 1784124525.81 total 379.03 last 32.44) - open/close/unlink 35893 (time 1784124535.81 total 389.03 last 49.50) - open/close/unlink 36282 (time 1784124545.83 total 399.06 last 38.80) - open/close/unlink 36773 (time 1784124555.84 total 409.06 last 49.08) - open/close/unlink 37450 (time 1784124565.84 total 419.07 last 67.65) - open/close/unlink 38134 (time 1784124575.85 total 429.07 last 68.38) - open/close/unlink 38793 (time 1784124585.85 total 439.08 last 65.88) - open/close/unlink 39534 (time 1784124595.85 total 449.08 last 74.06) - open/close/unlink 40000 (time 1784124603.15 total 456.38 last 63.83) - open/close/unlink 40644 (time 1784124613.16 total 466.39 last 64.35) - open/close/unlink 41300 (time 1784124623.17 total 476.39 last 65.57) - open/close/unlink 42063 (time 1784124633.18 total 486.40 last 76.23) - open/close/unlink 42713 (time 1784124643.21 total 496.44 last 64.78) - open/close/unlink 43406 (time 1784124653.24 total 506.47 last 69.09) - open/close/unlink 44009 (time 1784124663.24 total 516.47 last 60.29) - open/close/unlink 44726 (time 1784124673.24 total 526.47 last 71.70) - open/close/unlink 45489 (time 1784124683.25 total 536.48 last 76.25) - open/close/unlink 46349 (time 1784124693.26 total 546.49 last 85.89) - open/close/unlink 47268 (time 1784124703.27 total 556.50 last 91 - open/close/unlink 655 (time 1784124156.91 total 10.03 last 65.31) - open/close/unlink 1355 (time 1784124166.91 total 20.03 last 69.97) - open/close/unlink 1973 (time 1784124176.92 total 30.04 last 61.72) - open/close/unlink 2533 (time 1784124186.94 total 40.06 last 55.92) - open/close/unlink 3021 (time 1784124196.95 total 50.07 last 48.77) - open/close/unlink 3714 (time 1784124206.96 total 60.08 last 69.18) - open/close/unlink 4273 (time 1784124216.96 total 70.08 last 55.90) - open/close/unlink 4854 (time 1784124226.97 total 80.09 last 58.07) - open/close/unlink 5533 (time 1784124236.97 total 90.09 last 67.88) - open/close/unlink 6088 (time 1784124246.98 total 100.10 last 55.47) - open/close/unlink 6918 (time 1784124256.98 total 110.10 last 82.96) - open/close/unlink 7785 (time 1784124266.99 total 120.11 last 86.65) - open/close/unlink 8722 (time 1784124277.00 total 130.12 last 93.57) - open/close/unlink 9808 (time 1784124287.01 total 140.13 last 108.54) - open/close/unlink 11021 (time 1784124297.01 total 150.13 last 121.22) - open/close/unlink 12110 (time 1784124307.01 total 160.14 last 108.89) - open/close/unlink 13352 (time 1784124317.02 total 170.14 last 124.17) - open/close/unlink 14796 (time 1784124327.03 total 180.15 last 144.21) - open/close/unlink 15967 (time 1784124337.03 total 190.15 last 117.07) - open/close/unlink 17164 (time 1784124347.04 total 200.16 last 119.61) - open/close/unlink 18344 (time 1784124357.04 total 210.16 last 117.97) - open/close/unlink 19597 (time 1784124367.05 total 220.17 last 125.25) - open/close/unlink 20000 (time 1784124370.24 total 223.36 last 126.25) - open/close/unlink 21270 (time 1784124380.24 total 233.36 last 126.99) - open/close/unlink 22544 (time 1784124390.25 total 243.37 last 127.29) - open/close/unlink 23905 (time 1784124400.25 total 253.37 last 136.05) - open/close/unlink 25274 (time 1784124410.26 total 263.38 last 136.76) - open/close/unlink 26661 (time 1784124420.27 total 273.39 last 138.66) - open/close/unlink 27961 (time 1784124430.27 total 283.39 last 129.99) - open/close/unlink 29225 (time 1784124440.27 total 293.39 last 126.37) - open/close/unlink 30000 (time 1784124445.85 total 298.98 last 138.75) - open/close/unlink 31247 (time 1784124455.86 total 308.98 last 124.68) - open/close/unlink 32555 (time 1784124465.86 total 318.98 last 130.71) - open/close/unlink 33811 (time 1784124475.88 total 329.00 last 125.39) - open/close/unlink 34201 (time 1784124485.90 total 339.02 last 38.94) - open/close/unlink 34478 (time 1784124495.92 total 349.05 last 27.62) - open/close/unlink 34788 (time 1784124505.94 total 359.06 last 30.95) - open/close/unlink 35056 (time 1784124515.97 total 369.09 last 26.71) - open/close/unlink 35386 (time 1784124526.00 total 379.12 last 32.92) - open/close/unlink 35882 (time 1784124536.00 total 389.12 last 49.58) - open/close/unlink 36274 (time 1784124546.04 total 399.16 last 39.04) - open/close/unlink 36772 (time 1784124556.06 total 409.18 last 49.69) - open/close/unlink 37454 (time 1784124566.07 total 419.19 last 68.17) - open/close/unlink 38142 (time 1784124576.07 total 429.19 last 68.79) - open/close/unlink 38793 (time 1784124586.08 total 439.20 last 65.00) - open/close/unlink 39547 (time 1784124596.10 total 449.22 last 75.28) - open/close/unlink 40000 (time 1784124603.28 total 456.40 last 63.12) - open/close/unlink 40646 (time 1784124613.28 total 466.40 last 64.57) - open/close/unlink 41308 (time 1784124623.29 total 476.41 last 66.16) - open/close/unlink 42074 (time 1784124633.29 total 486.41 last 76.57) - open/close/unlink 42723 (time 1784124643.30 total 496.42 last 64.87) - open/close/unlink 43408 (time 1784124653.31 total 506.43 last 68.40) - open/close/unlink 44008 (time 1784124663.32 total 516.45 last 59.91) - open/close/unlink 44723 (time 1784124673.33 total 526.45 last 71.47) - open/close/unlink 45491 (time 1784124683.34 total 536.46 last 76.73) - open/close/unlink 46350 (time 1784124693.35 total 546.47 last 85.80) - open/close/unlink 47270 (time 1784124703.36 total 556.48 last 91.84) - open/close/unlink 48163 (time 1784124712.10 total 565.18 last 93.78) - open/close/unlink 49212 (time 1784124722.10 total 575.19 last 104.85) - open/close/unlink 50000 (time 1784124731.37 total 584.46 last 84.98) - open/close/unlink 50666 (time 1784124741.43 total 594.51 last 66.23) - open/close/unlink 50892 (time 1784124751.51 total 604.59 last 22.43) - open/close/unlink 51083 (time 1784124761.53 total 614.61 last 19.06) - open/close/unlink 51276 (time 1784124771.55 total 624.63 last 19.26) - open/close/unlink 51514 (time 1784124781.57 total 634.66 last 23.74) - open/close/unlink 51749 (time 1784124791.58 total 644.66 last 23.49) - open/close/unlink 52043 (time 1784124801.62 total 654.70 last 29.29) - open/close/unlink 52480 (time 1784124811.64 total 664.72 last 43.62) - open/close/unlink 52931 (time 1784124821.64 total 674.72 last 45.10) - open/close/unlink 53476 (time 1784124831.64 total 684.73 last 54.46) - open/close/unlink 54211 (time 1784124841.65 total 694.74 last 73.45) - open/close/unlink 54880 (time 1784124851.66 total 704.74 last 66.86) - open/close/unlink 55497 (time 1784124861.67 total 714.75 last 61.65) - open/close/unlink 56118 (time 1784124871.67 total 724.75 last 62.08) - open/close/unlink 56874 (time 1784124881.69 total 734.77 last 75.45) - open/close/unlink 57525 (time 1784124891.69 total 744.78 last 65.07) - open/close/unlink 58136 (time 1784124901.70 total 754.79 last 61.03) - open/close/unlink 58902 (time 1784124911.71 total 764.79 last 76.58) - open/close/unlink 59484 (time 1784124921.72 total 774.81 last 58.11) - open/close/unlink 60000 (time 1784124929.64 total 782.73 last 65.15) - open/close/unlink 60590 (time 1784124939.65 total 792.73 last 58.96) - open/close/unlink 61180 (time 1784124949.67 total 802.75 last 58.90) - open/close/unlink 61728 (time 1784124959.68 total 812.76 last 54.74) - open/close/unlink 62191 (time 1784124969.69 total 822.77 last 46.26) - open/close/unlink 62650 (time 1784124979.69 total 832.78 last 45.88) - open/close/unlink 63114 (time 1784124989.70 total 842.78 last 46.37) - open/close/unlink 63700 (time 1784124999.72 total 852.80 last 58.51) - open/close/unlink 64295 (time 1784125009.72 total 862.80 last 59.48) total: 64768 open/close/unlink in 871.09 seconds: 74.35 ops/second .04) - open/close/unlink 48090 (time 1784124711.08 total 564.09 last 94.86) - open/close/unlink 49128 (time 1784124721.09 total 574.10 last 103.70) - open/close/unlink 49978 (time 1784124731.09 total 584.10 last 84.99) - open/close/unlink 50666 (time 1784124741.12 total 594.13 last 68.62) - open/close/unlink 50896 (time 1784124751.18 total 604.19 last 22.87) - open/close/unlink 51089 (time 1784124761.18 total 614.19 last 19.29) - open/close/unlink 51273 (time 1784124771.23 total 624.24 last 18.32) - open/close/unlink 51515 (time 1784124781.24 total 634.25 last 24.17) - open/close/unlink 51753 (time 1784124791.30 total 644.31 last 23.66) - open/close/unlink 52045 (time 1784124801.31 total 654.32 last 29.16) - open/close/unlink 52472 (time 1784124811.32 total 664.33 last 42.67) - open/close/unlink 52921 (time 1784124821.33 total 674.34 last 44.85) - open/close/unlink 53460 (time 1784124831.33 total 684.35 last 53.86) - open/close/unlink 54185 (time 1784124841.34 total 694.36 last 72.44) - open/close/unlink 54849 (time 1784124851.35 total 704.36 last 66.35) - open/close/unlink 55478 (time 1784124861.37 total 714.38 last 62.78) - open/close/unlink 56097 (time 1784124871.37 total 724.39 last 61.88) - open/close/unlink 56864 (time 1784124881.37 total 734.39 last 76.70) - open/close/unlink 57524 (time 1784124891.39 total 744.40 last 65.88) - open/close/unlink 58127 (time 1784124901.40 total 754.41 last 60.24) - open/close/unlink 58885 (time 1784124911.42 total 764.43 last 75.67) - open/close/unlink 59471 (time 1784124921.42 total 774.43 last 58.59) - open/close/unlink 60000 (time 1784124929.65 total 782.66 last 64.27) - open/close/unlink 60584 (time 1784124939.66 total 792.67 last 58.36) - open/close/unlink 61169 (time 1784124949.66 total 802.67 last 58.49) - open/close/unlink 61711 (time 1784124959.66 total 812.67 last 54.20) - open/close/unlink 62174 (time 1784124969.67 total 822.68 last 46.24) - open/close/unlink 62636 (time 1784124979.68 total 832.69 last 46.16) - open/close/unlink 63103 (time 1784124989.68 total 842.70 last 46.68) - open/close/unlink 63682 (time 1784124999.70 total 852.71 last 57.82) - open/close/unlink 64273 (time 1784125009.72 total 862.73 last 58.97) total: 64768 open/close/unlink in 872.05 seconds: 74.27 ops/second .01) - open/close/unlink 48149 (time 1784124712.16 total 565.39 last 93.08) - open/close/unlink 49198 (time 1784124722.17 total 575.40 last 104.79) - open/close/unlink 50000 (time 1784124731.62 total 584.84 last 84.90) - open/close/unlink 50652 (time 1784124741.78 total 595.01 last 64.16) - open/close/unlink 50879 (time 1784124751.83 total 605.05 last 22.59) - open/close/unlink 51066 (time 1784124761.91 total 615.14 last 18.55) - open/close/unlink 51272 (time 1784124771.92 total 625.15 last 20.57) - open/close/unlink 51501 (time 1784124781.94 total 635.16 last 22.87) - open/close/unlink 51741 (time 1784124791.95 total 645.17 last 23.97) - open/close/unlink 52033 (time 1784124801.96 total 655.19 last 29.16) - open/close/unlink 52476 (time 1784124811.98 total 665.20 last 44.24) - open/close/unlink 52926 (time 1784124822.00 total 675.22 last 44.91) - open/close/unlink 53471 (time 1784124832.01 total 685.23 last 54.45) - open/close/unlink 54222 (time 1784124842.01 total 695.24 last 75.06) - open/close/unlink 54873 (time 1784124852.02 total 705.24 last 65.08) - open/close/unlink 55493 (time 1784124862.02 total 715.25 last 61.96) - open/close/unlink 56119 (time 1784124872.04 total 725.27 last 62.49) - open/close/unlink 56874 (time 1784124882.04 total 735.27 last 75.46) - open/close/unlink 57515 (time 1784124892.07 total 745.29 last 63.94) - open/close/unlink 58129 (time 1784124902.08 total 755.31 last 61.33) - open/close/unlink 58902 (time 1784124912.08 total 765.31 last 77.28) - open/close/unlink 59474 (time 1784124922.09 total 775.31 last 57.18) - open/close/unlink 60000 (time 1784124930.29 total 783.51 last 64.12) - open/close/unlink 60576 (time 1784124940.30 total 793.52 last 57.55) - open/close/unlink 61169 (time 1784124950.31 total 803.53 last 59.23) - open/close/unlink 61709 (time 1784124960.33 total 813.56 last 53.87) - open/close/unlink 62175 (time 1784124970.34 total 823.57 last 46.55) - open/close/unlink 62630 (time 1784124980.34 total 833.57 last 45.50) - open/close/unlink 63107 (time 1784124990.35 total 843.58 last 47.67) - open/close/unlink 63698 (time 1784125000.35 total 853.58 last 59.09) - open/close/unlink 64275 (time 1784125010.36 total 863.59 last 57.65) - open/close/unlink 64766 (time 1784125020.38 total 873.60 last 49.02) total: 64768 open/close/unlink in 873.67 seconds: 74.13 ops/second .90) - open/close/unlink 48205 (time 1784124713.36 total 566.48 last 93.49) - open/close/unlink 49211 (time 1784124723.37 total 576.49 last 100.55) - open/close/unlink 50000 (time 1784124732.42 total 585.54 last 87.10) - open/close/unlink 50604 (time 1784124742.43 total 595.55 last 60.38) - open/close/unlink 50820 (time 1784124752.46 total 605.58 last 21.52) - open/close/unlink 51016 (time 1784124762.47 total 615.59 last 19.59) - open/close/unlink 51225 (time 1784124772.49 total 625.61 last 20.86) - open/close/unlink 51455 (time 1784124782.50 total 635.62 last 22.98) - open/close/unlink 51680 (time 1784124792.55 total 645.67 last 22.38) - open/close/unlink 51981 (time 1784124802.56 total 655.68 last 30.07) - open/close/unlink 52435 (time 1784124812.58 total 665.70 last 45.34) - open/close/unlink 52886 (time 1784124822.58 total 675.70 last 45.10) - open/close/unlink 53442 (time 1784124832.58 total 685.71 last 55.56) - open/close/unlink 54196 (time 1784124842.59 total 695.71 last 75.39) - open/close/unlink 54847 (time 1784124852.60 total 705.72 last 65.02) - open/close/unlink 55463 (time 1784124862.61 total 715.73 last 61.53) - open/close/unlink 56090 (time 1784124872.62 total 725.74 last 62.66) - open/close/unlink 56849 (time 1784124882.62 total 735.74 last 75.88) - open/close/unlink 57483 (time 1784124892.63 total 745.75 last 63.33) - open/close/unlink 58115 (time 1784124902.64 total 755.76 last 63.15) - open/close/unlink 58879 (time 1784124912.64 total 765.76 last 76.35) - open/close/unlink 59447 (time 1784124922.65 total 775.77 last 56.77) - open/close/unlink 60000 (time 1784124931.29 total 784.42 last 63.96) - open/close/unlink 60588 (time 1784124941.30 total 794.42 last 58.75) - open/close/unlink 61181 (time 1784124951.31 total 804.43 last 59.28) - open/close/unlink 61689 (time 1784124961.31 total 814.43 last 50.76) - open/close/unlink 62168 (time 1784124971.33 total 824.45 last 47.84) - open/close/unlink 62621 (time 1784124981.33 total 834.45 last 45.30) - open/close/unlink 63115 (time 1784124991.34 total 844.46 last 49.34) - open/close/unlink 63709 (time 1784125001.35 total 854.48 last 59.31) - open/close/unlink 64280 (time 1784125011.38 total 864.50 last 56.96) - open/close/unlink 64737 (time 1784125021.39 total 874.51 last 45.65) total: 64768 open/close/unlink in 875.47 seconds: 73.98 ops/second .84) - open/close/unlink 48205 (time 1784124713.28 total 566.51 last 93.57) - open/close/unlink 49218 (time 1784124723.30 total 576.52 last 101.16) - open/close/unlink 50000 (time 1784124732.38 total 585.61 last 86.08) - open/close/unlink 50602 (time 1784124742.41 total 595.64 last 60.04) - open/close/unlink 50818 (time 1784124752.47 total 605.70 last 21.46) - open/close/unlink 51016 (time 1784124762.48 total 615.70 last 19.80) - open/close/unlink 51219 (time 1784124772.51 total 625.74 last 20.22) - open/close/unlink 51452 (time 1784124782.55 total 635.77 last 23.23) - open/close/unlink 51676 (time 1784124792.56 total 645.79 last 22.37) - open/close/unlink 51975 (time 1784124802.56 total 655.79 last 29.90) - open/close/unlink 52431 (time 1784124812.58 total 665.81 last 45.50) - open/close/unlink 52878 (time 1784124822.61 total 675.84 last 44.59) - open/close/unlink 53439 (time 1784124832.61 total 685.84 last 56.06) - open/close/unlink 54188 (time 1784124842.62 total 695.85 last 74.85) - open/close/unlink 54842 (time 1784124852.63 total 705.86 last 65.32) - open/close/unlink 55457 (time 1784124862.64 total 715.87 last 61.45) - open/close/unlink 56086 (time 1784124872.66 total 725.88 last 62.81) - open/close/unlink 56839 (time 1784124882.66 total 735.89 last 75.27) - open/close/unlink 57467 (time 1784124892.66 total 745.89 last 62.78) - open/close/unlink 58099 (time 1784124902.67 total 755.90 last 63.13) - open/close/unlink 58864 (time 1784124912.69 total 765.92 last 76.39) - open/close/unlink 59432 (time 1784124922.69 total 775.92 last 56.79) - open/close/unlink 60000 (time 1784124931.66 total 784.89 last 63.30) - open/close/unlink 60576 (time 1784124941.67 total 794.90 last 57.55) - open/close/unlink 61175 (time 1784124951.68 total 804.90 last 59.89) - open/close/unlink 61678 (time 1784124961.68 total 814.90 last 50.30) - open/close/unlink 62155 (time 1784124971.69 total 824.91 last 47.65) - open/close/unlink 62604 (time 1784124981.70 total 834.93 last 44.83) - open/close/unlink 63088 (time 1784124991.71 total 844.94 last 48.35) - open/close/unlink 63684 (time 1784125001.72 total 854.94 last 59.57) - open/close/unlink 64266 (time 1784125011.72 total 864.94 last 58.20) - open/close/unlink 64718 (time 1784125021.75 total 874.97 last 45.06) total: 64768 open/close/unlink in 876.60 seconds: 73.89 ops/second Waiting for MDT destroys to complete oleg448-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg448-server unloading modules via unload_modules_local on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing unload_modules_local oleg448-server: modules unloaded. pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 PASS 106 (977s) Stopping clients: oleg448-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: oleg448-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions oleg448-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg448-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg448-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1137 sec ========== 10:18:40 (1784125120) === conf-sanity: start cleanup 10:18:41 (1784125121) === === conf-sanity: finish cleanup 10:18:43 (1784125123) ===