-----============= acceptance-small: conf-sanity ============----- Thu Apr 30 14:10:30 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg448-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg448-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg448-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg448-server oleg448-server: oleg448-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg448-server: oleg448-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg448-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 14:11:54 (1777572714) start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 991 (time 1777572741.96 total 10.00 last 99.07) - open/close/unlink 2041 (time 1777572751.97 total 20.01 last 104.97) - open/close/unlink 3066 (time 1777572761.97 total 30.01 last 102.45) - open/close/unlink 3867 (time 1777572771.98 total 40.02 last 80.03) - open/close/unlink 4561 (time 1777572781.99 total 50.03 last 69.33) - open/close/unlink 5156 (time 1777572792.00 total 60.03 last 59.48) - open/close/unlink 5811 (time 1777572802.00 total 70.04 last 65.47) - open/close/unlink 6735 (time 1777572812.01 total 80.05 last 92.34) - open/close/unlink 7732 (time 1777572822.01 total 90.05 last 99.62) - open/close/unlink 8678 (time 1777572832.02 total 100.06 last 94.51) - open/close/unlink 9629 (time 1777572842.02 total 110.06 last 95.09) - open/close/unlink 10000 (time 1777572845.92 total 113.96 last 95.22) - open/close/unlink 10999 (time 1777572855.92 total 123.96 last 99.90) - open/close/unlink 12137 (time 1777572865.93 total 133.97 last 113.69) - open/close/unlink 13225 (time 1777572875.94 total 143.97 last 108.76) - open/close/unlink 14365 (time 1777572885.95 total 153.99 last 113.88) - open/close/unlink 15338 (time 1777572895.95 total 163.99 last 97.23) - open/close/unlink 16333 (time 1777572905.96 total 174.00 last 99.43) - open/close/unlink 17319 (time 1777572915.96 total 184.00 last 98.55) - open/close/unlink 18439 (time 1777572925.97 total 194.01 last 111.97) - open/close/unlink 19482 (time 1777572935.97 total 204.01 last 104.27) - open/close/unlink 20000 (time 1777572940.31 total 208.34 last 119.49) - open/close/unlink 21056 (time 1777572950.31 total 218.35 last 105.55) - open/close/unlink 21921 (time 1777572960.31 total 228.35 last 86.47) - open/close/unlink 22802 (time 1777572970.32 total 238.36 last 88.00) - open/close/unlink 23856 (time 1777572980.33 total 248.37 last 105.37) - open/close/unlink 24759 (time 1777572990.34 total 258.38 last 90.21) - open/close/unlink 25697 (time 1777573000.35 total 268.38 last 93.73) - open/close/unlink 26789 (time 1777573010.36 total 278.39 last 109.08) - open/close/unlink 27807 (time 1777573020.36 total 288.40 last 101.76) - open/close/unlink 28622 (time 1777573030.38 total 298.42 last 81.35) - open/close/unlink 29426 (time 1777573040.38 total 308.42 last 80.37) - open/close/unlink 30000 (time 1777573047.86 total 315.90 last 76.79) - open/close/unlink 31048 (time 1777573057.86 total 325.90 last 104.73) - open/close/unlink 32152 (time 1777573067.87 total 335.91 last 110.35) - open/close/unlink 33158 (time 1777573077.87 total 345.91 last 100.54) - open/close/unlink 34147 (time 1777573087.88 total 355.92 last 98.87) - open/close/unlink 35243 (time 1777573097.88 total 365.92 last 109.53) - open/close/unlink 36236 (time 1777573107.89 total 375.93 last 99.25) - open/close/unlink 37250 (time 1777573117.90 total 385.94 last 101.28) - open/close/unlink 37882 (time 1777573127.90 total 395.94 last 63.18) - open/close/unlink 38519 (time 1777573137.92 total 405.96 last 63.58) - open/close/unlink 39093 (time 1777573147.94 total 415.98 last 57.32) - open/close/unlink 39650 (time 1777573157.95 total 425.98 last 55.65) - open/close/unlink 40000 (time 1777573165.60 total 433.63 last 45.76) - open/close/unlink 40676 (time 1777573175.60 total 443.64 last 67.59) - open/close/unlink 41334 (time 1777573185.60 total 453.64 last 65.76) - open/close/unlink 42014 (time 1777573195.62 total 463.66 last 67.87) - open/close/unlink 42749 (time 1777573205.62 total 473.66 last 73.50) - open/close/unlink 43560 (time 1777573215.63 total 483.67 last 81.03) - open/close/unlink 44365 (time 1777573225.64 total 493.67 last 80.47) - open/close/unlink 45238 (time 1777573235.64 total 503.68 last 87.23) - open/close/unlink 46110 (time 1777573245.64 total 513.68 last 87.19) - open/close/unlink 46908 (time 1777573255.65 total 523.69 last 79.75) - open/close/unlink 47655 (time 1777573265.66 total 533.70 last 74.63) - open/close/unlink 48333 (time 1777573275.67 total 543.71 last 67.75) - open/close/unlink 49074 (time 1777573285.67 total 553.71 last 74. - open/close/unlink 1007 (time 1777572742.16 total 10.01 last 100.65) - open/close/unlink 2061 (time 1777572752.16 total 20.01 last 105.39) - open/close/unlink 3082 (time 1777572762.17 total 30.02 last 102.01) - open/close/unlink 3878 (time 1777572772.17 total 40.02 last 79.58) - open/close/unlink 4569 (time 1777572782.19 total 50.03 last 68.99) - open/close/unlink 5169 (time 1777572792.20 total 60.05 last 59.93) - open/close/unlink 5836 (time 1777572802.21 total 70.05 last 66.64) - open/close/unlink 6763 (time 1777572812.22 total 80.06 last 92.64) - open/close/unlink 7758 (time 1777572822.22 total 90.07 last 99.41) - open/close/unlink 8701 (time 1777572832.23 total 100.07 last 94.27) - open/close/unlink 9654 (time 1777572842.23 total 110.08 last 95.25) - open/close/unlink 10000 (time 1777572845.81 total 113.66 last 96.63) - open/close/unlink 10992 (time 1777572855.82 total 123.66 last 99.17) - open/close/unlink 12128 (time 1777572865.83 total 133.67 last 113.49) - open/close/unlink 13217 (time 1777572875.83 total 143.67 last 108.86) - open/close/unlink 14369 (time 1777572885.83 total 153.68 last 115.15) - open/close/unlink 15341 (time 1777572895.83 total 163.68 last 97.20) - open/close/unlink 16336 (time 1777572905.84 total 173.68 last 99.49) - open/close/unlink 17325 (time 1777572915.84 total 183.68 last 98.87) - open/close/unlink 18437 (time 1777572925.85 total 193.69 last 111.13) - open/close/unlink 19477 (time 1777572935.85 total 203.69 last 103.95) - open/close/unlink 20000 (time 1777572940.24 total 208.08 last 119.13) - open/close/unlink 21054 (time 1777572950.24 total 218.09 last 105.36) - open/close/unlink 21921 (time 1777572960.24 total 228.09 last 86.70) - open/close/unlink 22798 (time 1777572970.25 total 238.10 last 87.62) - open/close/unlink 23860 (time 1777572980.25 total 248.10 last 106.19) - open/close/unlink 24776 (time 1777572990.26 total 258.10 last 91.55) - open/close/unlink 25713 (time 1777573000.26 total 268.11 last 93.65) - open/close/unlink 26809 (time 1777573010.27 total 278.11 last 109.58) - open/close/unlink 27819 (time 1777573020.28 total 288.12 last 100.90) - open/close/unlink 28633 (time 1777573030.31 total 298.16 last 81.11) - open/close/unlink 29433 (time 1777573040.32 total 308.17 last 79.92) - open/close/unlink 30000 (time 1777573047.68 total 315.52 last 77.09) - open/close/unlink 31045 (time 1777573057.68 total 325.52 last 104.47) - open/close/unlink 32149 (time 1777573067.68 total 335.53 last 110.35) - open/close/unlink 33154 (time 1777573077.69 total 345.54 last 100.44) - open/close/unlink 34131 (time 1777573087.70 total 355.54 last 97.64) - open/close/unlink 35224 (time 1777573097.70 total 365.55 last 109.25) - open/close/unlink 36222 (time 1777573107.71 total 375.56 last 99.70) - open/close/unlink 37240 (time 1777573117.71 total 385.56 last 101.79) - open/close/unlink 37868 (time 1777573127.73 total 395.58 last 62.67) - open/close/unlink 38505 (time 1777573137.74 total 405.58 last 63.68) - open/close/unlink 39073 (time 1777573147.75 total 415.59 last 56.74) - open/close/unlink 39630 (time 1777573157.75 total 425.60 last 55.68) - open/close/unlink 40000 (time 1777573165.77 total 433.62 last 46.13) - open/close/unlink 40685 (time 1777573175.77 total 443.62 last 68.49) - open/close/unlink 41342 (time 1777573185.78 total 453.62 last 65.69) - open/close/unlink 42026 (time 1777573195.78 total 463.63 last 68.35) - open/close/unlink 42768 (time 1777573205.78 total 473.63 last 74.19) - open/close/unlink 43572 (time 1777573215.80 total 483.64 last 80.30) - open/close/unlink 44380 (time 1777573225.81 total 493.65 last 80.72) - open/close/unlink 45246 (time 1777573235.83 total 503.67 last 86.43) - open/close/unlink 46115 (time 1777573245.83 total 513.68 last 86.86) - open/close/unlink 46905 (time 1777573255.84 total 523.68 last 78.97) - open/close/unlink 47667 (time 1777573265.84 total 533.68 last 76.20) - open/close/unlink 48345 (time 1777573275.84 total 543.69 last 67.74) - open/close/unlink 49089 (time 1777573285.85 total 553.70 last 7 - open/close/unlink 1000 (time 1777572741.97 total 10.00 last 99.99) - open/close/unlink 2062 (time 1777572751.98 total 20.01 last 106.13) - open/close/unlink 3092 (time 1777572761.98 total 30.01 last 102.99) - open/close/unlink 3903 (time 1777572771.99 total 40.01 last 81.06) - open/close/unlink 4596 (time 1777572781.99 total 50.02 last 69.27) - open/close/unlink 5186 (time 1777572792.00 total 60.03 last 58.94) - open/close/unlink 5835 (time 1777572802.00 total 70.03 last 64.89) - open/close/unlink 6760 (time 1777572812.01 total 80.04 last 92.42) - open/close/unlink 7753 (time 1777572822.02 total 90.05 last 99.23) - open/close/unlink 8704 (time 1777572832.03 total 100.06 last 95.00) - open/close/unlink 9657 (time 1777572842.03 total 110.06 last 95.28) - open/close/unlink 10000 (time 1777572845.66 total 113.69 last 94.48) - open/close/unlink 10985 (time 1777572855.67 total 123.70 last 98.42) - open/close/unlink 12130 (time 1777572865.67 total 133.70 last 114.46) - open/close/unlink 13216 (time 1777572875.68 total 143.71 last 108.54) - open/close/unlink 14374 (time 1777572885.69 total 153.71 last 115.69) - open/close/unlink 15356 (time 1777572895.69 total 163.72 last 98.18) - open/close/unlink 16357 (time 1777572905.70 total 173.73 last 99.97) - open/close/unlink 17343 (time 1777572915.71 total 183.73 last 98.56) - open/close/unlink 18455 (time 1777572925.71 total 193.74 last 111.13) - open/close/unlink 19500 (time 1777572935.72 total 203.74 last 104.47) - open/close/unlink 20000 (time 1777572939.99 total 208.02 last 117.01) - open/close/unlink 21055 (time 1777572949.99 total 218.02 last 105.49) - open/close/unlink 21931 (time 1777572960.00 total 228.02 last 87.54) - open/close/unlink 22810 (time 1777572970.01 total 238.03 last 87.82) - open/close/unlink 23857 (time 1777572980.02 total 248.04 last 104.60) - open/close/unlink 24771 (time 1777572990.02 total 258.05 last 91.33) - open/close/unlink 25715 (time 1777573000.02 total 268.05 last 94.39) - open/close/unlink 26808 (time 1777573010.03 total 278.06 last 109.21) - open/close/unlink 27808 (time 1777573020.04 total 288.06 last 99.95) - open/close/unlink 28623 (time 1777573030.04 total 298.07 last 81.45) - open/close/unlink 29423 (time 1777573040.05 total 308.08 last 79.91) - open/close/unlink 30000 (time 1777573047.61 total 315.63 last 76.40) - open/close/unlink 31034 (time 1777573057.61 total 325.63 last 103.40) - open/close/unlink 32144 (time 1777573067.61 total 335.63 last 110.99) - open/close/unlink 33145 (time 1777573077.61 total 345.64 last 100.05) - open/close/unlink 34121 (time 1777573087.61 total 355.64 last 97.58) - open/close/unlink 35211 (time 1777573097.62 total 365.65 last 108.89) - open/close/unlink 36216 (time 1777573107.63 total 375.65 last 100.49) - open/close/unlink 37224 (time 1777573117.63 total 385.66 last 100.75) - open/close/unlink 37864 (time 1777573127.63 total 395.66 last 63.99) - open/close/unlink 38503 (time 1777573137.63 total 405.66 last 63.89) - open/close/unlink 39072 (time 1777573147.65 total 415.68 last 56.79) - open/close/unlink 39625 (time 1777573157.66 total 425.69 last 55.23) - open/close/unlink 40000 (time 1777573165.84 total 433.87 last 45.87) - open/close/unlink 40682 (time 1777573175.84 total 443.87 last 68.18) - open/close/unlink 41345 (time 1777573185.85 total 453.88 last 66.25) - open/close/unlink 42020 (time 1777573195.86 total 463.88 last 67.45) - open/close/unlink 42752 (time 1777573205.86 total 473.89 last 73.16) - open/close/unlink 43560 (time 1777573215.88 total 483.90 last 80.68) - open/close/unlink 44370 (time 1777573225.88 total 493.90 last 80.99) - open/close/unlink 45232 (time 1777573235.88 total 503.91 last 86.17) - open/close/unlink 46108 (time 1777573245.89 total 513.92 last 87.49) - open/close/unlink 46892 (time 1777573255.89 total 523.92 last 78.39) - open/close/unlink 47648 (time 1777573265.91 total 533.93 last 75.52) - open/close/unlink 48318 (time 1777573275.92 total 543.95 last 66.88) - open/close/unlink 49058 (time 1777573285.93 total 553.96 last 73 - open/close/unlink 997 (time 1777572742.14 total 10.00 last 99.68) - open/close/unlink 2044 (time 1777572752.15 total 20.01 last 104.60) - open/close/unlink 3075 (time 1777572762.16 total 30.02 last 103.01) - open/close/unlink 3870 (time 1777572772.17 total 40.03 last 79.40) - open/close/unlink 4552 (time 1777572782.17 total 50.04 last 68.19) - open/close/unlink 5147 (time 1777572792.19 total 60.05 last 59.42) - open/close/unlink 5800 (time 1777572802.19 total 70.05 last 65.30) - open/close/unlink 6729 (time 1777572812.19 total 80.05 last 92.87) - open/close/unlink 7723 (time 1777572822.20 total 90.06 last 99.29) - open/close/unlink 8665 (time 1777572832.20 total 100.07 last 94.19) - open/close/unlink 9618 (time 1777572842.21 total 110.07 last 95.23) - open/close/unlink 10000 (time 1777572846.26 total 114.12 last 94.40) - open/close/unlink 11019 (time 1777572856.26 total 124.12 last 101.84) - open/close/unlink 12153 (time 1777572866.27 total 134.13 last 113.34) - open/close/unlink 13242 (time 1777572876.28 total 144.14 last 108.82) - open/close/unlink 14383 (time 1777572886.29 total 154.15 last 113.96) - open/close/unlink 15356 (time 1777572896.30 total 164.16 last 97.19) - open/close/unlink 16354 (time 1777572906.30 total 174.16 last 99.77) - open/close/unlink 17341 (time 1777572916.31 total 184.17 last 98.60) - open/close/unlink 18456 (time 1777572926.32 total 194.18 last 111.44) - open/close/unlink 19508 (time 1777572936.32 total 204.19 last 105.14) - open/close/unlink 20000 (time 1777572940.48 total 208.34 last 118.32) - open/close/unlink 21043 (time 1777572950.48 total 218.35 last 104.27) - open/close/unlink 21905 (time 1777572960.49 total 228.36 last 86.12) - open/close/unlink 22797 (time 1777572970.50 total 238.36 last 89.13) - open/close/unlink 23851 (time 1777572980.50 total 248.37 last 105.38) - open/close/unlink 24753 (time 1777572990.51 total 258.37 last 90.16) - open/close/unlink 25701 (time 1777573000.51 total 268.37 last 94.80) - open/close/unlink 26790 (time 1777573010.51 total 278.37 last 108.90) - open/close/unlink 27798 (time 1777573020.51 total 288.37 last 100.78) - open/close/unlink 28606 (time 1777573030.52 total 298.38 last 80.71) - open/close/unlink 29411 (time 1777573040.53 total 308.39 last 80.42) - open/close/unlink 30000 (time 1777573048.07 total 315.93 last 78.11) - open/close/unlink 31057 (time 1777573058.08 total 325.94 last 105.62) - open/close/unlink 32175 (time 1777573068.08 total 335.95 last 111.76) - open/close/unlink 33156 (time 1777573078.09 total 345.95 last 98.07) - open/close/unlink 34144 (time 1777573088.09 total 355.95 last 98.78) - open/close/unlink 35236 (time 1777573098.10 total 365.96 last 109.13) - open/close/unlink 36233 (time 1777573108.10 total 375.96 last 99.66) - open/close/unlink 37232 (time 1777573118.12 total 385.98 last 99.76) - open/close/unlink 37865 (time 1777573128.12 total 395.98 last 63.26) - open/close/unlink 38498 (time 1777573138.12 total 405.98 last 63.29) - open/close/unlink 39069 (time 1777573148.12 total 415.98 last 57.10) - open/close/unlink 39629 (time 1777573158.14 total 426.00 last 55.91) - open/close/unlink 40000 (time 1777573166.21 total 434.08 last 45.94) - open/close/unlink 40695 (time 1777573176.22 total 444.08 last 69.49) - open/close/unlink 41346 (time 1777573186.23 total 454.09 last 65.02) - open/close/unlink 42021 (time 1777573196.24 total 464.10 last 67.45) - open/close/unlink 42779 (time 1777573206.24 total 474.10 last 75.79) - open/close/unlink 43585 (time 1777573216.26 total 484.12 last 80.45) - open/close/unlink 44394 (time 1777573226.26 total 494.12 last 80.90) - open/close/unlink 45250 (time 1777573236.27 total 504.13 last 85.49) - open/close/unlink 46140 (time 1777573246.27 total 514.13 last 89.00) - open/close/unlink 46918 (time 1777573256.27 total 524.14 last 77.76) - open/close/unlink 47674 (time 1777573266.29 total 534.15 last 75.50) - open/close/unlink 48350 (time 1777573276.29 total 544.16 last 67.56) - open/close/unlink 49090 (time 1777573286.32 total 554.18 last 73.8 - open/close/unlink 1006 (time 1777572742.17 total 10.00 last 100.60) - open/close/unlink 2054 (time 1777572752.17 total 20.00 last 104.76) - open/close/unlink 3077 (time 1777572762.18 total 30.01 last 102.25) - open/close/unlink 3880 (time 1777572772.19 total 40.02 last 80.23) - open/close/unlink 4574 (time 1777572782.21 total 50.04 last 69.23) - open/close/unlink 5170 (time 1777572792.23 total 60.06 last 59.50) - open/close/unlink 5838 (time 1777572802.23 total 70.06 last 66.78) - open/close/unlink 6766 (time 1777572812.23 total 80.06 last 92.80) - open/close/unlink 7758 (time 1777572822.24 total 90.07 last 99.10) - open/close/unlink 8690 (time 1777572832.25 total 100.08 last 93.09) - open/close/unlink 9643 (time 1777572842.26 total 110.10 last 95.17) - open/close/unlink 10000 (time 1777572845.90 total 113.73 last 98.17) - open/close/unlink 10999 (time 1777572855.90 total 123.74 last 99.87) - open/close/unlink 12126 (time 1777572865.91 total 133.74 last 112.62) - open/close/unlink 13219 (time 1777572875.91 total 143.75 last 109.27) - open/close/unlink 14355 (time 1777572885.92 total 153.75 last 113.57) - open/close/unlink 15324 (time 1777572895.92 total 163.75 last 96.86) - open/close/unlink 16309 (time 1777572905.92 total 173.76 last 98.46) - open/close/unlink 17295 (time 1777572915.93 total 183.76 last 98.53) - open/close/unlink 18422 (time 1777572925.93 total 193.77 last 112.67) - open/close/unlink 19463 (time 1777572935.94 total 203.77 last 104.06) - open/close/unlink 20000 (time 1777572940.41 total 208.24 last 120.01) - open/close/unlink 21054 (time 1777572950.42 total 218.25 last 105.36) - open/close/unlink 21915 (time 1777572960.42 total 228.25 last 86.10) - open/close/unlink 22805 (time 1777572970.42 total 238.25 last 88.95) - open/close/unlink 23856 (time 1777572980.43 total 248.26 last 105.05) - open/close/unlink 24752 (time 1777572990.43 total 258.27 last 89.54) - open/close/unlink 25701 (time 1777573000.43 total 268.27 last 94.90) - open/close/unlink 26794 (time 1777573010.44 total 278.27 last 109.25) - open/close/unlink 27806 (time 1777573020.44 total 288.27 last 101.16) - open/close/unlink 28615 (time 1777573030.45 total 298.28 last 80.85) - open/close/unlink 29417 (time 1777573040.45 total 308.29 last 80.15) - open/close/unlink 30000 (time 1777573047.95 total 315.78 last 77.81) - open/close/unlink 31046 (time 1777573057.95 total 325.78 last 104.58) - open/close/unlink 32153 (time 1777573067.95 total 335.79 last 110.66) - open/close/unlink 33153 (time 1777573077.96 total 345.79 last 99.96) - open/close/unlink 34134 (time 1777573087.96 total 355.79 last 98.07) - open/close/unlink 35236 (time 1777573097.96 total 365.80 last 110.15) - open/close/unlink 36228 (time 1777573107.97 total 375.80 last 99.14) - open/close/unlink 37232 (time 1777573117.97 total 385.81 last 100.38) - open/close/unlink 37860 (time 1777573127.98 total 395.82 last 62.72) - open/close/unlink 38497 (time 1777573137.99 total 405.82 last 63.70) - open/close/unlink 39067 (time 1777573148.00 total 415.83 last 56.92) - open/close/unlink 39618 (time 1777573158.01 total 425.85 last 55.03) - open/close/unlink 40000 (time 1777573166.26 total 434.09 last 46.34) - open/close/unlink 40697 (time 1777573176.26 total 444.09 last 69.66) - open/close/unlink 41357 (time 1777573186.27 total 454.10 last 65.96) - open/close/unlink 42025 (time 1777573196.28 total 464.11 last 66.70) - open/close/unlink 42772 (time 1777573206.29 total 474.12 last 74.65) - open/close/unlink 43574 (time 1777573216.30 total 484.13 last 80.13) - open/close/unlink 44394 (time 1777573226.30 total 494.13 last 81.97) - open/close/unlink 45253 (time 1777573236.31 total 504.14 last 85.83) - open/close/unlink 46139 (time 1777573246.31 total 514.14 last 88.59) - open/close/unlink 46915 (time 1777573256.32 total 524.15 last 77.51) - open/close/unlink 47664 (time 1777573266.34 total 534.18 last 74.75) - open/close/unlink 48336 (time 1777573276.36 total 544.19 last 67.11) - open/close/unlink 49079 (time 1777573286.38 total 554.21 last 744.33) - open/close/unlink 49782 (time 1777573295.86 total 563.71 last 69.24) - open/close/unlink 50000 (time 1777573298.85 total 566.69 last 73.07) - open/close/unlink 50757 (time 1777573308.85 total 576.70 last 75.67) - open/close/unlink 51554 (time 1777573318.86 total 586.70 last 79.65) - open/close/unlink 52350 (time 1777573328.87 total 596.71 last 79.53) - open/close/unlink 53109 (time 1777573338.87 total 606.71 last 75.90) - open/close/unlink 53842 (time 1777573348.87 total 616.72 last 73.24) - open/close/unlink 54567 (time 1777573358.88 total 626.73 last 72.43) - open/close/unlink 55222 (time 1777573368.91 total 636.75 last 65.34) - open/close/unlink 55952 (time 1777573378.91 total 646.76 last 72.97) - open/close/unlink 56825 (time 1777573388.92 total 656.77 last 87.23) - open/close/unlink 57729 (time 1777573398.95 total 666.79 last 90.14) - open/close/unlink 58670 (time 1777573408.95 total 676.80 last 94.07) - open/close/unlink 59683 (time 1777573418.95 total 686.80 last 101.29) - open/close/unlink 60000 (time 1777573422.19 total 690.03 last 98.08) - open/close/unlink 60822 (time 1777573432.19 total 700.04 last 82.17) - open/close/unlink 61613 (time 1777573442.20 total 710.04 last 79.05) - open/close/unlink 62449 (time 1777573452.20 total 720.04 last 83.59) - open/close/unlink 63281 (time 1777573462.20 total 730.04 last 83.18) - open/close/unlink 64118 (time 1777573472.21 total 740.05 last 83.66) total: 64768 open/close/unlink in 747.54 seconds: 86.64 ops/second 10) - open/close/unlink 49768 (time 1777573295.67 total 563.71 last 69.38) - open/close/unlink 50000 (time 1777573298.85 total 566.89 last 72.89) - open/close/unlink 50753 (time 1777573308.86 total 576.90 last 75.25) - open/close/unlink 51545 (time 1777573318.87 total 586.91 last 79.13) - open/close/unlink 52340 (time 1777573328.88 total 596.92 last 79.43) - open/close/unlink 53097 (time 1777573338.88 total 606.92 last 75.68) - open/close/unlink 53830 (time 1777573348.89 total 616.92 last 73.27) - open/close/unlink 54558 (time 1777573358.90 total 626.94 last 72.72) - open/close/unlink 55205 (time 1777573368.92 total 636.96 last 64.55) - open/close/unlink 55927 (time 1777573378.93 total 646.97 last 72.13) - open/close/unlink 56801 (time 1777573388.95 total 656.98 last 87.26) - open/close/unlink 57697 (time 1777573398.96 total 667.00 last 89.47) - open/close/unlink 58628 (time 1777573408.97 total 677.00 last 93.05) - open/close/unlink 59642 (time 1777573418.97 total 687.01 last 101.37) - open/close/unlink 60000 (time 1777573422.72 total 690.76 last 95.50) - open/close/unlink 60806 (time 1777573432.73 total 700.77 last 80.53) - open/close/unlink 61603 (time 1777573442.73 total 710.77 last 79.70) - open/close/unlink 62449 (time 1777573452.73 total 720.77 last 84.55) - open/close/unlink 63278 (time 1777573462.73 total 730.77 last 82.89) - open/close/unlink 64121 (time 1777573472.74 total 740.78 last 84.24) total: 64768 open/close/unlink in 748.86 seconds: 86.49 ops/second 1) - open/close/unlink 49787 (time 1777573296.32 total 564.18 last 69.68) - open/close/unlink 50000 (time 1777573299.16 total 567.02 last 75.06) - open/close/unlink 50750 (time 1777573309.17 total 577.03 last 74.96) - open/close/unlink 51552 (time 1777573319.17 total 587.03 last 80.18) - open/close/unlink 52334 (time 1777573329.17 total 597.03 last 78.19) - open/close/unlink 53098 (time 1777573339.17 total 607.03 last 76.40) - open/close/unlink 53830 (time 1777573349.17 total 617.03 last 73.19) - open/close/unlink 54553 (time 1777573359.18 total 627.04 last 72.26) - open/close/unlink 55196 (time 1777573369.19 total 637.05 last 64.22) - open/close/unlink 55922 (time 1777573379.20 total 647.06 last 72.55) - open/close/unlink 56787 (time 1777573389.22 total 657.08 last 86.33) - open/close/unlink 57702 (time 1777573399.23 total 667.09 last 91.37) - open/close/unlink 58633 (time 1777573409.24 total 677.10 last 93.01) - open/close/unlink 59671 (time 1777573419.24 total 687.10 last 103.79) - open/close/unlink 60000 (time 1777573422.74 total 690.61 last 93.87) - open/close/unlink 60807 (time 1777573432.75 total 700.61 last 80.66) - open/close/unlink 61603 (time 1777573442.75 total 710.62 last 79.57) - open/close/unlink 62435 (time 1777573452.75 total 720.62 last 83.19) - open/close/unlink 63260 (time 1777573462.76 total 730.62 last 82.49) - open/close/unlink 64102 (time 1777573472.76 total 740.62 last 84.16) total: 64768 open/close/unlink in 749.65 seconds: 86.40 ops/second .15) - open/close/unlink 49791 (time 1777573296.38 total 564.21 last 71.18) - open/close/unlink 50000 (time 1777573299.16 total 566.99 last 75.14) - open/close/unlink 50747 (time 1777573309.17 total 577.00 last 74.65) - open/close/unlink 51543 (time 1777573319.18 total 587.01 last 79.54) - open/close/unlink 52336 (time 1777573329.18 total 597.01 last 79.30) - open/close/unlink 53087 (time 1777573339.18 total 607.01 last 75.08) - open/close/unlink 53817 (time 1777573349.19 total 617.02 last 72.91) - open/close/unlink 54537 (time 1777573359.19 total 627.02 last 71.99) - open/close/unlink 55179 (time 1777573369.20 total 637.04 last 64.12) - open/close/unlink 55911 (time 1777573379.20 total 647.04 last 73.19) - open/close/unlink 56780 (time 1777573389.22 total 657.05 last 86.78) - open/close/unlink 57681 (time 1777573399.23 total 667.07 last 89.96) - open/close/unlink 58629 (time 1777573409.24 total 677.07 last 94.77) - open/close/unlink 59657 (time 1777573419.25 total 687.08 last 102.70) - open/close/unlink 60000 (time 1777573422.92 total 690.75 last 93.47) - open/close/unlink 60803 (time 1777573432.93 total 700.76 last 80.21) - open/close/unlink 61594 (time 1777573442.93 total 710.77 last 79.06) - open/close/unlink 62439 (time 1777573452.94 total 720.77 last 84.48) - open/close/unlink 63274 (time 1777573462.94 total 730.77 last 83.46) - open/close/unlink 64116 (time 1777573472.94 total 740.77 last 84.19) total: 64768 open/close/unlink in 749.66 seconds: 86.40 ops/second .93) - open/close/unlink 49755 (time 1777573295.94 total 563.97 last 69.63) - open/close/unlink 50000 (time 1777573299.26 total 567.29 last 73.86) - open/close/unlink 50748 (time 1777573309.27 total 577.29 last 74.77) - open/close/unlink 51544 (time 1777573319.27 total 587.30 last 79.56) - open/close/unlink 52334 (time 1777573329.27 total 597.30 last 78.98) - open/close/unlink 53095 (time 1777573339.28 total 607.30 last 76.07) - open/close/unlink 53842 (time 1777573349.29 total 617.31 last 74.63) - open/close/unlink 54562 (time 1777573359.29 total 627.31 last 71.98) - open/close/unlink 55208 (time 1777573369.30 total 637.33 last 64.53) - open/close/unlink 55937 (time 1777573379.31 total 647.34 last 72.80) - open/close/unlink 56794 (time 1777573389.32 total 657.34 last 85.68) - open/close/unlink 57697 (time 1777573399.32 total 667.34 last 90.28) - open/close/unlink 58637 (time 1777573409.33 total 677.36 last 93.87) - open/close/unlink 59673 (time 1777573419.34 total 687.36 last 103.53) - open/close/unlink 60000 (time 1777573422.89 total 690.92 last 92.10) - open/close/unlink 60805 (time 1777573432.90 total 700.92 last 80.45) - open/close/unlink 61593 (time 1777573442.90 total 710.93 last 78.77) - open/close/unlink 62437 (time 1777573452.90 total 720.93 last 84.40) - open/close/unlink 63269 (time 1777573462.90 total 730.93 last 83.19) - open/close/unlink 64105 (time 1777573472.90 total 740.93 last 83.58) total: 64768 open/close/unlink in 750.25 seconds: 86.33 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg448-server: cannot open 'lustre-ost2': no such pool pdsh@oleg448-client: oleg448-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server unloading modules via unload_modules_local on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing unload_modules_local oleg448-server: modules unloaded. pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 PASS 106 (807s) Stopping clients: oleg448-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: oleg448-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions oleg448-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg448-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg448-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 924 sec =========== 14:25:55 (1777573555) === conf-sanity: start cleanup 14:25:56 (1777573556) === === conf-sanity: finish cleanup 14:25:57 (1777573557) ===