-----============= acceptance-small: conf-sanity ============----- Mon May 4 11:55:11 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg337-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg337-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg337-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg337-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg337-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg337-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg337-server oleg337-server: oleg337-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg337-server' oleg337-server: oleg337-server.virtnet: executing load_modules_local oleg337-server: Loading modules from /home/green/git/lustre-release/lustre oleg337-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg337-server: detected 4 online CPUs by sysfs oleg337-server: MODOPTS_LIBCFS= oleg337-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg337-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg337-server: oleg337-server.virtnet: executing set_default_debug -1 all pdsh@oleg337-client: oleg337-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg337-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg337-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg337-server: oleg337-server.virtnet: executing set_default_debug -1 all pdsh@oleg337-client: oleg337-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg337-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg337-server: oleg337-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg337-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg337-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg337-server stop mds service on oleg337-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg337-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 11:57:04 (1777910224) start mds service on oleg337-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg337-server: oleg337-server.virtnet: executing set_default_debug -1 all pdsh@oleg337-client: oleg337-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg337-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg337-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg337-server: oleg337-server.virtnet: executing set_default_debug -1 all pdsh@oleg337-client: oleg337-server: ssh exited with exit code 1 Started lustre-OST0000 oleg337-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg337-client.virtnet: -o user_xattr,flock 192.168.203.137@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 92553 329 92224 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 12328 424 11904 4% /mnt/lustre[OST:0] filesystem_summary: 12233 329 11904 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 524 (time 1777910261.45 total 10.01 last 52.33) - open/close/unlink 1096 (time 1777910271.47 total 20.03 last 57.09) - open/close/unlink 1630 (time 1777910281.49 total 30.05 last 53.31) - open/close/unlink 2110 (time 1777910291.49 total 40.06 last 47.98) - open/close/unlink 2548 (time 1777910301.50 total 50.06 last 43.76) - open/close/unlink 2931 (time 1777910311.51 total 60.07 last 38.28) - open/close/unlink 3308 (time 1777910321.53 total 70.09 last 37.63) - open/close/unlink 3657 (time 1777910331.53 total 80.10 last 34.87) - open/close/unlink 4049 (time 1777910341.54 total 90.10 last 39.17) - open/close/unlink 4435 (time 1777910351.56 total 100.13 last 38.51) - open/close/unlink 4806 (time 1777910361.57 total 110.14 last 37.06) - open/close/unlink 5255 (time 1777910371.58 total 120.14 last 44.88) - open/close/unlink 5685 (time 1777910381.60 total 130.16 last 42.93) - open/close/unlink 6129 (time 1777910391.60 total 140.16 last 44.37) - open/close/unlink 6530 (time 1777910401.62 total 150.18 last 40.04) - open/close/unlink 6915 (time 1777910411.63 total 160.19 last 38.44) - open/close/unlink 7351 (time 1777910421.65 total 170.21 last 43.53) - open/close/unlink 7778 (time 1777910431.67 total 180.23 last 42.63) - open/close/unlink 8243 (time 1777910441.68 total 190.24 last 46.42) - open/close/unlink 8666 (time 1777910451.69 total 200.25 last 42.27) - open/close/unlink 9240 (time 1777910461.71 total 210.28 last 57.25) - open/close/unlink 9799 (time 1777910471.73 total 220.29 last 55.83) - open/close/unlink 10000 (time 1777910474.64 total 223.21 last 68.89) - open/close/unlink 10625 (time 1777910484.66 total 233.22 last 62.42) - open/close/unlink 11401 (time 1777910494.66 total 243.22 last 77.60) - open/close/unlink 12137 (time 1777910504.66 total 253.22 last 73.57) - open/close/unlink 13141 (time 1777910514.67 total 263.23 last 100.34) - open/close/unlink 14027 (time 1777910524.67 total 273.23 last 88.56) - open/close/unlink 14782 (time 1777910534.67 total 283.23 last 75.49) - open/close/unlink 15639 (time 1777910544.68 total 293.24 last 85.63) - open/close/unlink 16589 (time 1777910554.69 total 303.25 last 94.95) - open/close/unlink 17221 (time 1777910564.70 total 313.26 last 63.13) - open/close/unlink 17882 (time 1777910574.71 total 323.27 last 66.04) - open/close/unlink 18609 (time 1777910584.71 total 333.27 last 72.69) - open/close/unlink 19187 (time 1777910594.71 total 343.27 last 57.79) - open/close/unlink 19912 (time 1777910604.72 total 353.28 last 72.46) - open/close/unlink 20601 (time 1777910614.74 total 363.30 last 68.76) - open/close/unlink 21311 (time 1777910624.74 total 373.30 last 70.98) - open/close/unlink 22114 (time 1777910634.75 total 383.31 last 80.26) - open/close/unlink 22734 (time 1777910644.76 total 393.32 last 61.93) - open/close/unlink 23477 (time 1777910654.76 total 403.32 last 74.29) - open/close/unlink 24150 (time 1777910664.77 total 413.33 last 67.25) - open/close/unlink 24864 (time 1777910674.77 total 423.33 last 71.38) - open/close/unlink 25628 (time 1777910684.78 total 433.34 last 76.34) - open/close/unlink 26299 (time 1777910694.79 total 443.35 last 67.00) - open/close/unlink 27071 (time 1777910704.80 total 453.36 last 77.18) - open/close/unlink 27813 (time 1777910714.81 total 463.37 last 74.12) - open/close/unlink 28692 (time 1777910724.81 total 473.37 last 87.89) - open/close/unlink 29585 (time 1777910734.82 total 483.38 last 89.20) - open/close/unlink 30000 (time 1777910739.93 total 488.50 last 81.13) - open/close/unlink 30713 (time 1777910749.94 total 498.50 last 71.24) - open/close/unlink 31606 (time 1777910759.95 total 508.51 last 89.26) - open/close/unlink 32470 (time 1777910769.95 total 518.51 last 86.35) - open/close/unlink 33300 (time 1777910779.97 total 528.53 last 82.89) - open/close/unlink 34100 (time 1777910789.98 total 538.54 last 79.89) - open/close/unlink 34800 (time 1777910799.98 total 548.54 last 70.00) - open/close/unlink 35461 (time 1777910810.00 total 558.56 last 65.94) - open/close/unlink 36 - open/close/unlink 525 (time 1777910261.31 total 10.01 last 52.46) - open/close/unlink 1101 (time 1777910271.32 total 20.01 last 57.59) - open/close/unlink 1635 (time 1777910281.32 total 30.01 last 53.40) - open/close/unlink 2120 (time 1777910291.33 total 40.03 last 48.43) - open/close/unlink 2558 (time 1777910301.34 total 50.03 last 43.77) - open/close/unlink 2948 (time 1777910311.37 total 60.07 last 38.86) - open/close/unlink 3327 (time 1777910321.40 total 70.09 last 37.80) - open/close/unlink 3670 (time 1777910331.40 total 80.10 last 34.29) - open/close/unlink 4057 (time 1777910341.41 total 90.10 last 38.69) - open/close/unlink 4433 (time 1777910351.42 total 100.12 last 37.54) - open/close/unlink 4803 (time 1777910361.46 total 110.15 last 36.87) - open/close/unlink 5249 (time 1777910371.47 total 120.17 last 44.54) - open/close/unlink 5680 (time 1777910381.49 total 130.18 last 43.04) - open/close/unlink 6123 (time 1777910391.50 total 140.20 last 44.23) - open/close/unlink 6527 (time 1777910401.51 total 150.20 last 40.38) - open/close/unlink 6918 (time 1777910411.53 total 160.22 last 39.02) - open/close/unlink 7352 (time 1777910421.54 total 170.23 last 43.36) - open/close/unlink 7781 (time 1777910431.55 total 180.24 last 42.85) - open/close/unlink 8239 (time 1777910441.56 total 190.25 last 45.75) - open/close/unlink 8659 (time 1777910451.57 total 200.26 last 41.97) - open/close/unlink 9237 (time 1777910461.57 total 210.27 last 57.76) - open/close/unlink 9786 (time 1777910471.58 total 220.27 last 54.87) - open/close/unlink 10000 (time 1777910474.75 total 223.44 last 67.49) - open/close/unlink 10627 (time 1777910484.76 total 233.45 last 62.65) - open/close/unlink 11405 (time 1777910494.76 total 243.46 last 77.76) - open/close/unlink 12136 (time 1777910504.77 total 253.46 last 73.08) - open/close/unlink 13140 (time 1777910514.77 total 263.47 last 100.32) - open/close/unlink 14025 (time 1777910524.78 total 273.48 last 88.42) - open/close/unlink 14779 (time 1777910534.80 total 283.49 last 75.29) - open/close/unlink 15639 (time 1777910544.81 total 293.50 last 85.93) - open/close/unlink 16585 (time 1777910554.81 total 303.51 last 94.54) - open/close/unlink 17214 (time 1777910564.83 total 313.52 last 62.82) - open/close/unlink 17866 (time 1777910574.85 total 323.54 last 65.07) - open/close/unlink 18603 (time 1777910584.85 total 333.55 last 73.66) - open/close/unlink 19185 (time 1777910594.86 total 343.55 last 58.17) - open/close/unlink 19917 (time 1777910604.87 total 353.57 last 73.09) - open/close/unlink 20603 (time 1777910614.89 total 363.58 last 68.50) - open/close/unlink 21296 (time 1777910624.89 total 373.59 last 69.26) - open/close/unlink 22099 (time 1777910634.92 total 383.62 last 80.06) - open/close/unlink 22718 (time 1777910644.94 total 393.63 last 61.81) - open/close/unlink 23468 (time 1777910654.95 total 403.65 last 74.89) - open/close/unlink 24137 (time 1777910664.96 total 413.65 last 66.87) - open/close/unlink 24844 (time 1777910674.96 total 423.66 last 70.65) - open/close/unlink 25605 (time 1777910684.97 total 433.66 last 76.08) - open/close/unlink 26277 (time 1777910694.97 total 443.67 last 67.16) - open/close/unlink 27053 (time 1777910704.98 total 453.67 last 77.56) - open/close/unlink 27795 (time 1777910714.98 total 463.68 last 74.17) - open/close/unlink 28680 (time 1777910724.98 total 473.68 last 88.49) - open/close/unlink 29578 (time 1777910734.99 total 483.68 last 89.72) - open/close/unlink 30000 (time 1777910740.23 total 488.93 last 80.47) - open/close/unlink 30712 (time 1777910750.24 total 498.93 last 71.18) - open/close/unlink 31603 (time 1777910760.24 total 508.94 last 89.05) - open/close/unlink 32458 (time 1777910770.25 total 518.95 last 85.43) - open/close/unlink 33292 (time 1777910780.26 total 528.96 last 83.31) - open/close/unlink 34081 (time 1777910790.27 total 538.96 last 78.84) - open/close/unlink 34782 (time 1777910800.28 total 548.97 last 70.05) - open/close/unlink 35435 (time 1777910810.29 total 558.98 last 65.24) - open/close/unlink 36 - open/close/unlink 522 (time 1777910261.40 total 10.04 last 52.00) - open/close/unlink 1100 (time 1777910271.40 total 20.04 last 57.77) - open/close/unlink 1635 (time 1777910281.41 total 30.05 last 53.47) - open/close/unlink 2123 (time 1777910291.42 total 40.06 last 48.74) - open/close/unlink 2560 (time 1777910301.44 total 50.08 last 43.62) - open/close/unlink 2945 (time 1777910311.44 total 60.08 last 38.49) - open/close/unlink 3320 (time 1777910321.45 total 70.09 last 37.47) - open/close/unlink 3679 (time 1777910331.45 total 80.09 last 35.90) - open/close/unlink 4068 (time 1777910341.45 total 90.09 last 38.89) - open/close/unlink 4453 (time 1777910351.47 total 100.11 last 38.43) - open/close/unlink 4827 (time 1777910361.47 total 110.11 last 37.39) - open/close/unlink 5270 (time 1777910371.50 total 120.14 last 44.20) - open/close/unlink 5700 (time 1777910381.51 total 130.15 last 42.94) - open/close/unlink 6143 (time 1777910391.53 total 140.16 last 44.24) - open/close/unlink 6545 (time 1777910401.55 total 150.19 last 40.12) - open/close/unlink 6936 (time 1777910411.55 total 160.19 last 39.09) - open/close/unlink 7367 (time 1777910421.56 total 170.20 last 43.06) - open/close/unlink 7799 (time 1777910431.56 total 180.20 last 43.19) - open/close/unlink 8264 (time 1777910441.56 total 190.20 last 46.50) - open/close/unlink 8686 (time 1777910451.57 total 200.21 last 42.18) - open/close/unlink 9259 (time 1777910461.57 total 210.21 last 57.29) - open/close/unlink 9818 (time 1777910471.58 total 220.22 last 55.85) - open/close/unlink 10000 (time 1777910474.26 total 222.90 last 67.81) - open/close/unlink 10624 (time 1777910484.28 total 232.92 last 62.31) - open/close/unlink 11389 (time 1777910494.28 total 242.92 last 76.44) - open/close/unlink 12119 (time 1777910504.29 total 252.93 last 72.99) - open/close/unlink 13118 (time 1777910514.29 total 262.93 last 99.85) - open/close/unlink 14009 (time 1777910524.29 total 272.93 last 89.10) - open/close/unlink 14767 (time 1777910534.29 total 282.93 last 75.78) - open/close/unlink 15610 (time 1777910544.30 total 292.94 last 84.24) - open/close/unlink 16569 (time 1777910554.31 total 302.95 last 95.83) - open/close/unlink 17206 (time 1777910564.32 total 312.95 last 63.66) - open/close/unlink 17857 (time 1777910574.32 total 322.96 last 65.07) - open/close/unlink 18593 (time 1777910584.32 total 332.96 last 73.59) - open/close/unlink 19159 (time 1777910594.33 total 342.97 last 56.56) - open/close/unlink 19889 (time 1777910604.35 total 352.99 last 72.84) - open/close/unlink 20581 (time 1777910614.36 total 363.00 last 69.12) - open/close/unlink 21269 (time 1777910624.37 total 373.00 last 68.77) - open/close/unlink 22076 (time 1777910634.37 total 383.01 last 80.64) - open/close/unlink 22698 (time 1777910644.39 total 393.02 last 62.12) - open/close/unlink 23448 (time 1777910654.39 total 403.03 last 74.94) - open/close/unlink 24109 (time 1777910664.39 total 413.03 last 66.09) - open/close/unlink 24829 (time 1777910674.41 total 423.05 last 71.91) - open/close/unlink 25584 (time 1777910684.41 total 433.05 last 75.46) - open/close/unlink 26261 (time 1777910694.42 total 443.06 last 67.68) - open/close/unlink 27029 (time 1777910704.42 total 453.06 last 76.75) - open/close/unlink 27766 (time 1777910714.43 total 463.07 last 73.67) - open/close/unlink 28637 (time 1777910724.44 total 473.07 last 87.03) - open/close/unlink 29533 (time 1777910734.44 total 483.08 last 89.54) - open/close/unlink 30000 (time 1777910740.31 total 488.95 last 79.54) - open/close/unlink 30726 (time 1777910750.32 total 498.96 last 72.57) - open/close/unlink 31613 (time 1777910760.32 total 508.96 last 88.65) - open/close/unlink 32453 (time 1777910770.32 total 518.96 last 83.99) - open/close/unlink 33285 (time 1777910780.33 total 528.97 last 83.12) - open/close/unlink 34066 (time 1777910790.33 total 538.97 last 78.10) - open/close/unlink 34768 (time 1777910800.34 total 548.97 last 70.19) - open/close/unlink 35422 (time 1777910810.34 total 558.98 last 65.35) - open/close/unlink 363 - open/close/unlink 527 (time 1777910261.50 total 10.03 last 52.57) - open/close/unlink 1095 (time 1777910271.50 total 20.03 last 56.76) - open/close/unlink 1626 (time 1777910281.51 total 30.04 last 53.05) - open/close/unlink 2114 (time 1777910291.54 total 40.07 last 48.67) - open/close/unlink 2554 (time 1777910301.55 total 50.08 last 43.95) - open/close/unlink 2940 (time 1777910311.57 total 60.10 last 38.54) - open/close/unlink 3310 (time 1777910321.59 total 70.12 last 36.91) - open/close/unlink 3672 (time 1777910331.61 total 80.14 last 36.13) - open/close/unlink 4063 (time 1777910341.62 total 90.14 last 39.07) - open/close/unlink 4451 (time 1777910351.62 total 100.15 last 38.79) - open/close/unlink 4820 (time 1777910361.62 total 110.15 last 36.89) - open/close/unlink 5260 (time 1777910371.62 total 120.15 last 43.99) - open/close/unlink 5688 (time 1777910381.63 total 130.16 last 42.78) - open/close/unlink 6132 (time 1777910391.64 total 140.17 last 44.33) - open/close/unlink 6529 (time 1777910401.66 total 150.19 last 39.62) - open/close/unlink 6910 (time 1777910411.69 total 160.22 last 38.00) - open/close/unlink 7350 (time 1777910421.70 total 170.23 last 43.96) - open/close/unlink 7776 (time 1777910431.72 total 180.25 last 42.52) - open/close/unlink 8243 (time 1777910441.73 total 190.26 last 46.64) - open/close/unlink 8667 (time 1777910451.73 total 200.26 last 42.40) - open/close/unlink 9230 (time 1777910461.74 total 210.27 last 56.27) - open/close/unlink 9793 (time 1777910471.74 total 220.27 last 56.29) - open/close/unlink 10000 (time 1777910474.78 total 223.31 last 68.10) - open/close/unlink 10628 (time 1777910484.78 total 233.31 last 62.76) - open/close/unlink 11400 (time 1777910494.79 total 243.32 last 77.14) - open/close/unlink 12130 (time 1777910504.79 total 253.32 last 72.99) - open/close/unlink 13139 (time 1777910514.80 total 263.33 last 100.82) - open/close/unlink 14019 (time 1777910524.80 total 273.33 last 87.99) - open/close/unlink 14763 (time 1777910534.81 total 283.34 last 74.33) - open/close/unlink 15621 (time 1777910544.82 total 293.35 last 85.73) - open/close/unlink 16569 (time 1777910554.83 total 303.36 last 94.71) - open/close/unlink 17201 (time 1777910564.83 total 313.36 last 63.19) - open/close/unlink 17849 (time 1777910574.84 total 323.37 last 64.72) - open/close/unlink 18582 (time 1777910584.84 total 333.37 last 73.29) - open/close/unlink 19156 (time 1777910594.86 total 343.39 last 57.28) - open/close/unlink 19889 (time 1777910604.87 total 353.40 last 73.22) - open/close/unlink 20563 (time 1777910614.89 total 363.42 last 67.30) - open/close/unlink 21274 (time 1777910624.90 total 373.43 last 71.01) - open/close/unlink 22080 (time 1777910634.91 total 383.44 last 80.50) - open/close/unlink 22700 (time 1777910644.92 total 393.45 last 61.95) - open/close/unlink 23447 (time 1777910654.93 total 403.45 last 74.66) - open/close/unlink 24126 (time 1777910664.93 total 413.46 last 67.85) - open/close/unlink 24838 (time 1777910674.94 total 423.47 last 71.15) - open/close/unlink 25597 (time 1777910684.94 total 433.47 last 75.88) - open/close/unlink 26265 (time 1777910694.95 total 443.48 last 66.76) - open/close/unlink 27036 (time 1777910704.95 total 453.48 last 77.08) - open/close/unlink 27779 (time 1777910714.95 total 463.48 last 74.27) - open/close/unlink 28661 (time 1777910724.96 total 473.49 last 88.16) - open/close/unlink 29551 (time 1777910734.96 total 483.49 last 88.96) - open/close/unlink 30000 (time 1777910740.64 total 489.17 last 79.04) - open/close/unlink 30725 (time 1777910750.65 total 499.18 last 72.44) - open/close/unlink 31601 (time 1777910760.66 total 509.18 last 87.57) - open/close/unlink 32463 (time 1777910770.66 total 519.19 last 86.19) - open/close/unlink 33308 (time 1777910780.66 total 529.19 last 84.44) - open/close/unlink 34070 (time 1777910790.68 total 539.21 last 76.10) - open/close/unlink 34771 (time 1777910800.68 total 549.21 last 70.07) - open/close/unlink 35422 (time 1777910810.69 total 559.22 last 65.03) - open/close/unlink 36 - open/close/unlink 524 (time 1777910261.02 total 10.01 last 52.34) - open/close/unlink 1086 (time 1777910271.03 total 20.02 last 56.14) - open/close/unlink 1625 (time 1777910281.05 total 30.05 last 53.76) - open/close/unlink 2113 (time 1777910291.08 total 40.07 last 48.70) - open/close/unlink 2547 (time 1777910301.08 total 50.08 last 43.36) - open/close/unlink 2940 (time 1777910311.10 total 60.10 last 39.22) - open/close/unlink 3311 (time 1777910321.11 total 70.10 last 37.09) - open/close/unlink 3663 (time 1777910331.11 total 80.11 last 35.19) - open/close/unlink 4052 (time 1777910341.11 total 90.11 last 38.89) - open/close/unlink 4426 (time 1777910351.14 total 100.13 last 37.32) - open/close/unlink 4791 (time 1777910361.15 total 110.14 last 36.45) - open/close/unlink 5241 (time 1777910371.15 total 120.15 last 44.99) - open/close/unlink 5661 (time 1777910381.16 total 130.15 last 41.97) - open/close/unlink 6100 (time 1777910391.17 total 140.17 last 43.83) - open/close/unlink 6505 (time 1777910401.21 total 150.20 last 40.34) - open/close/unlink 6892 (time 1777910411.23 total 160.23 last 38.61) - open/close/unlink 7325 (time 1777910421.26 total 170.26 last 43.18) - open/close/unlink 7755 (time 1777910431.27 total 180.27 last 42.96) - open/close/unlink 8218 (time 1777910441.28 total 190.27 last 46.27) - open/close/unlink 8645 (time 1777910451.28 total 200.27 last 42.69) - open/close/unlink 9227 (time 1777910461.32 total 210.32 last 57.95) - open/close/unlink 9772 (time 1777910471.33 total 220.32 last 54.49) - open/close/unlink 10000 (time 1777910474.75 total 223.74 last 66.64) - open/close/unlink 10630 (time 1777910484.75 total 233.75 last 62.96) - open/close/unlink 11402 (time 1777910494.77 total 243.76 last 77.08) - open/close/unlink 12129 (time 1777910504.77 total 253.77 last 72.66) - open/close/unlink 13141 (time 1777910514.78 total 263.77 last 101.16) - open/close/unlink 14025 (time 1777910524.79 total 273.78 last 88.34) - open/close/unlink 14778 (time 1777910534.79 total 283.79 last 75.24) - open/close/unlink 15636 (time 1777910544.80 total 293.79 last 85.76) - open/close/unlink 16587 (time 1777910554.81 total 303.80 last 94.97) - open/close/unlink 17223 (time 1777910564.82 total 313.81 last 63.55) - open/close/unlink 17878 (time 1777910574.83 total 323.82 last 65.43) - open/close/unlink 18606 (time 1777910584.84 total 333.84 last 72.72) - open/close/unlink 19187 (time 1777910594.86 total 343.85 last 58.02) - open/close/unlink 19911 (time 1777910604.87 total 353.86 last 72.32) - open/close/unlink 20593 (time 1777910614.88 total 363.87 last 68.11) - open/close/unlink 21295 (time 1777910624.88 total 373.88 last 70.18) - open/close/unlink 22101 (time 1777910634.89 total 383.88 last 80.54) - open/close/unlink 22720 (time 1777910644.90 total 393.89 last 61.85) - open/close/unlink 23470 (time 1777910654.90 total 403.90 last 74.97) - open/close/unlink 24139 (time 1777910664.90 total 413.90 last 66.89) - open/close/unlink 24847 (time 1777910674.90 total 423.90 last 70.79) - open/close/unlink 25603 (time 1777910684.91 total 433.90 last 75.56) - open/close/unlink 26272 (time 1777910694.92 total 443.92 last 66.82) - open/close/unlink 27045 (time 1777910704.93 total 453.92 last 77.26) - open/close/unlink 27785 (time 1777910714.94 total 463.93 last 73.93) - open/close/unlink 28665 (time 1777910724.94 total 473.93 last 88.00) - open/close/unlink 29557 (time 1777910734.94 total 483.93 last 89.16) - open/close/unlink 30000 (time 1777910740.64 total 489.63 last 77.77) - open/close/unlink 30734 (time 1777910750.64 total 499.63 last 73.38) - open/close/unlink 31611 (time 1777910760.65 total 509.64 last 87.63) - open/close/unlink 32462 (time 1777910770.66 total 519.66 last 84.99) - open/close/unlink 33312 (time 1777910780.67 total 529.66 last 84.95) - open/close/unlink 34069 (time 1777910790.68 total 539.68 last 75.60) - open/close/unlink 34775 (time 1777910800.69 total 549.68 last 70.55) - open/close/unlink 35425 (time 1777910810.70 total 559.69 last 64.94) - open/close/unlink 36379 (time 1777910820.29 total 568.99 last 94.36) - open/close/unlink 37144 (time 1777910830.30 total 578.99 last 76.45) - open/close/unlink 38134 (time 1777910840.30 total 589.00 last 98.95) - open/close/unlink 39141 (time 1777910850.32 total 599.01 last 100.56) - open/close/unlink 40000 (time 1777910859.69 total 608.38 last 91.65) - open/close/unlink 41027 (time 1777910869.69 total 618.39 last 102.65) - open/close/unlink 41760 (time 1777910879.69 total 628.39 last 73.30) - open/close/unlink 42588 (time 1777910889.70 total 638.40 last 82.73) - open/close/unlink 43444 (time 1777910899.71 total 648.40 last 85.57) - open/close/unlink 44273 (time 1777910909.72 total 658.41 last 82.82) - open/close/unlink 45238 (time 1777910919.73 total 668.42 last 96.37) - open/close/unlink 45990 (time 1777910929.73 total 678.43 last 75.18) - open/close/unlink 46854 (time 1777910939.74 total 688.44 last 86.31) - open/close/unlink 47739 (time 1777910949.75 total 698.44 last 88.44) - open/close/unlink 48747 (time 1777910959.76 total 708.45 last 100.73) - open/close/unlink 49771 (time 1777910969.76 total 718.46 last 102.32) - open/close/unlink 50000 (time 1777910971.89 total 720.58 last 107.71) - open/close/unlink 50981 (time 1777910981.89 total 730.59 last 98.07) - open/close/unlink 51996 (time 1777910991.90 total 740.59 last 101.45) - open/close/unlink 52983 (time 1777911001.90 total 750.60 last 98.65) - open/close/unlink 54077 (time 1777911011.91 total 760.60 last 109.38) - open/close/unlink 55072 (time 1777911021.91 total 770.61 last 99.44) - open/close/unlink 56146 (time 1777911031.92 total 780.61 last 107.36) - open/close/unlink 57109 (time 1777911041.92 total 790.61 last 96.28) - open/close/unlink 57933 (time 1777911051.93 total 800.62 last 82.34) - open/close/unlink 58732 (time 1777911061.93 total 810.63 last 79.85) - open/close/unlink 59419 (time 1777911071.94 total 820.63 last 68.66) - open/close/unlink 60000 (time 1777911079.26 total 827.96 last 79.31) - open/close/unlink 60774 (time 1777911089.28 total 837.97 last 77.32) - open/close/unlink 61577 (time 1777911099.28 total 847.98 last 80.23) - open/close/unlink 62430 (time 1777911109.29 total 857.98 last 85.25) - open/close/unlink 63100 (time 1777911119.30 total 867.99 last 66.93) - open/close/unlink 63747 (time 1777911129.30 total 878.00 last 64.67) - open/close/unlink 64314 (time 1777911139.32 total 888.01 last 56.63) total: 64768 open/close/unlink in 896.03 seconds: 72.28 ops/second 395 (time 1777910820.00 total 568.57 last 93.39) - open/close/unlink 37169 (time 1777910830.01 total 578.57 last 77.37) - open/close/unlink 38155 (time 1777910840.01 total 588.57 last 98.56) - open/close/unlink 39155 (time 1777910850.01 total 598.58 last 99.99) - open/close/unlink 40000 (time 1777910859.35 total 607.91 last 90.51) - open/close/unlink 41032 (time 1777910869.36 total 617.92 last 103.15) - open/close/unlink 41769 (time 1777910879.36 total 627.93 last 73.63) - open/close/unlink 42603 (time 1777910889.37 total 637.93 last 83.34) - open/close/unlink 43463 (time 1777910899.39 total 647.95 last 85.86) - open/close/unlink 44291 (time 1777910909.40 total 657.96 last 82.74) - open/close/unlink 45253 (time 1777910919.40 total 667.96 last 96.14) - open/close/unlink 46009 (time 1777910929.41 total 677.97 last 75.55) - open/close/unlink 46857 (time 1777910939.41 total 687.97 last 84.79) - open/close/unlink 47742 (time 1777910949.41 total 697.97 last 88.48) - open/close/unlink 48747 (time 1777910959.41 total 707.97 last 100.49) - open/close/unlink 49778 (time 1777910969.42 total 717.99 last 102.98) - open/close/unlink 50000 (time 1777910971.52 total 720.08 last 105.94) - open/close/unlink 50982 (time 1777910981.52 total 730.08 last 98.17) - open/close/unlink 51999 (time 1777910991.53 total 740.09 last 101.64) - open/close/unlink 52974 (time 1777911001.53 total 750.09 last 97.48) - open/close/unlink 54075 (time 1777911011.54 total 760.10 last 110.06) - open/close/unlink 55072 (time 1777911021.55 total 770.11 last 99.56) - open/close/unlink 56143 (time 1777911031.55 total 780.11 last 107.07) - open/close/unlink 57114 (time 1777911041.56 total 790.12 last 96.99) - open/close/unlink 57946 (time 1777911051.57 total 800.13 last 83.13) - open/close/unlink 58737 (time 1777911061.58 total 810.14 last 79.04) - open/close/unlink 59415 (time 1777911071.58 total 820.14 last 67.78) - open/close/unlink 60000 (time 1777911078.86 total 827.42 last 80.43) - open/close/unlink 60775 (time 1777911088.86 total 837.42 last 77.49) - open/close/unlink 61551 (time 1777911098.86 total 847.42 last 77.59) - open/close/unlink 62406 (time 1777911108.87 total 857.43 last 85.41) - open/close/unlink 63090 (time 1777911118.88 total 867.44 last 68.37) - open/close/unlink 63725 (time 1777911128.88 total 877.45 last 63.44) - open/close/unlink 64296 (time 1777911138.89 total 887.45 last 57.06) total: 64768 open/close/unlink in 895.93 seconds: 72.29 ops/second 70 (time 1777910820.34 total 568.98 last 94.79) - open/close/unlink 37133 (time 1777910830.35 total 578.99 last 76.25) - open/close/unlink 38108 (time 1777910840.36 total 588.99 last 97.46) - open/close/unlink 39109 (time 1777910850.36 total 599.00 last 100.05) - open/close/unlink 40000 (time 1777910860.13 total 608.77 last 91.19) - open/close/unlink 41035 (time 1777910870.14 total 618.78 last 103.41) - open/close/unlink 41770 (time 1777910880.15 total 628.79 last 73.43) - open/close/unlink 42596 (time 1777910890.16 total 638.80 last 82.52) - open/close/unlink 43449 (time 1777910900.17 total 648.81 last 85.23) - open/close/unlink 44297 (time 1777910910.18 total 658.82 last 84.71) - open/close/unlink 45262 (time 1777910920.18 total 668.82 last 96.48) - open/close/unlink 46014 (time 1777910930.19 total 678.83 last 75.14) - open/close/unlink 46885 (time 1777910940.19 total 688.83 last 87.09) - open/close/unlink 47766 (time 1777910950.20 total 698.83 last 88.04) - open/close/unlink 48786 (time 1777910960.20 total 708.84 last 101.97) - open/close/unlink 49810 (time 1777910970.20 total 718.84 last 102.36) - open/close/unlink 50809 (time 1777910980.21 total 728.85 last 99.86) - open/close/unlink 51848 (time 1777910990.21 total 738.85 last 103.86) - open/close/unlink 52782 (time 1777911000.22 total 748.86 last 93.32) - open/close/unlink 53871 (time 1777911010.22 total 758.86 last 108.86) - open/close/unlink 54857 (time 1777911020.23 total 768.87 last 98.53) - open/close/unlink 55947 (time 1777911030.24 total 778.88 last 108.92) - open/close/unlink 56947 (time 1777911040.24 total 788.88 last 100.00) - open/close/unlink 57792 (time 1777911050.24 total 798.88 last 84.44) - open/close/unlink 58595 (time 1777911060.26 total 808.90 last 80.16) - open/close/unlink 59276 (time 1777911070.26 total 818.90 last 68.09) - open/close/unlink 60000 (time 1777911079.39 total 828.03 last 79.32) - open/close/unlink 60774 (time 1777911089.40 total 838.04 last 77.36) - open/close/unlink 61561 (time 1777911099.40 total 848.04 last 78.67) - open/close/unlink 62415 (time 1777911109.41 total 858.05 last 85.34) - open/close/unlink 63087 (time 1777911119.42 total 868.06 last 67.14) - open/close/unlink 63731 (time 1777911129.42 total 878.06 last 64.39) - open/close/unlink 64302 (time 1777911139.43 total 888.07 last 57.04) total: 64768 open/close/unlink in 896.49 seconds: 72.25 ops/second 389 (time 1777910820.70 total 569.69 last 96.38) - open/close/unlink 37148 (time 1777910830.70 total 579.70 last 75.86) - open/close/unlink 38153 (time 1777910840.71 total 589.71 last 100.41) - open/close/unlink 39134 (time 1777910850.73 total 599.72 last 97.97) - open/close/unlink 40000 (time 1777910859.92 total 608.92 last 94.17) - open/close/unlink 41028 (time 1777910869.93 total 618.92 last 102.77) - open/close/unlink 41776 (time 1777910879.93 total 628.93 last 74.74) - open/close/unlink 42605 (time 1777910889.94 total 638.94 last 82.84) - open/close/unlink 43465 (time 1777910899.94 total 648.94 last 85.99) - open/close/unlink 44303 (time 1777910909.95 total 658.94 last 83.74) - open/close/unlink 45262 (time 1777910919.96 total 668.95 last 95.82) - open/close/unlink 46015 (time 1777910929.97 total 678.96 last 75.23) - open/close/unlink 46871 (time 1777910939.97 total 688.96 last 85.57) - open/close/unlink 47759 (time 1777910949.98 total 698.97 last 88.74) - open/close/unlink 48772 (time 1777910959.98 total 708.97 last 101.26) - open/close/unlink 49783 (time 1777910969.99 total 718.98 last 101.03) - open/close/unlink 50780 (time 1777910980.00 total 728.99 last 99.63) - open/close/unlink 51819 (time 1777910990.00 total 739.00 last 103.83) - open/close/unlink 52760 (time 1777911000.01 total 749.00 last 94.07) - open/close/unlink 53857 (time 1777911010.01 total 759.00 last 109.69) - open/close/unlink 54836 (time 1777911020.01 total 769.00 last 97.87) - open/close/unlink 55927 (time 1777911030.01 total 779.01 last 109.05) - open/close/unlink 56931 (time 1777911040.02 total 789.01 last 100.33) - open/close/unlink 57793 (time 1777911050.03 total 799.02 last 86.15) - open/close/unlink 58590 (time 1777911060.03 total 809.02 last 79.68) - open/close/unlink 59265 (time 1777911070.03 total 819.03 last 67.46) - open/close/unlink 60000 (time 1777911079.36 total 828.35 last 78.86) - open/close/unlink 60772 (time 1777911089.36 total 838.36 last 77.14) - open/close/unlink 61568 (time 1777911099.37 total 848.37 last 79.51) - open/close/unlink 62421 (time 1777911109.39 total 858.39 last 85.16) - open/close/unlink 63089 (time 1777911119.41 total 868.40 last 66.70) - open/close/unlink 63726 (time 1777911129.41 total 878.41 last 63.64) - open/close/unlink 64290 (time 1777911139.42 total 888.42 last 56.35) total: 64768 open/close/unlink in 896.91 seconds: 72.21 ops/second 388 (time 1777910820.70 total 569.23 last 96.53) - open/close/unlink 37133 (time 1777910830.71 total 579.23 last 74.45) - open/close/unlink 38121 (time 1777910840.71 total 589.24 last 98.73) - open/close/unlink 39110 (time 1777910850.72 total 599.25 last 98.78) - open/close/unlink 40000 (time 1777910860.18 total 608.71 last 94.09) - open/close/unlink 41025 (time 1777910870.19 total 618.72 last 102.46) - open/close/unlink 41768 (time 1777910880.19 total 628.72 last 74.25) - open/close/unlink 42597 (time 1777910890.20 total 638.73 last 82.85) - open/close/unlink 43455 (time 1777910900.21 total 648.74 last 85.70) - open/close/unlink 44298 (time 1777910910.22 total 658.75 last 84.21) - open/close/unlink 45251 (time 1777910920.23 total 668.76 last 95.25) - open/close/unlink 45996 (time 1777910930.23 total 678.76 last 74.46) - open/close/unlink 46858 (time 1777910940.24 total 688.77 last 86.16) - open/close/unlink 47741 (time 1777910950.25 total 698.78 last 88.19) - open/close/unlink 48759 (time 1777910960.26 total 708.79 last 101.71) - open/close/unlink 49774 (time 1777910970.27 total 718.80 last 101.41) - open/close/unlink 50771 (time 1777910980.28 total 728.81 last 99.61) - open/close/unlink 51816 (time 1777910990.28 total 738.81 last 104.50) - open/close/unlink 52752 (time 1777911000.28 total 748.81 last 93.57) - open/close/unlink 53847 (time 1777911010.29 total 758.81 last 109.43) - open/close/unlink 54834 (time 1777911020.29 total 768.82 last 98.67) - open/close/unlink 55917 (time 1777911030.29 total 778.82 last 108.25) - open/close/unlink 56906 (time 1777911040.30 total 788.82 last 98.87) - open/close/unlink 57757 (time 1777911050.31 total 798.84 last 84.99) - open/close/unlink 58552 (time 1777911060.33 total 808.86 last 79.32) - open/close/unlink 59223 (time 1777911070.34 total 818.86 last 67.07) - open/close/unlink 60000 (time 1777911080.08 total 828.61 last 79.77) - open/close/unlink 60761 (time 1777911090.09 total 838.61 last 76.03) - open/close/unlink 61561 (time 1777911100.09 total 848.62 last 79.97) - open/close/unlink 62411 (time 1777911110.10 total 858.63 last 84.91) - open/close/unlink 63093 (time 1777911120.11 total 868.64 last 68.13) - open/close/unlink 63704 (time 1777911130.11 total 878.64 last 61.07) - open/close/unlink 64270 (time 1777911140.13 total 888.66 last 56.50) total: 64768 open/close/unlink in 898.31 seconds: 72.10 ops/second sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete oleg337-server: cannot open 'lustre-ost2': no such pool pdsh@oleg337-client: oleg337-server: ssh exited with exit code 255 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg337-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg337-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg337-server stop mds service on oleg337-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg337-server unloading modules via unload_modules_local on: 'oleg337-server' oleg337-server: oleg337-server.virtnet: executing unload_modules_local oleg337-server: modules unloaded. pdsh@oleg337-client: oleg337-client: ssh exited with exit code 2 pdsh@oleg337-client: oleg337-server: ssh exited with exit code 2 pdsh@oleg337-client: oleg337-client: ssh exited with exit code 2 pdsh@oleg337-client: oleg337-server: ssh exited with exit code 2 PASS 106 (961s) Stopping clients: oleg337-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg337-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg337-client: oleg337-server: ssh exited with exit code 2 oleg337-server: oleg337-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg337-server' oleg337-server: oleg337-server.virtnet: executing load_modules_local oleg337-server: Loading modules from /home/green/git/lustre-release/lustre oleg337-server: detected 4 online CPUs by sysfs oleg337-server: MODOPTS_LIBCFS= oleg337-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg337-server: Force libcfs to create 2 CPU partitions oleg337-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg337-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg337-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 1104 sec ========== 12:13:36 (1777911216) === conf-sanity: start cleanup 12:13:37 (1777911217) === === conf-sanity: finish cleanup 12:13:39 (1777911219) ===