-----============= acceptance-small: conf-sanity ============----- Wed Jul 8 21:58:49 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg151-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682473 > 34553653) for LU-16938, go 81 excepting tests: 32newtarball Stopping clients: oleg151-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg151-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg151-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg151-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg151-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg151-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg151-server oleg151-server: oleg151-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg151-server' oleg151-server: oleg151-server.virtnet: executing load_modules_local oleg151-server: Loading modules from /home/green/git/lustre-release/lustre oleg151-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg151-server: detected 4 online CPUs by sysfs oleg151-server: MODOPTS_LIBCFS= oleg151-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg151-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg151-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg151-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg151-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg151-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg151-server: oleg151-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg151-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg151-server: oleg151-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg151-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg151-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg151-server stop mds service on oleg151-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg151-server stop mds service on oleg151-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg151-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 22:00:55 (1783562455) start mds service on oleg151-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg151-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg151-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg151-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg151-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Started lustre-OST0000 oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg151-client.virtnet: -o user_xattr,flock 192.168.201.151@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 401 49599 1% /mnt/lustre[OST:0] filesystem_summary: 50128 529 49599 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 472 (time 1783562506.71 total 10.02 last 47.12) - open/close/unlink 959 (time 1783562516.72 total 20.03 last 48.66) - open/close/unlink 1479 (time 1783562526.73 total 30.03 last 51.95) - open/close/unlink 1977 (time 1783562536.74 total 40.04 last 49.76) - open/close/unlink 2436 (time 1783562546.75 total 50.06 last 45.82) - open/close/unlink 2916 (time 1783562556.76 total 60.07 last 47.95) - open/close/unlink 3412 (time 1783562566.77 total 70.08 last 49.55) - open/close/unlink 3952 (time 1783562576.78 total 80.08 last 53.98) - open/close/unlink 4490 (time 1783562586.78 total 90.09 last 53.79) - open/close/unlink 5001 (time 1783562596.79 total 100.10 last 51.04) - open/close/unlink 5490 (time 1783562606.80 total 110.11 last 48.84) - open/close/unlink 6064 (time 1783562616.81 total 120.12 last 57.34) - open/close/unlink 6758 (time 1783562626.83 total 130.14 last 69.29) - open/close/unlink 7401 (time 1783562636.84 total 140.15 last 64.23) - open/close/unlink 8046 (time 1783562646.85 total 150.16 last 64.44) - open/close/unlink 8815 (time 1783562656.86 total 160.17 last 76.83) - open/close/unlink 9508 (time 1783562666.87 total 170.18 last 69.23) - open/close/unlink 10000 (time 1783562673.14 total 176.45 last 78.44) - open/close/unlink 10636 (time 1783562683.16 total 186.47 last 63.49) - open/close/unlink 11260 (time 1783562693.17 total 196.48 last 62.35) - open/close/unlink 11892 (time 1783562703.18 total 206.49 last 63.14) - open/close/unlink 12587 (time 1783562713.19 total 216.50 last 69.40) - open/close/unlink 13256 (time 1783562723.20 total 226.51 last 66.85) - open/close/unlink 13988 (time 1783562733.21 total 236.52 last 73.10) - open/close/unlink 14646 (time 1783562743.22 total 246.53 last 65.76) - open/close/unlink 15679 (time 1783562753.23 total 256.53 last 103.26) - open/close/unlink 16377 (time 1783562763.23 total 266.54 last 69.77) - open/close/unlink 17123 (time 1783562773.23 total 276.54 last 74.60) - open/close/unlink 17828 (time 1783562783.23 total 286.54 last 70.47) - open/close/unlink 18785 (time 1783562793.25 total 296.56 last 95.54) - open/close/unlink 19330 (time 1783562803.27 total 306.58 last 54.38) - open/close/unlink 19871 (time 1783562813.28 total 316.59 last 54.06) - open/close/unlink 20000 (time 1783562815.37 total 318.68 last 61.78) - open/close/unlink 20590 (time 1783562825.39 total 328.70 last 58.89) - open/close/unlink 21293 (time 1783562835.40 total 338.71 last 70.22) - open/close/unlink 21945 (time 1783562845.41 total 348.72 last 65.09) - open/close/unlink 22656 (time 1783562855.42 total 358.73 last 71.04) - open/close/unlink 23279 (time 1783562865.42 total 368.73 last 62.29) - open/close/unlink 23938 (time 1783562875.43 total 378.74 last 65.85) - open/close/unlink 24571 (time 1783562885.45 total 388.75 last 63.22) - open/close/unlink 25092 (time 1783562895.45 total 398.76 last 52.09) - open/close/unlink 25603 (time 1783562905.45 total 408.76 last 51.10) - open/close/unlink 26273 (time 1783562915.45 total 418.76 last 66.97) - open/close/unlink 27103 (time 1783562925.46 total 428.77 last 82.96) - open/close/unlink 27926 (time 1783562935.46 total 438.77 last 82.27) - open/close/unlink 28702 (time 1783562945.46 total 448.77 last 77.59) - open/close/unlink 29501 (time 1783562955.47 total 458.78 last 79.86) - open/close/unlink 30000 (time 1783562961.31 total 464.62 last 85.42) - open/close/unlink 30841 (time 1783562971.32 total 474.62 last 84.03) - open/close/unlink 31745 (time 1783562981.32 total 484.63 last 90.33) - open/close/unlink 32517 (time 1783562991.33 total 494.64 last 77.12) - open/close/unlink 33204 (time 1783563001.35 total 504.65 last 68.62) - open/close/unlink 33936 (time 1783563011.35 total 514.66 last 73.18) - open/close/unlink 34646 (time 1783563021.36 total 524.66 last 70.94) - open/close/unlink 35339 (time 1783563031.37 total 534.68 last 69.22) - open/close/unlink 36045 (time 1783563041.39 total 544.70 last 70.47) - open/close/unlink 36740 (time 1783563051.40 total 554.71 last 69.41) - open/close/unlin - open/close/unlink 474 (time 1783562506.83 total 10.02 last 47.32) - open/close/unlink 970 (time 1783562516.84 total 20.02 last 49.57) - open/close/unlink 1484 (time 1783562526.87 total 30.05 last 51.27) - open/close/unlink 1972 (time 1783562536.88 total 40.07 last 48.73) - open/close/unlink 2430 (time 1783562546.89 total 50.07 last 45.76) - open/close/unlink 2908 (time 1783562556.90 total 60.08 last 47.77) - open/close/unlink 3417 (time 1783562566.92 total 70.10 last 50.80) - open/close/unlink 3952 (time 1783562576.92 total 80.10 last 53.49) - open/close/unlink 4499 (time 1783562586.93 total 90.11 last 54.64) - open/close/unlink 5009 (time 1783562596.93 total 100.12 last 50.97) - open/close/unlink 5492 (time 1783562606.94 total 110.13 last 48.26) - open/close/unlink 6071 (time 1783562616.96 total 120.14 last 57.84) - open/close/unlink 6762 (time 1783562626.96 total 130.14 last 69.09) - open/close/unlink 7404 (time 1783562636.96 total 140.14 last 64.18) - open/close/unlink 8062 (time 1783562646.97 total 150.16 last 65.70) - open/close/unlink 8821 (time 1783562656.98 total 160.17 last 75.84) - open/close/unlink 9517 (time 1783562666.99 total 170.17 last 69.56) - open/close/unlink 10000 (time 1783562673.15 total 176.33 last 78.44) - open/close/unlink 10630 (time 1783562683.15 total 186.34 last 62.95) - open/close/unlink 11256 (time 1783562693.18 total 196.36 last 62.46) - open/close/unlink 11889 (time 1783562703.18 total 206.36 last 63.30) - open/close/unlink 12584 (time 1783562713.19 total 216.37 last 69.43) - open/close/unlink 13250 (time 1783562723.21 total 226.39 last 66.45) - open/close/unlink 13988 (time 1783562733.22 total 236.40 last 73.72) - open/close/unlink 14638 (time 1783562743.23 total 246.41 last 64.95) - open/close/unlink 15666 (time 1783562753.23 total 256.41 last 102.76) - open/close/unlink 16367 (time 1783562763.26 total 266.44 last 69.92) - open/close/unlink 17128 (time 1783562773.27 total 276.46 last 75.97) - open/close/unlink 17838 (time 1783562783.28 total 286.46 last 70.99) - open/close/unlink 18788 (time 1783562793.29 total 296.48 last 94.81) - open/close/unlink 19332 (time 1783562803.31 total 306.49 last 54.32) - open/close/unlink 19876 (time 1783562813.31 total 316.50 last 54.37) - open/close/unlink 20000 (time 1783562815.41 total 318.59 last 59.29) - open/close/unlink 20596 (time 1783562825.43 total 328.61 last 59.48) - open/close/unlink 21307 (time 1783562835.43 total 338.61 last 71.09) - open/close/unlink 21959 (time 1783562845.44 total 348.62 last 65.13) - open/close/unlink 22669 (time 1783562855.45 total 358.63 last 70.95) - open/close/unlink 23294 (time 1783562865.45 total 368.63 last 62.46) - open/close/unlink 23951 (time 1783562875.46 total 378.65 last 65.63) - open/close/unlink 24570 (time 1783562885.47 total 388.65 last 61.85) - open/close/unlink 25088 (time 1783562895.49 total 398.67 last 51.72) - open/close/unlink 25596 (time 1783562905.51 total 408.69 last 50.67) - open/close/unlink 26266 (time 1783562915.53 total 418.71 last 66.87) - open/close/unlink 27098 (time 1783562925.53 total 428.72 last 83.18) - open/close/unlink 27910 (time 1783562935.54 total 438.72 last 81.17) - open/close/unlink 28688 (time 1783562945.54 total 448.72 last 77.79) - open/close/unlink 29486 (time 1783562955.54 total 458.73 last 79.76) - open/close/unlink 30000 (time 1783562961.71 total 464.89 last 83.41) - open/close/unlink 30859 (time 1783562971.71 total 474.89 last 85.86) - open/close/unlink 31745 (time 1783562981.72 total 484.90 last 88.50) - open/close/unlink 32515 (time 1783562991.73 total 494.91 last 76.94) - open/close/unlink 33204 (time 1783563001.73 total 504.92 last 68.86) - open/close/unlink 33936 (time 1783563011.74 total 514.93 last 73.12) - open/close/unlink 34644 (time 1783563021.75 total 524.93 last 70.75) - open/close/unlink 35354 (time 1783563031.77 total 534.96 last 70.83) - open/close/unlink 36059 (time 1783563041.78 total 544.96 last 70.48) - open/close/unlink 36750 (time 1783563051.78 total 554.97 last 69.05) - open/close/unlin - open/close/unlink 472 (time 1783562506.91 total 10.00 last 47.20) - open/close/unlink 959 (time 1783562516.94 total 20.02 last 48.59) - open/close/unlink 1471 (time 1783562526.96 total 30.04 last 51.10) - open/close/unlink 1963 (time 1783562537.00 total 40.09 last 48.99) - open/close/unlink 2421 (time 1783562547.03 total 50.12 last 45.65) - open/close/unlink 2898 (time 1783562557.04 total 60.12 last 47.69) - open/close/unlink 3411 (time 1783562567.04 total 70.13 last 51.28) - open/close/unlink 3940 (time 1783562577.07 total 80.15 last 52.75) - open/close/unlink 4484 (time 1783562587.08 total 90.17 last 54.34) - open/close/unlink 4987 (time 1783562597.09 total 100.18 last 50.22) - open/close/unlink 5478 (time 1783562607.11 total 110.19 last 49.03) - open/close/unlink 6069 (time 1783562617.12 total 120.20 last 59.05) - open/close/unlink 6754 (time 1783562627.12 total 130.21 last 68.49) - open/close/unlink 7390 (time 1783562637.14 total 140.22 last 63.48) - open/close/unlink 8059 (time 1783562647.15 total 150.24 last 66.81) - open/close/unlink 8826 (time 1783562657.16 total 160.25 last 76.63) - open/close/unlink 9519 (time 1783562667.16 total 170.25 last 69.26) - open/close/unlink 10000 (time 1783562673.30 total 176.38 last 78.45) - open/close/unlink 10634 (time 1783562683.30 total 186.39 last 63.39) - open/close/unlink 11249 (time 1783562693.30 total 196.39 last 61.47) - open/close/unlink 11887 (time 1783562703.31 total 206.39 last 63.77) - open/close/unlink 12582 (time 1783562713.32 total 216.41 last 69.40) - open/close/unlink 13257 (time 1783562723.33 total 226.42 last 67.46) - open/close/unlink 13994 (time 1783562733.34 total 236.43 last 73.60) - open/close/unlink 14647 (time 1783562743.35 total 246.44 last 65.25) - open/close/unlink 15684 (time 1783562753.35 total 256.44 last 103.67) - open/close/unlink 16376 (time 1783562763.36 total 266.44 last 69.17) - open/close/unlink 17132 (time 1783562773.37 total 276.46 last 75.50) - open/close/unlink 17839 (time 1783562783.37 total 286.46 last 70.68) - open/close/unlink 18792 (time 1783562793.37 total 296.46 last 95.30) - open/close/unlink 19336 (time 1783562803.39 total 306.47 last 54.32) - open/close/unlink 19881 (time 1783562813.39 total 316.48 last 54.46) - open/close/unlink 20000 (time 1783562815.44 total 318.53 last 58.20) - open/close/unlink 20583 (time 1783562825.46 total 328.54 last 58.21) - open/close/unlink 21291 (time 1783562835.46 total 338.55 last 70.76) - open/close/unlink 21945 (time 1783562845.47 total 348.56 last 65.31) - open/close/unlink 22650 (time 1783562855.48 total 358.57 last 70.45) - open/close/unlink 23274 (time 1783562865.50 total 368.59 last 62.28) - open/close/unlink 23932 (time 1783562875.50 total 378.59 last 65.78) - open/close/unlink 24568 (time 1783562885.51 total 388.60 last 63.54) - open/close/unlink 25081 (time 1783562895.52 total 398.60 last 51.29) - open/close/unlink 25596 (time 1783562905.53 total 408.62 last 51.42) - open/close/unlink 26258 (time 1783562915.54 total 418.63 last 66.16) - open/close/unlink 27083 (time 1783562925.54 total 428.63 last 82.49) - open/close/unlink 27894 (time 1783562935.54 total 438.63 last 81.08) - open/close/unlink 28666 (time 1783562945.54 total 448.63 last 77.17) - open/close/unlink 29462 (time 1783562955.55 total 458.64 last 79.57) - open/close/unlink 30000 (time 1783562961.97 total 465.06 last 83.76) - open/close/unlink 30850 (time 1783562971.98 total 475.07 last 84.92) - open/close/unlink 31731 (time 1783562981.99 total 485.08 last 88.04) - open/close/unlink 32504 (time 1783562991.99 total 495.08 last 77.30) - open/close/unlink 33192 (time 1783563002.00 total 505.09 last 68.71) - open/close/unlink 33921 (time 1783563012.01 total 515.10 last 72.83) - open/close/unlink 34625 (time 1783563022.01 total 525.10 last 70.39) - open/close/unlink 35330 (time 1783563032.02 total 535.11 last 70.43) - open/close/unlink 36028 (time 1783563042.02 total 545.11 last 69.80) - open/close/unlink 36716 (time 1783563052.03 total 555.12 last 68.74) - open/close/unlin - open/close/unlink 489 (time 1783562507.06 total 10.00 last 48.88) - open/close/unlink 980 (time 1783562517.07 total 20.01 last 49.04) - open/close/unlink 1492 (time 1783562527.07 total 30.02 last 51.18) - open/close/unlink 1984 (time 1783562537.10 total 40.05 last 49.06) - open/close/unlink 2444 (time 1783562547.11 total 50.06 last 45.95) - open/close/unlink 2925 (time 1783562557.12 total 60.07 last 48.03) - open/close/unlink 3428 (time 1783562567.13 total 70.07 last 50.29) - open/close/unlink 3958 (time 1783562577.14 total 80.09 last 52.94) - open/close/unlink 4504 (time 1783562587.15 total 90.10 last 54.54) - open/close/unlink 5008 (time 1783562597.16 total 100.11 last 50.33) - open/close/unlink 5506 (time 1783562607.17 total 110.11 last 49.78) - open/close/unlink 6101 (time 1783562617.17 total 120.12 last 59.48) - open/close/unlink 6795 (time 1783562627.18 total 130.13 last 69.32) - open/close/unlink 7433 (time 1783562637.20 total 140.15 last 63.68) - open/close/unlink 8087 (time 1783562647.21 total 150.16 last 65.34) - open/close/unlink 8847 (time 1783562657.22 total 160.17 last 75.94) - open/close/unlink 9534 (time 1783562667.22 total 170.17 last 68.65) - open/close/unlink 10000 (time 1783562673.24 total 176.19 last 77.50) - open/close/unlink 10641 (time 1783562683.24 total 186.19 last 64.07) - open/close/unlink 11263 (time 1783562693.24 total 196.19 last 62.19) - open/close/unlink 11897 (time 1783562703.25 total 206.20 last 63.38) - open/close/unlink 12594 (time 1783562713.25 total 216.20 last 69.68) - open/close/unlink 13257 (time 1783562723.26 total 226.20 last 66.26) - open/close/unlink 13990 (time 1783562733.26 total 236.21 last 73.28) - open/close/unlink 14647 (time 1783562743.26 total 246.21 last 65.68) - open/close/unlink 15678 (time 1783562753.27 total 256.22 last 103.03) - open/close/unlink 16379 (time 1783562763.28 total 266.22 last 70.05) - open/close/unlink 17122 (time 1783562773.28 total 276.23 last 74.27) - open/close/unlink 17831 (time 1783562783.28 total 286.23 last 70.89) - open/close/unlink 18788 (time 1783562793.29 total 296.24 last 95.60) - open/close/unlink 19332 (time 1783562803.30 total 306.25 last 54.34) - open/close/unlink 19888 (time 1783562813.31 total 316.26 last 55.57) - open/close/unlink 20467 (time 1783562823.31 total 326.26 last 57.90) - open/close/unlink 21186 (time 1783562833.32 total 336.26 last 71.86) - open/close/unlink 21808 (time 1783562843.32 total 346.27 last 62.18) - open/close/unlink 22544 (time 1783562853.32 total 356.27 last 73.59) - open/close/unlink 23158 (time 1783562863.33 total 366.28 last 61.34) - open/close/unlink 23819 (time 1783562873.33 total 376.28 last 66.08) - open/close/unlink 24460 (time 1783562883.33 total 386.28 last 64.10) - open/close/unlink 24964 (time 1783562893.35 total 396.29 last 50.33) - open/close/unlink 25504 (time 1783562903.35 total 406.29 last 54.00) - open/close/unlink 26135 (time 1783562913.36 total 416.30 last 63.04) - open/close/unlink 26898 (time 1783562923.36 total 426.31 last 76.26) - open/close/unlink 27755 (time 1783562933.37 total 436.32 last 85.64) - open/close/unlink 28522 (time 1783562943.37 total 446.32 last 76.70) - open/close/unlink 29356 (time 1783562953.37 total 456.32 last 83.37) - open/close/unlink 30000 (time 1783562961.23 total 464.18 last 81.99) - open/close/unlink 30846 (time 1783562971.24 total 474.18 last 84.54) - open/close/unlink 31745 (time 1783562981.24 total 484.19 last 89.85) - open/close/unlink 32517 (time 1783562991.24 total 494.19 last 77.18) - open/close/unlink 33201 (time 1783563001.26 total 504.20 last 68.32) - open/close/unlink 33933 (time 1783563011.27 total 514.22 last 73.08) - open/close/unlink 34646 (time 1783563021.28 total 524.23 last 71.24) - open/close/unlink 35354 (time 1783563031.29 total 534.24 last 70.72) - open/close/unlink 36063 (time 1783563041.30 total 544.25 last 70.85) - open/close/unlink 36752 (time 1783563051.31 total 554.26 last 68.80) - open/close/unlink 37516 (time 1783563061.32 total 564.27 last 76.35) - open/close/unlin - open/close/unlink 473 (time 1783562506.71 total 10.00 last 47.29) - open/close/unlink 962 (time 1783562516.72 total 20.02 last 48.84) - open/close/unlink 1480 (time 1783562526.74 total 30.03 last 51.71) - open/close/unlink 1976 (time 1783562536.77 total 40.07 last 49.44) - open/close/unlink 2432 (time 1783562546.78 total 50.08 last 45.55) - open/close/unlink 2905 (time 1783562556.81 total 60.10 last 47.18) - open/close/unlink 3415 (time 1783562566.81 total 70.10 last 50.99) - open/close/unlink 3945 (time 1783562576.83 total 80.12 last 52.92) - open/close/unlink 4483 (time 1783562586.83 total 90.13 last 53.76) - open/close/unlink 5001 (time 1783562596.84 total 100.14 last 51.75) - open/close/unlink 5493 (time 1783562606.87 total 110.16 last 49.08) - open/close/unlink 6076 (time 1783562616.88 total 120.17 last 58.23) - open/close/unlink 6769 (time 1783562626.89 total 130.18 last 69.25) - open/close/unlink 7409 (time 1783562636.91 total 140.20 last 63.87) - open/close/unlink 8074 (time 1783562646.91 total 150.20 last 66.48) - open/close/unlink 8833 (time 1783562656.92 total 160.21 last 75.85) - open/close/unlink 9513 (time 1783562666.93 total 170.22 last 67.94) - open/close/unlink 10000 (time 1783562673.29 total 176.58 last 76.54) - open/close/unlink 10649 (time 1783562683.30 total 186.59 last 64.84) - open/close/unlink 11265 (time 1783562693.31 total 196.60 last 61.55) - open/close/unlink 11898 (time 1783562703.31 total 206.60 last 63.27) - open/close/unlink 12594 (time 1783562713.31 total 216.60 last 69.59) - open/close/unlink 13261 (time 1783562723.31 total 226.61 last 66.70) - open/close/unlink 14003 (time 1783562733.32 total 236.61 last 74.14) - open/close/unlink 14659 (time 1783562743.33 total 246.63 last 65.52) - open/close/unlink 15700 (time 1783562753.34 total 256.63 last 104.01) - open/close/unlink 16393 (time 1783562763.36 total 266.66 last 69.15) - open/close/unlink 17135 (time 1783562773.37 total 276.66 last 74.15) - open/close/unlink 17850 (time 1783562783.37 total 286.66 last 71.50) - open/close/unlink 18806 (time 1783562793.37 total 296.67 last 95.58) - open/close/unlink 19351 (time 1783562803.37 total 306.67 last 54.50) - open/close/unlink 19891 (time 1783562813.38 total 316.67 last 53.98) - open/close/unlink 20480 (time 1783562823.38 total 326.67 last 58.87) - open/close/unlink 21190 (time 1783562833.39 total 336.68 last 70.96) - open/close/unlink 21819 (time 1783562843.40 total 346.69 last 62.83) - open/close/unlink 22557 (time 1783562853.40 total 356.69 last 73.79) - open/close/unlink 23165 (time 1783562863.42 total 366.71 last 60.70) - open/close/unlink 23831 (time 1783562873.43 total 376.72 last 66.55) - open/close/unlink 24476 (time 1783562883.43 total 386.72 last 64.48) - open/close/unlink 24983 (time 1783562893.45 total 396.74 last 50.62) - open/close/unlink 25512 (time 1783562903.46 total 406.75 last 52.82) - open/close/unlink 26144 (time 1783562913.47 total 416.76 last 63.16) - open/close/unlink 26906 (time 1783562923.48 total 426.77 last 76.13) - open/close/unlink 27755 (time 1783562933.49 total 436.78 last 84.77) - open/close/unlink 28517 (time 1783562943.50 total 446.79 last 76.11) - open/close/unlink 29359 (time 1783562953.52 total 456.81 last 84.09) - open/close/unlink 30000 (time 1783562961.38 total 464.67 last 81.53) - open/close/unlink 30840 (time 1783562971.39 total 474.68 last 83.91) - open/close/unlink 31740 (time 1783562981.41 total 484.70 last 89.85) - open/close/unlink 32508 (time 1783562991.41 total 494.70 last 76.77) - open/close/unlink 33197 (time 1783563001.42 total 504.71 last 68.83) - open/close/unlink 33928 (time 1783563011.43 total 514.72 last 73.02) - open/close/unlink 34635 (time 1783563021.44 total 524.73 last 70.66) - open/close/unlink 35339 (time 1783563031.44 total 534.73 last 70.39) - open/close/unlink 36045 (time 1783563041.44 total 544.73 last 70.58) - open/close/unlink 36734 (time 1783563051.44 total 554.73 last 68.90) - open/close/unlink 37494 (time 1783563061.46 total 564.75 last 75.88) - open/close/unlink 38559 (time 1783563071.32 total 574.27 last 104.27) - open/close/unlink 39591 (time 1783563081.33 total 584.28 last 103.16) - open/close/unlink 40000 (time 1783563085.49 total 588.43 last 98.33) - open/close/unlink 40831 (time 1783563095.49 total 598.44 last 83.03) - open/close/unlink 41523 (time 1783563105.50 total 608.45 last 69.17) - open/close/unlink 42175 (time 1783563115.51 total 618.46 last 65.09) - open/close/unlink 42957 (time 1783563125.52 total 628.47 last 78.18) - open/close/unlink 43769 (time 1783563135.52 total 638.47 last 81.17) - open/close/unlink 44503 (time 1783563145.54 total 648.49 last 73.26) - open/close/unlink 45289 (time 1783563155.54 total 658.49 last 78.58) - open/close/unlink 46014 (time 1783563165.56 total 668.50 last 72.41) - open/close/unlink 46595 (time 1783563175.56 total 678.51 last 58.08) - open/close/unlink 47139 (time 1783563185.58 total 688.53 last 54.28) - open/close/unlink 47699 (time 1783563195.61 total 698.56 last 55.83) - open/close/unlink 48264 (time 1783563205.63 total 708.58 last 56.39) - open/close/unlink 49015 (time 1783563215.63 total 718.58 last 75.07) - open/close/unlink 49838 (time 1783563225.64 total 728.59 last 82.25) - open/close/unlink 50639 (time 1783563235.64 total 738.59 last 80.07) - open/close/unlink 51464 (time 1783563245.64 total 748.59 last 82.49) - open/close/unlink 52354 (time 1783563255.65 total 758.59 last 88.98) - open/close/unlink 53342 (time 1783563265.65 total 768.60 last 98.77) - open/close/unlink 54120 (time 1783563275.65 total 778.60 last 77.80) - open/close/unlink 54927 (time 1783563285.65 total 788.60 last 80.70) - open/close/unlink 55827 (time 1783563295.66 total 798.60 last 89.96) - open/close/unlink 56739 (time 1783563305.66 total 808.60 last 91.18) - open/close/unlink 57569 (time 1783563315.66 total 818.61 last 82.97) - open/close/unlink 58406 (time 1783563325.67 total 828.61 last 83.65) - open/close/unlink 59353 (time 1783563335.67 total 838.61 last 94.70) - open/close/unlink 60000 (time 1783563342.10 total 845.04 last 100.64) - open/close/unlink 60841 (time 1783563352.10 total 855.04 last 84.09) - open/close/unlink 61900 (time 1783563362.10 total 865.05 last 105.89) - open/close/unlink 62907 (time 1783563372.10 total 875.05 last 100.64) - open/close/unlink 63854 (time 1783563382.11 total 885.05 last 94.68) - open/close/unlink 64561 (time 1783563392.12 total 895.07 last 70.62) total: 64768 open/close/unlink in 897.59 seconds: 72.16 ops/second k 38537 (time 1783563071.46 total 574.76 last 104.22) - open/close/unlink 39568 (time 1783563081.47 total 584.76 last 103.09) - open/close/unlink 40000 (time 1783563085.98 total 589.27 last 95.62) - open/close/unlink 40828 (time 1783563096.00 total 599.29 last 82.68) - open/close/unlink 41523 (time 1783563106.00 total 609.29 last 69.47) - open/close/unlink 42182 (time 1783563116.00 total 619.30 last 65.89) - open/close/unlink 42968 (time 1783563126.01 total 629.30 last 78.57) - open/close/unlink 43777 (time 1783563136.01 total 639.30 last 80.88) - open/close/unlink 44522 (time 1783563146.02 total 649.31 last 74.44) - open/close/unlink 45309 (time 1783563156.02 total 659.31 last 78.67) - open/close/unlink 46029 (time 1783563166.03 total 669.33 last 71.92) - open/close/unlink 46606 (time 1783563176.05 total 679.34 last 57.60) - open/close/unlink 47152 (time 1783563186.06 total 689.35 last 54.57) - open/close/unlink 47695 (time 1783563196.09 total 699.38 last 54.12) - open/close/unlink 48273 (time 1783563206.09 total 709.39 last 57.76) - open/close/unlink 49037 (time 1783563216.11 total 719.40 last 76.32) - open/close/unlink 49862 (time 1783563226.11 total 729.40 last 82.46) - open/close/unlink 50649 (time 1783563236.12 total 739.41 last 78.61) - open/close/unlink 51488 (time 1783563246.13 total 749.42 last 83.86) - open/close/unlink 52365 (time 1783563256.13 total 759.43 last 87.64) - open/close/unlink 53350 (time 1783563266.15 total 769.44 last 98.36) - open/close/unlink 54132 (time 1783563276.15 total 779.44 last 78.19) - open/close/unlink 54951 (time 1783563286.15 total 789.45 last 81.86) - open/close/unlink 55857 (time 1783563296.16 total 799.45 last 90.58) - open/close/unlink 56752 (time 1783563306.16 total 809.45 last 89.45) - open/close/unlink 57576 (time 1783563316.17 total 819.47 last 82.31) - open/close/unlink 58426 (time 1783563326.18 total 829.48 last 84.91) - open/close/unlink 59398 (time 1783563336.19 total 839.48 last 97.15) - open/close/unlink 60000 (time 1783563342.32 total 845.61 last 98.19) - open/close/unlink 60845 (time 1783563352.33 total 855.62 last 84.40) - open/close/unlink 61924 (time 1783563362.34 total 865.63 last 107.86) - open/close/unlink 62916 (time 1783563372.34 total 875.63 last 99.16) - open/close/unlink 63862 (time 1783563382.35 total 885.64 last 94.48) - open/close/unlink 64580 (time 1783563392.37 total 895.66 last 71.69) total: 64768 open/close/unlink in 897.95 seconds: 72.13 ops/second k 37498 (time 1783563061.41 total 564.72 last 75.75) - open/close/unlink 38542 (time 1783563071.41 total 574.72 last 104.34) - open/close/unlink 39576 (time 1783563081.41 total 584.72 last 103.39) - open/close/unlink 40000 (time 1783563085.77 total 589.08 last 97.31) - open/close/unlink 40828 (time 1783563095.78 total 599.09 last 82.73) - open/close/unlink 41526 (time 1783563105.79 total 609.10 last 69.74) - open/close/unlink 42175 (time 1783563115.79 total 619.10 last 64.89) - open/close/unlink 42970 (time 1783563125.80 total 629.11 last 79.43) - open/close/unlink 43772 (time 1783563135.82 total 639.12 last 80.05) - open/close/unlink 44512 (time 1783563145.82 total 649.13 last 73.94) - open/close/unlink 45307 (time 1783563155.83 total 659.14 last 79.44) - open/close/unlink 46019 (time 1783563165.84 total 669.15 last 71.15) - open/close/unlink 46594 (time 1783563175.85 total 679.16 last 57.45) - open/close/unlink 47143 (time 1783563185.86 total 689.17 last 54.83) - open/close/unlink 47697 (time 1783563195.88 total 699.19 last 55.26) - open/close/unlink 48276 (time 1783563205.90 total 709.20 last 57.84) - open/close/unlink 49031 (time 1783563215.90 total 719.21 last 75.44) - open/close/unlink 49853 (time 1783563225.90 total 729.21 last 82.19) - open/close/unlink 50645 (time 1783563235.91 total 739.21 last 79.19) - open/close/unlink 51475 (time 1783563245.92 total 749.22 last 82.92) - open/close/unlink 52366 (time 1783563255.92 total 759.23 last 89.07) - open/close/unlink 53342 (time 1783563265.92 total 769.23 last 97.55) - open/close/unlink 54117 (time 1783563275.93 total 779.24 last 77.44) - open/close/unlink 54928 (time 1783563285.94 total 789.24 last 81.06) - open/close/unlink 55834 (time 1783563295.94 total 799.25 last 90.55) - open/close/unlink 56732 (time 1783563305.95 total 809.26 last 89.73) - open/close/unlink 57566 (time 1783563315.96 total 819.26 last 83.35) - open/close/unlink 58411 (time 1783563325.96 total 829.27 last 84.45) - open/close/unlink 59355 (time 1783563335.97 total 839.27 last 94.36) - open/close/unlink 60000 (time 1783563342.52 total 845.83 last 98.39) - open/close/unlink 60852 (time 1783563352.54 total 855.84 last 85.08) - open/close/unlink 61919 (time 1783563362.54 total 865.85 last 106.65) - open/close/unlink 62916 (time 1783563372.57 total 875.88 last 99.43) - open/close/unlink 63870 (time 1783563382.57 total 885.88 last 95.35) - open/close/unlink 64581 (time 1783563392.58 total 895.89 last 71.02) total: 64768 open/close/unlink in 898.27 seconds: 72.10 ops/second k 37522 (time 1783563061.79 total 564.97 last 77.16) - open/close/unlink 38576 (time 1783563071.79 total 574.98 last 105.37) - open/close/unlink 39578 (time 1783563081.79 total 584.98 last 100.19) - open/close/unlink 40000 (time 1783563086.22 total 589.41 last 95.26) - open/close/unlink 40827 (time 1783563096.23 total 599.41 last 82.66) - open/close/unlink 41525 (time 1783563106.23 total 609.42 last 69.76) - open/close/unlink 42174 (time 1783563116.24 total 619.42 last 64.88) - open/close/unlink 42960 (time 1783563126.25 total 629.43 last 78.53) - open/close/unlink 43761 (time 1783563136.26 total 639.44 last 79.99) - open/close/unlink 44500 (time 1783563146.26 total 649.44 last 73.90) - open/close/unlink 45297 (time 1783563156.26 total 659.45 last 79.67) - open/close/unlink 46021 (time 1783563166.27 total 669.45 last 72.36) - open/close/unlink 46588 (time 1783563176.27 total 679.46 last 56.67) - open/close/unlink 47132 (time 1783563186.28 total 689.47 last 54.35) - open/close/unlink 47678 (time 1783563196.29 total 699.47 last 54.58) - open/close/unlink 48255 (time 1783563206.29 total 709.48 last 57.66) - open/close/unlink 49013 (time 1783563216.30 total 719.48 last 75.75) - open/close/unlink 49831 (time 1783563226.31 total 729.49 last 81.74) - open/close/unlink 50625 (time 1783563236.31 total 739.50 last 79.34) - open/close/unlink 51467 (time 1783563246.32 total 749.50 last 84.18) - open/close/unlink 52358 (time 1783563256.32 total 759.50 last 89.09) - open/close/unlink 53323 (time 1783563266.33 total 769.51 last 96.38) - open/close/unlink 54112 (time 1783563276.34 total 779.53 last 78.81) - open/close/unlink 54934 (time 1783563286.34 total 789.53 last 82.20) - open/close/unlink 55842 (time 1783563296.36 total 799.55 last 90.60) - open/close/unlink 56742 (time 1783563306.38 total 809.56 last 89.89) - open/close/unlink 57565 (time 1783563316.38 total 819.57 last 82.22) - open/close/unlink 58417 (time 1783563326.39 total 829.57 last 85.19) - open/close/unlink 59398 (time 1783563336.39 total 839.57 last 98.06) - open/close/unlink 60000 (time 1783563342.79 total 845.98 last 94.02) - open/close/unlink 60841 (time 1783563352.79 total 855.98 last 84.08) - open/close/unlink 61943 (time 1783563362.80 total 865.98 last 110.17) - open/close/unlink 62919 (time 1783563372.81 total 875.99 last 97.51) - open/close/unlink 63866 (time 1783563382.81 total 885.99 last 94.68) - open/close/unlink 64568 (time 1783563392.82 total 896.00 last 70.13) total: 64768 open/close/unlink in 898.69 seconds: 72.07 ops/second k 37490 (time 1783563062.03 total 565.12 last 77.38) - open/close/unlink 38561 (time 1783563072.04 total 575.13 last 107.01) - open/close/unlink 39556 (time 1783563082.04 total 585.13 last 99.49) - open/close/unlink 40000 (time 1783563086.54 total 589.62 last 98.84) - open/close/unlink 40820 (time 1783563096.55 total 599.63 last 81.91) - open/close/unlink 41520 (time 1783563106.56 total 609.64 last 69.93) - open/close/unlink 42164 (time 1783563116.56 total 619.65 last 64.37) - open/close/unlink 42955 (time 1783563126.56 total 629.65 last 79.09) - open/close/unlink 43760 (time 1783563136.58 total 639.67 last 80.37) - open/close/unlink 44497 (time 1783563146.59 total 649.68 last 73.62) - open/close/unlink 45296 (time 1783563156.61 total 659.69 last 79.77) - open/close/unlink 46027 (time 1783563166.61 total 669.70 last 73.06) - open/close/unlink 46579 (time 1783563176.63 total 679.72 last 55.11) - open/close/unlink 47134 (time 1783563186.64 total 689.73 last 55.43) - open/close/unlink 47672 (time 1783563196.66 total 699.75 last 53.69) - open/close/unlink 48257 (time 1783563206.68 total 709.77 last 58.38) - open/close/unlink 49031 (time 1783563216.69 total 719.77 last 77.38) - open/close/unlink 49845 (time 1783563226.72 total 729.80 last 81.15) - open/close/unlink 50622 (time 1783563236.72 total 739.81 last 77.69) - open/close/unlink 51473 (time 1783563246.72 total 749.81 last 85.08) - open/close/unlink 52362 (time 1783563256.73 total 759.82 last 88.81) - open/close/unlink 53321 (time 1783563266.73 total 769.82 last 95.87) - open/close/unlink 54125 (time 1783563276.73 total 779.82 last 80.39) - open/close/unlink 54961 (time 1783563286.74 total 789.83 last 83.54) - open/close/unlink 55855 (time 1783563296.74 total 799.83 last 89.38) - open/close/unlink 56760 (time 1783563306.75 total 809.84 last 90.43) - open/close/unlink 57571 (time 1783563316.75 total 819.84 last 81.09) - open/close/unlink 58426 (time 1783563326.76 total 829.85 last 85.44) - open/close/unlink 59420 (time 1783563336.76 total 839.85 last 99.38) - open/close/unlink 60000 (time 1783563343.06 total 846.14 last 92.14) - open/close/unlink 60839 (time 1783563353.06 total 856.15 last 83.83) - open/close/unlink 61954 (time 1783563363.07 total 866.16 last 111.42) - open/close/unlink 62916 (time 1783563373.08 total 876.17 last 96.13) - open/close/unlink 63858 (time 1783563383.08 total 886.17 last 94.14) - open/close/unlink 64547 (time 1783563393.09 total 896.18 last 68.87) total: 64768 open/close/unlink in 899.56 seconds: 72.00 ops/second Waiting for MDT destroys to complete oleg151-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg151-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg151-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg151-server stop mds service on oleg151-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg151-server stop mds service on oleg151-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg151-server unloading modules via unload_modules_local on: 'oleg151-server' oleg151-server: oleg151-server.virtnet: executing unload_modules_local oleg151-server: modules unloaded. pdsh@oleg151-client: oleg151-client: ssh exited with exit code 2 pdsh@oleg151-client: oleg151-server: ssh exited with exit code 2 pdsh@oleg151-client: oleg151-client: ssh exited with exit code 2 pdsh@oleg151-client: oleg151-server: ssh exited with exit code 2 PASS 106 (989s) Stopping clients: oleg151-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg151-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg151-client: oleg151-server: ssh exited with exit code 2 oleg151-server: oleg151-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg151-server' oleg151-server: oleg151-server.virtnet: executing load_modules_local oleg151-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg151-server: Loading modules from /home/green/git/lustre-release/lustre oleg151-server: detected 4 online CPUs by sysfs oleg151-server: MODOPTS_LIBCFS= oleg151-server: Force libcfs to create 2 CPU partitions oleg151-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg151-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg151-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1146 sec ========== 22:17:56 (1783563476) === conf-sanity: start cleanup 22:17:57 (1783563477) === === conf-sanity: finish cleanup 22:17:58 (1783563478) ===