-----============= acceptance-small: conf-sanity ============----- Fri Apr 10 10:43:56 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg340-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32newtarball Stopping clients: oleg340-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg340-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg340-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg340-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg340-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg340-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg340-server oleg340-server: oleg340-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg340-server' oleg340-server: oleg340-server.virtnet: executing load_modules_local oleg340-server: Loading modules from /home/green/git/lustre-release/lustre oleg340-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg340-server: detected 4 online CPUs by sysfs oleg340-server: MODOPTS_LIBCFS= oleg340-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg340-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg340-server: oleg340-server.virtnet: executing set_default_debug -1 all pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg340-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg340-server: oleg340-server.virtnet: executing set_default_debug -1 all pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg340-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg340-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg340-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg340-server: oleg340-server.virtnet: executing set_default_debug -1 all pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg340-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg340-server: oleg340-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg340-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg340-server: oleg340-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg340-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg340-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg340-server stop mds service on oleg340-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg340-server stop mds service on oleg340-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg340-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 10:47:06 (1775832426) start mds service on oleg340-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg340-server: oleg340-server.virtnet: executing set_default_debug -1 all pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg340-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg340-server: oleg340-server.virtnet: executing set_default_debug -1 all pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg340-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg340-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg340-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg340-server: oleg340-server.virtnet: executing set_default_debug -1 all pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 Started lustre-OST0000 oleg340-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg340-client.virtnet: -o user_xattr,flock 192.168.203.140@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 400 49600 1% /mnt/lustre[OST:0] filesystem_summary: 50129 529 49600 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 534 (time 1775832480.55 total 10.01 last 53.35) - open/close/unlink 1003 (time 1775832490.55 total 20.02 last 46.87) - open/close/unlink 1516 (time 1775832500.56 total 30.02 last 51.25) - open/close/unlink 2045 (time 1775832510.57 total 40.03 last 52.88) - open/close/unlink 2574 (time 1775832520.58 total 50.04 last 52.85) - open/close/unlink 3078 (time 1775832530.60 total 60.06 last 50.29) - open/close/unlink 3575 (time 1775832540.61 total 70.07 last 49.64) - open/close/unlink 4124 (time 1775832550.62 total 80.08 last 54.84) - open/close/unlink 4702 (time 1775832560.63 total 90.09 last 57.76) - open/close/unlink 5284 (time 1775832570.64 total 100.10 last 58.15) - open/close/unlink 5895 (time 1775832580.65 total 110.11 last 61.05) - open/close/unlink 6491 (time 1775832590.65 total 120.11 last 59.59) - open/close/unlink 7067 (time 1775832600.65 total 130.11 last 57.59) - open/close/unlink 7695 (time 1775832610.66 total 140.12 last 62.76) - open/close/unlink 8360 (time 1775832620.66 total 150.13 last 66.45) - open/close/unlink 9013 (time 1775832630.67 total 160.13 last 65.26) - open/close/unlink 9615 (time 1775832640.67 total 170.13 last 60.19) - open/close/unlink 10000 (time 1775832646.63 total 176.09 last 64.66) - open/close/unlink 10675 (time 1775832656.64 total 186.11 last 67.39) - open/close/unlink 11297 (time 1775832666.65 total 196.12 last 62.13) - open/close/unlink 12002 (time 1775832676.66 total 206.12 last 70.46) - open/close/unlink 12769 (time 1775832686.67 total 216.13 last 76.66) - open/close/unlink 13525 (time 1775832696.67 total 226.13 last 75.55) - open/close/unlink 14302 (time 1775832706.67 total 236.14 last 77.69) - open/close/unlink 15038 (time 1775832716.68 total 246.14 last 73.57) - open/close/unlink 15951 (time 1775832726.68 total 256.15 last 91.25) - open/close/unlink 16755 (time 1775832736.69 total 266.15 last 80.35) - open/close/unlink 17706 (time 1775832746.69 total 276.16 last 95.06) - open/close/unlink 18498 (time 1775832756.70 total 286.16 last 79.14) - open/close/unlink 19446 (time 1775832766.71 total 296.17 last 94.74) - open/close/unlink 20000 (time 1775832772.99 total 302.46 last 88.11) - open/close/unlink 20783 (time 1775832783.00 total 312.47 last 78.23) - open/close/unlink 21541 (time 1775832793.01 total 322.48 last 75.72) - open/close/unlink 22318 (time 1775832803.02 total 332.48 last 77.63) - open/close/unlink 23110 (time 1775832813.03 total 342.49 last 79.15) - open/close/unlink 24001 (time 1775832823.04 total 352.50 last 89.02) - open/close/unlink 24740 (time 1775832833.05 total 362.51 last 73.80) - open/close/unlink 25430 (time 1775832843.06 total 372.52 last 68.93) - open/close/unlink 26251 (time 1775832853.07 total 382.53 last 82.01) - open/close/unlink 27213 (time 1775832863.08 total 392.54 last 96.14) - open/close/unlink 28124 (time 1775832873.09 total 402.55 last 90.98) - open/close/unlink 29087 (time 1775832883.09 total 412.56 last 96.27) - open/close/unlink 29940 (time 1775832893.10 total 422.56 last 85.29) - open/close/unlink 30844 (time 1775832903.10 total 432.56 last 90.39) - open/close/unlink 31804 (time 1775832913.10 total 442.56 last 96.00) - open/close/unlink 32853 (time 1775832923.10 total 452.56 last 104.88) - open/close/unlink 33835 (time 1775832933.11 total 462.57 last 98.12) - open/close/unlink 34721 (time 1775832943.11 total 472.57 last 88.55) - open/close/unlink 35767 (time 1775832953.12 total 482.58 last 104.54) - open/close/unlink 36868 (time 1775832963.12 total 492.59 last 110.03) - open/close/unlink 37827 (time 1775832973.13 total 502.59 last 95.85) - open/close/unlink 38741 (time 1775832983.13 total 512.60 last 91.34) - open/close/unlink 39850 (time 1775832993.14 total 522.61 last 110.81) - open/close/unlink 40893 (time 1775833003.15 total 532.61 last 104.23) - open/close/unlink 41927 (time 1775833013.15 total 542.62 last 103.36) - open/close/unlink 42843 (time 1775833023.16 total 552.62 last 91.53) - open/close/unlink 43744 (time 1775833033.17 total 562.63 last 90.05) - open/close - open/close/unlink 534 (time 1775832480.71 total 10.02 last 53.30) - open/close/unlink 998 (time 1775832490.72 total 20.03 last 46.33) - open/close/unlink 1509 (time 1775832500.73 total 30.04 last 51.06) - open/close/unlink 2045 (time 1775832510.75 total 40.06 last 53.49) - open/close/unlink 2581 (time 1775832520.77 total 50.08 last 53.52) - open/close/unlink 3072 (time 1775832530.78 total 60.09 last 49.02) - open/close/unlink 3559 (time 1775832540.79 total 70.10 last 48.68) - open/close/unlink 4109 (time 1775832550.80 total 80.11 last 54.96) - open/close/unlink 4689 (time 1775832560.80 total 90.11 last 57.96) - open/close/unlink 5273 (time 1775832570.80 total 100.11 last 58.39) - open/close/unlink 5885 (time 1775832580.81 total 110.12 last 61.13) - open/close/unlink 6478 (time 1775832590.82 total 120.13 last 59.26) - open/close/unlink 7055 (time 1775832600.84 total 130.15 last 57.58) - open/close/unlink 7682 (time 1775832610.84 total 140.15 last 62.69) - open/close/unlink 8346 (time 1775832620.85 total 150.16 last 66.35) - open/close/unlink 9000 (time 1775832630.86 total 160.17 last 65.34) - open/close/unlink 9611 (time 1775832640.87 total 170.18 last 61.06) - open/close/unlink 10000 (time 1775832646.97 total 176.28 last 63.71) - open/close/unlink 10672 (time 1775832656.99 total 186.30 last 67.11) - open/close/unlink 11295 (time 1775832666.99 total 196.30 last 62.28) - open/close/unlink 12004 (time 1775832677.00 total 206.31 last 70.83) - open/close/unlink 12769 (time 1775832687.01 total 216.32 last 76.43) - open/close/unlink 13521 (time 1775832697.02 total 226.33 last 75.13) - open/close/unlink 14313 (time 1775832707.02 total 236.33 last 79.19) - open/close/unlink 15041 (time 1775832717.02 total 246.33 last 72.79) - open/close/unlink 15964 (time 1775832727.03 total 256.34 last 92.26) - open/close/unlink 16765 (time 1775832737.03 total 266.34 last 80.07) - open/close/unlink 17699 (time 1775832747.04 total 276.35 last 93.34) - open/close/unlink 18489 (time 1775832757.04 total 286.35 last 78.98) - open/close/unlink 19449 (time 1775832767.05 total 296.36 last 95.89) - open/close/unlink 20000 (time 1775832773.34 total 302.65 last 87.54) - open/close/unlink 20777 (time 1775832783.34 total 312.66 last 77.69) - open/close/unlink 21548 (time 1775832793.35 total 322.66 last 77.09) - open/close/unlink 22321 (time 1775832803.35 total 332.66 last 77.25) - open/close/unlink 23112 (time 1775832813.36 total 342.67 last 79.06) - open/close/unlink 24004 (time 1775832823.36 total 352.67 last 89.18) - open/close/unlink 24742 (time 1775832833.37 total 362.68 last 73.76) - open/close/unlink 25440 (time 1775832843.38 total 372.69 last 69.68) - open/close/unlink 26275 (time 1775832853.38 total 382.69 last 83.49) - open/close/unlink 27219 (time 1775832863.39 total 392.70 last 94.33) - open/close/unlink 28131 (time 1775832873.40 total 402.71 last 91.14) - open/close/unlink 29095 (time 1775832883.41 total 412.72 last 96.32) - open/close/unlink 29949 (time 1775832893.41 total 422.72 last 85.38) - open/close/unlink 30859 (time 1775832903.41 total 432.72 last 90.97) - open/close/unlink 31816 (time 1775832913.42 total 442.73 last 95.63) - open/close/unlink 32864 (time 1775832923.43 total 452.74 last 104.70) - open/close/unlink 33845 (time 1775832933.45 total 462.76 last 97.91) - open/close/unlink 34727 (time 1775832943.45 total 472.76 last 88.18) - open/close/unlink 35790 (time 1775832953.45 total 482.76 last 106.27) - open/close/unlink 36880 (time 1775832963.46 total 492.77 last 108.98) - open/close/unlink 37835 (time 1775832973.46 total 502.77 last 95.43) - open/close/unlink 38746 (time 1775832983.47 total 512.78 last 91.08) - open/close/unlink 39853 (time 1775832993.47 total 522.78 last 110.64) - open/close/unlink 40890 (time 1775833003.48 total 532.79 last 103.57) - open/close/unlink 41903 (time 1775833013.49 total 542.80 last 101.21) - open/close/unlink 42821 (time 1775833023.49 total 552.80 last 91.80) - open/close/unlink 43717 (time 1775833033.49 total 562.80 last 89.59) - open/close/ - open/close/unlink 531 (time 1775832480.62 total 10.01 last 53.03) - open/close/unlink 1005 (time 1775832490.63 total 20.03 last 47.34) - open/close/unlink 1512 (time 1775832500.65 total 30.04 last 50.61) - open/close/unlink 2035 (time 1775832510.67 total 40.06 last 52.21) - open/close/unlink 2568 (time 1775832520.68 total 50.07 last 53.23) - open/close/unlink 3071 (time 1775832530.69 total 60.08 last 50.25) - open/close/unlink 3560 (time 1775832540.69 total 70.08 last 48.90) - open/close/unlink 4121 (time 1775832550.70 total 80.09 last 56.07) - open/close/unlink 4689 (time 1775832560.70 total 90.10 last 56.77) - open/close/unlink 5272 (time 1775832570.71 total 100.10 last 58.25) - open/close/unlink 5878 (time 1775832580.71 total 110.10 last 60.59) - open/close/unlink 6481 (time 1775832590.72 total 120.11 last 60.24) - open/close/unlink 7058 (time 1775832600.74 total 130.13 last 57.61) - open/close/unlink 7681 (time 1775832610.75 total 140.14 last 62.25) - open/close/unlink 8344 (time 1775832620.75 total 150.14 last 66.26) - open/close/unlink 8996 (time 1775832630.76 total 160.16 last 65.12) - open/close/unlink 9602 (time 1775832640.77 total 170.17 last 60.54) - open/close/unlink 10000 (time 1775832647.01 total 176.40 last 63.84) - open/close/unlink 10673 (time 1775832657.02 total 186.41 last 67.25) - open/close/unlink 11283 (time 1775832667.02 total 196.42 last 60.94) - open/close/unlink 11989 (time 1775832677.03 total 206.43 last 70.54) - open/close/unlink 12752 (time 1775832687.04 total 216.43 last 76.27) - open/close/unlink 13505 (time 1775832697.04 total 226.43 last 75.27) - open/close/unlink 14297 (time 1775832707.04 total 236.43 last 79.20) - open/close/unlink 15022 (time 1775832717.05 total 246.44 last 72.43) - open/close/unlink 15952 (time 1775832727.06 total 256.45 last 92.95) - open/close/unlink 16761 (time 1775832737.06 total 266.45 last 80.88) - open/close/unlink 17698 (time 1775832747.07 total 276.46 last 93.60) - open/close/unlink 18494 (time 1775832757.07 total 286.47 last 79.56) - open/close/unlink 19447 (time 1775832767.09 total 296.48 last 95.16) - open/close/unlink 20000 (time 1775832773.37 total 302.77 last 87.98) - open/close/unlink 20771 (time 1775832783.38 total 312.77 last 77.08) - open/close/unlink 21538 (time 1775832793.39 total 322.78 last 76.61) - open/close/unlink 22313 (time 1775832803.39 total 332.79 last 77.47) - open/close/unlink 23105 (time 1775832813.40 total 342.79 last 79.14) - open/close/unlink 23986 (time 1775832823.40 total 352.80 last 88.05) - open/close/unlink 24730 (time 1775832833.41 total 362.81 last 74.35) - open/close/unlink 25423 (time 1775832843.42 total 372.81 last 69.23) - open/close/unlink 26262 (time 1775832853.42 total 382.81 last 83.90) - open/close/unlink 27204 (time 1775832863.44 total 392.83 last 94.07) - open/close/unlink 28119 (time 1775832873.44 total 402.83 last 91.49) - open/close/unlink 29085 (time 1775832883.44 total 412.83 last 96.58) - open/close/unlink 29941 (time 1775832893.44 total 422.83 last 85.59) - open/close/unlink 30852 (time 1775832903.44 total 432.84 last 91.07) - open/close/unlink 31806 (time 1775832913.45 total 442.84 last 95.36) - open/close/unlink 32860 (time 1775832923.45 total 452.85 last 105.32) - open/close/unlink 33841 (time 1775832933.47 total 462.86 last 97.97) - open/close/unlink 34721 (time 1775832943.47 total 472.86 last 87.99) - open/close/unlink 35782 (time 1775832953.48 total 482.88 last 105.95) - open/close/unlink 36885 (time 1775832963.49 total 492.88 last 110.21) - open/close/unlink 37829 (time 1775832973.49 total 502.89 last 94.38) - open/close/unlink 38746 (time 1775832983.49 total 512.89 last 91.68) - open/close/unlink 39853 (time 1775832993.50 total 522.89 last 110.67) - open/close/unlink 40901 (time 1775833003.50 total 532.90 last 104.72) - open/close/unlink 41913 (time 1775833013.51 total 542.90 last 101.15) - open/close/unlink 42835 (time 1775833023.52 total 552.92 last 92.08) - open/close/unlink 43744 (time 1775833033.52 total 562.92 last 90.89) - open/close - open/close/unlink 534 (time 1775832480.63 total 10.01 last 53.37) - open/close/unlink 1006 (time 1775832490.64 total 20.02 last 47.15) - open/close/unlink 1516 (time 1775832500.66 total 30.04 last 50.89) - open/close/unlink 2048 (time 1775832510.68 total 40.05 last 53.13) - open/close/unlink 2579 (time 1775832520.69 total 50.06 last 53.03) - open/close/unlink 3077 (time 1775832530.70 total 60.07 last 49.75) - open/close/unlink 3569 (time 1775832540.70 total 70.07 last 49.19) - open/close/unlink 4122 (time 1775832550.71 total 80.09 last 55.22) - open/close/unlink 4696 (time 1775832560.72 total 90.10 last 57.34) - open/close/unlink 5280 (time 1775832570.73 total 100.11 last 58.34) - open/close/unlink 5881 (time 1775832580.74 total 110.12 last 60.03) - open/close/unlink 6477 (time 1775832590.75 total 120.13 last 59.55) - open/close/unlink 7058 (time 1775832600.75 total 130.13 last 58.08) - open/close/unlink 7683 (time 1775832610.76 total 140.14 last 62.45) - open/close/unlink 8346 (time 1775832620.77 total 150.15 last 66.22) - open/close/unlink 9004 (time 1775832630.78 total 160.15 last 65.78) - open/close/unlink 9614 (time 1775832640.79 total 170.17 last 60.90) - open/close/unlink 10000 (time 1775832646.87 total 176.25 last 63.52) - open/close/unlink 10666 (time 1775832656.87 total 186.25 last 66.59) - open/close/unlink 11285 (time 1775832666.89 total 196.26 last 61.80) - open/close/unlink 11983 (time 1775832676.89 total 206.27 last 69.77) - open/close/unlink 12748 (time 1775832686.90 total 216.27 last 76.48) - open/close/unlink 13504 (time 1775832696.91 total 226.28 last 75.52) - open/close/unlink 14289 (time 1775832706.91 total 236.29 last 78.48) - open/close/unlink 15017 (time 1775832716.92 total 246.29 last 72.73) - open/close/unlink 15947 (time 1775832726.93 total 256.30 last 92.93) - open/close/unlink 16746 (time 1775832736.93 total 266.31 last 79.86) - open/close/unlink 17684 (time 1775832746.94 total 276.32 last 93.71) - open/close/unlink 18480 (time 1775832756.95 total 286.32 last 79.57) - open/close/unlink 19438 (time 1775832766.96 total 296.33 last 95.71) - open/close/unlink 20000 (time 1775832773.31 total 302.68 last 88.45) - open/close/unlink 20773 (time 1775832783.31 total 312.69 last 77.25) - open/close/unlink 21536 (time 1775832793.33 total 322.70 last 76.20) - open/close/unlink 22325 (time 1775832803.34 total 332.71 last 78.80) - open/close/unlink 23123 (time 1775832813.35 total 342.73 last 79.69) - open/close/unlink 24012 (time 1775832823.35 total 352.73 last 88.89) - open/close/unlink 24758 (time 1775832833.36 total 362.74 last 74.55) - open/close/unlink 25449 (time 1775832843.40 total 372.77 last 68.85) - open/close/unlink 26276 (time 1775832853.40 total 382.77 last 82.69) - open/close/unlink 27221 (time 1775832863.41 total 392.79 last 94.38) - open/close/unlink 28130 (time 1775832873.41 total 402.79 last 90.88) - open/close/unlink 29095 (time 1775832883.42 total 412.79 last 96.48) - open/close/unlink 29945 (time 1775832893.43 total 422.81 last 84.88) - open/close/unlink 30857 (time 1775832903.43 total 432.81 last 91.17) - open/close/unlink 31817 (time 1775832913.44 total 442.81 last 95.98) - open/close/unlink 32867 (time 1775832923.45 total 452.82 last 104.86) - open/close/unlink 33851 (time 1775832933.46 total 462.83 last 98.31) - open/close/unlink 34738 (time 1775832943.47 total 472.84 last 88.64) - open/close/unlink 35799 (time 1775832953.47 total 482.84 last 106.09) - open/close/unlink 36894 (time 1775832963.47 total 492.85 last 109.42) - open/close/unlink 37852 (time 1775832973.47 total 502.85 last 95.80) - open/close/unlink 38759 (time 1775832983.48 total 512.86 last 90.63) - open/close/unlink 39874 (time 1775832993.49 total 522.86 last 111.43) - open/close/unlink 40917 (time 1775833003.49 total 532.87 last 104.24) - open/close/unlink 41930 (time 1775833013.51 total 542.88 last 101.15) - open/close/unlink 42840 (time 1775833023.51 total 552.89 last 90.95) - open/close/unlink 43740 (time 1775833033.52 total 562.90 last 89.92) - open/close - open/close/unlink 526 (time 1775832480.58 total 10.01 last 52.56) - open/close/unlink 995 (time 1775832490.59 total 20.02 last 46.83) - open/close/unlink 1504 (time 1775832500.60 total 30.03 last 50.84) - open/close/unlink 2041 (time 1775832510.61 total 40.04 last 53.67) - open/close/unlink 2574 (time 1775832520.63 total 50.06 last 53.21) - open/close/unlink 3071 (time 1775832530.63 total 60.06 last 49.68) - open/close/unlink 3557 (time 1775832540.64 total 70.07 last 48.55) - open/close/unlink 4096 (time 1775832550.64 total 80.07 last 53.88) - open/close/unlink 4663 (time 1775832560.65 total 90.08 last 56.68) - open/close/unlink 5250 (time 1775832570.66 total 100.09 last 58.61) - open/close/unlink 5857 (time 1775832580.67 total 110.10 last 60.66) - open/close/unlink 6455 (time 1775832590.68 total 120.11 last 59.71) - open/close/unlink 7031 (time 1775832600.70 total 130.13 last 57.52) - open/close/unlink 7657 (time 1775832610.71 total 140.14 last 62.54) - open/close/unlink 8318 (time 1775832620.72 total 150.15 last 66.00) - open/close/unlink 8974 (time 1775832630.73 total 160.16 last 65.52) - open/close/unlink 9576 (time 1775832640.74 total 170.17 last 60.15) - open/close/unlink 10000 (time 1775832647.34 total 176.77 last 64.24) - open/close/unlink 10662 (time 1775832657.35 total 186.78 last 66.15) - open/close/unlink 11285 (time 1775832667.36 total 196.79 last 62.22) - open/close/unlink 12009 (time 1775832677.36 total 206.79 last 72.39) - open/close/unlink 12773 (time 1775832687.37 total 216.80 last 76.34) - open/close/unlink 13520 (time 1775832697.39 total 226.82 last 74.55) - open/close/unlink 14309 (time 1775832707.41 total 236.84 last 78.76) - open/close/unlink 15042 (time 1775832717.41 total 246.84 last 73.27) - open/close/unlink 15971 (time 1775832727.43 total 256.86 last 92.76) - open/close/unlink 16775 (time 1775832737.45 total 266.88 last 80.26) - open/close/unlink 17711 (time 1775832747.45 total 276.88 last 93.53) - open/close/unlink 18511 (time 1775832757.46 total 286.89 last 79.91) - open/close/unlink 19451 (time 1775832767.48 total 296.90 last 93.89) - open/close/unlink 20000 (time 1775832773.64 total 303.06 last 89.13) - open/close/unlink 20761 (time 1775832783.64 total 313.07 last 76.08) - open/close/unlink 21525 (time 1775832793.64 total 323.07 last 76.37) - open/close/unlink 22297 (time 1775832803.65 total 333.08 last 77.15) - open/close/unlink 23100 (time 1775832813.66 total 343.08 last 80.25) - open/close/unlink 23993 (time 1775832823.66 total 353.09 last 89.27) - open/close/unlink 24730 (time 1775832833.66 total 363.09 last 73.67) - open/close/unlink 25419 (time 1775832843.66 total 373.09 last 68.90) - open/close/unlink 26274 (time 1775832853.67 total 383.09 last 85.49) - open/close/unlink 27219 (time 1775832863.67 total 393.10 last 94.42) - open/close/unlink 28134 (time 1775832873.67 total 403.10 last 91.50) - open/close/unlink 29090 (time 1775832883.68 total 413.11 last 95.55) - open/close/unlink 29940 (time 1775832893.69 total 423.12 last 84.90) - open/close/unlink 30857 (time 1775832903.70 total 433.13 last 91.61) - open/close/unlink 31810 (time 1775832913.71 total 443.14 last 95.24) - open/close/unlink 32844 (time 1775832923.71 total 453.14 last 103.35) - open/close/unlink 33817 (time 1775832933.72 total 463.15 last 97.22) - open/close/unlink 34706 (time 1775832943.73 total 473.15 last 88.85) - open/close/unlink 35766 (time 1775832953.73 total 483.16 last 105.98) - open/close/unlink 36866 (time 1775832963.73 total 493.16 last 109.98) - open/close/unlink 37817 (time 1775832973.74 total 503.17 last 95.03) - open/close/unlink 38750 (time 1775832983.74 total 513.17 last 93.26) - open/close/unlink 39869 (time 1775832993.75 total 523.18 last 111.81) - open/close/unlink 40908 (time 1775833003.75 total 533.18 last 103.84) - open/close/unlink 41914 (time 1775833013.76 total 543.18 last 100.60) - open/close/unlink 42826 (time 1775833023.76 total 553.18 last 91.19) - open/close/unlink 43732 (time 1775833033.76 total 563.19 last 90.59) - open/close//unlink 44646 (time 1775833043.17 total 572.63 last 90.16) - open/close/unlink 45586 (time 1775833053.19 total 582.65 last 93.88) - open/close/unlink 46569 (time 1775833063.19 total 592.65 last 98.27) - open/close/unlink 47622 (time 1775833073.20 total 602.66 last 105.15) - open/close/unlink 48758 (time 1775833083.21 total 612.67 last 113.51) - open/close/unlink 49857 (time 1775833093.21 total 622.68 last 109.86) - open/close/unlink 51048 (time 1775833103.22 total 632.68 last 119.06) - open/close/unlink 52111 (time 1775833113.22 total 642.68 last 106.26) - open/close/unlink 53267 (time 1775833123.22 total 652.68 last 115.59) - open/close/unlink 54449 (time 1775833133.24 total 662.70 last 117.99) - open/close/unlink 55655 (time 1775833143.25 total 672.71 last 120.51) - open/close/unlink 56885 (time 1775833153.27 total 682.73 last 122.77) - open/close/unlink 58240 (time 1775833163.27 total 692.73 last 135.45) - open/close/unlink 59653 (time 1775833173.27 total 702.74 last 141.25) - open/close/unlink 60000 (time 1775833175.61 total 705.08 last 148.22) - open/close/unlink 61658 (time 1775833185.63 total 715.09 last 165.56) - open/close/unlink 63173 (time 1775833195.63 total 725.10 last 151.43) - open/close/unlink 64544 (time 1775833205.64 total 735.10 last 137.04) total: 64768 open/close/unlink in 736.99 seconds: 87.88 ops/second /unlink 44646 (time 1775833043.53 total 572.92 last 90.19) - open/close/unlink 45595 (time 1775833053.53 total 582.92 last 94.88) - open/close/unlink 46579 (time 1775833063.53 total 592.92 last 98.36) - open/close/unlink 47646 (time 1775833073.54 total 602.93 last 106.65) - open/close/unlink 48777 (time 1775833083.54 total 612.93 last 113.03) - open/close/unlink 49875 (time 1775833093.55 total 622.94 last 109.73) - open/close/unlink 51061 (time 1775833103.55 total 632.94 last 118.57) - open/close/unlink 52126 (time 1775833113.55 total 642.95 last 106.47) - open/close/unlink 53280 (time 1775833123.56 total 652.95 last 115.32) - open/close/unlink 54468 (time 1775833133.57 total 662.96 last 118.69) - open/close/unlink 55677 (time 1775833143.57 total 672.96 last 120.89) - open/close/unlink 56912 (time 1775833153.57 total 682.96 last 123.48) - open/close/unlink 58271 (time 1775833163.57 total 692.97 last 135.85) - open/close/unlink 59662 (time 1775833173.58 total 702.97 last 139.07) - open/close/unlink 60000 (time 1775833175.81 total 705.21 last 151.20) - open/close/unlink 61652 (time 1775833185.82 total 715.21 last 165.14) - open/close/unlink 63155 (time 1775833195.82 total 725.21 last 150.25) - open/close/unlink 64530 (time 1775833205.82 total 735.21 last 137.49) total: 64768 open/close/unlink in 737.58 seconds: 87.81 ops/second unlink 44623 (time 1775833043.50 total 572.81 last 90.53) - open/close/unlink 45569 (time 1775833053.50 total 582.81 last 94.59) - open/close/unlink 46556 (time 1775833063.50 total 592.81 last 98.68) - open/close/unlink 47622 (time 1775833073.51 total 602.82 last 106.52) - open/close/unlink 48752 (time 1775833083.52 total 612.83 last 112.91) - open/close/unlink 49848 (time 1775833093.52 total 622.83 last 109.56) - open/close/unlink 51045 (time 1775833103.53 total 632.84 last 119.67) - open/close/unlink 52121 (time 1775833113.53 total 642.84 last 107.51) - open/close/unlink 53274 (time 1775833123.54 total 652.85 last 115.28) - open/close/unlink 54456 (time 1775833133.54 total 662.85 last 118.19) - open/close/unlink 55663 (time 1775833143.54 total 672.85 last 120.62) - open/close/unlink 56899 (time 1775833153.54 total 682.85 last 123.58) - open/close/unlink 58261 (time 1775833163.55 total 692.86 last 136.16) - open/close/unlink 59655 (time 1775833173.55 total 702.86 last 139.40) - open/close/unlink 60000 (time 1775833175.86 total 705.17 last 149.05) - open/close/unlink 61651 (time 1775833185.87 total 715.18 last 165.00) - open/close/unlink 63154 (time 1775833195.87 total 725.18 last 150.29) - open/close/unlink 64529 (time 1775833205.87 total 735.18 last 137.45) total: 64768 open/close/unlink in 737.68 seconds: 87.80 ops/second /unlink 44640 (time 1775833043.53 total 572.90 last 89.94) - open/close/unlink 45579 (time 1775833053.54 total 582.91 last 93.85) - open/close/unlink 46558 (time 1775833063.54 total 592.92 last 97.85) - open/close/unlink 47629 (time 1775833073.55 total 602.93 last 106.98) - open/close/unlink 48752 (time 1775833083.56 total 612.93 last 112.26) - open/close/unlink 49847 (time 1775833093.56 total 622.93 last 109.49) - open/close/unlink 51020 (time 1775833103.56 total 632.93 last 117.27) - open/close/unlink 52079 (time 1775833113.56 total 642.94 last 105.86) - open/close/unlink 53237 (time 1775833123.57 total 652.94 last 115.76) - open/close/unlink 54420 (time 1775833133.57 total 662.94 last 118.28) - open/close/unlink 55617 (time 1775833143.58 total 672.95 last 119.61) - open/close/unlink 56854 (time 1775833153.58 total 682.95 last 123.64) - open/close/unlink 58216 (time 1775833163.58 total 692.96 last 136.17) - open/close/unlink 59625 (time 1775833173.59 total 702.96 last 140.85) - open/close/unlink 60000 (time 1775833176.03 total 705.41 last 153.22) - open/close/unlink 61653 (time 1775833186.04 total 715.41 last 165.22) - open/close/unlink 63173 (time 1775833196.04 total 725.41 last 151.99) - open/close/unlink 64535 (time 1775833206.05 total 735.42 last 136.11) total: 64768 open/close/unlink in 738.04 seconds: 87.76 ops/second unlink 44640 (time 1775833043.76 total 573.19 last 90.74) - open/close/unlink 45584 (time 1775833053.77 total 583.20 last 94.35) - open/close/unlink 46570 (time 1775833063.77 total 593.20 last 98.57) - open/close/unlink 47632 (time 1775833073.78 total 603.21 last 106.12) - open/close/unlink 48779 (time 1775833083.79 total 613.22 last 114.58) - open/close/unlink 49887 (time 1775833093.80 total 623.23 last 110.73) - open/close/unlink 51066 (time 1775833103.80 total 633.23 last 117.89) - open/close/unlink 52137 (time 1775833113.80 total 643.23 last 107.10) - open/close/unlink 53284 (time 1775833123.80 total 653.23 last 114.66) - open/close/unlink 54469 (time 1775833133.81 total 663.24 last 118.43) - open/close/unlink 55648 (time 1775833143.82 total 673.25 last 117.77) - open/close/unlink 56884 (time 1775833153.82 total 683.25 last 123.59) - open/close/unlink 58251 (time 1775833163.82 total 693.25 last 136.65) - open/close/unlink 59650 (time 1775833173.83 total 703.25 last 139.86) - open/close/unlink 60000 (time 1775833176.16 total 705.59 last 149.82) - open/close/unlink 61652 (time 1775833186.16 total 715.59 last 165.16) - open/close/unlink 63172 (time 1775833196.17 total 725.60 last 151.94) - open/close/unlink 64526 (time 1775833206.18 total 735.60 last 135.31) total: 64768 open/close/unlink in 738.46 seconds: 87.71 ops/second Waiting for MDT destroys to complete oleg340-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg340-client: oleg340-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg340-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg340-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg340-server stop mds service on oleg340-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg340-server stop mds service on oleg340-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg340-server unloading modules via unload_modules_local on: 'oleg340-server' oleg340-server: oleg340-server.virtnet: executing unload_modules_local oleg340-server: modules unloaded. pdsh@oleg340-client: oleg340-client: ssh exited with exit code 2 pdsh@oleg340-client: oleg340-server: ssh exited with exit code 2 pdsh@oleg340-client: oleg340-client: ssh exited with exit code 2 pdsh@oleg340-client: oleg340-server: ssh exited with exit code 2 PASS 106 (816s) Stopping clients: oleg340-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg340-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg340-client: oleg340-server: ssh exited with exit code 2 oleg340-server: oleg340-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg340-server' oleg340-server: oleg340-server.virtnet: executing load_modules_local oleg340-server: Loading modules from /home/green/git/lustre-release/lustre oleg340-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg340-server: detected 4 online CPUs by sysfs oleg340-server: MODOPTS_LIBCFS= oleg340-server: Force libcfs to create 2 CPU partitions oleg340-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg340-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg340-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1032 sec ========== 11:01:10 (1775833270) === conf-sanity: start cleanup 11:01:10 (1775833270) === === conf-sanity: finish cleanup 11:01:12 (1775833272) ===