-----============= acceptance-small: conf-sanity ============----- Mon Sep 14 02:22:29 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg237-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683398 >= 34553653) for LU-16938, go 81 - see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683398 >= 34554143) for LU-18348, go 32b 32c - see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683398 >= 34617107) for LU-17920, go 123ae 123ag - see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683398 >= 34681950) for LU-19740, go 115 excepting tests: 32newtarball Stopping clients: oleg237-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg237-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg237-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg237-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg237-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg237-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg237-server oleg237-server: oleg237-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg237-server' oleg237-server: oleg237-server.virtnet: executing load_modules_local oleg237-server: kmemleak disabled oleg237-server: Loading modules from /home/green/git/lustre-release/lustre oleg237-server: detected 4 online CPUs by sysfs oleg237-server: MODOPTS_LIBCFS= oleg237-server: Force libcfs to create 2 CPU partitions oleg237-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg237-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg237-server: oleg237-server.virtnet: executing set_default_debug -1 all pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg237-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg237-server: oleg237-server.virtnet: executing set_default_debug -1 all pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg237-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg237-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg237-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg237-server: oleg237-server.virtnet: executing set_default_debug -1 all pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg237-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg237-server: oleg237-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg237-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg237-server: oleg237-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 oleg237-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg237-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg237-server stop mds service on oleg237-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg237-server stop mds service on oleg237-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg237-server == conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 02:24:59 (1789367099) start mds service on oleg237-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg237-server: oleg237-server.virtnet: executing set_default_debug -1 all pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg237-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg237-server: oleg237-server.virtnet: executing set_default_debug -1 all pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg237-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg237-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg237-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg237-server: oleg237-server.virtnet: executing set_default_debug -1 all pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 Started lustre-OST0000 oleg237-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg237-client.virtnet: -o user_xattr,flock 192.168.202.137@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 79992 274 79718 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 79992 255 79737 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 50000 433 49567 1% /mnt/lustre[OST:0] filesystem_summary: 50096 529 49567 2% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close/unlink 520 (time 1789367154.55 total 10.01 last 51.96) - open/close/unlink 1030 (time 1789367164.57 total 20.03 last 50.91) - open/close/unlink 1613 (time 1789367174.57 total 30.03 last 58.29) - open/close/unlink 2214 (time 1789367184.59 total 40.05 last 59.98) - open/close/unlink 2806 (time 1789367194.60 total 50.05 last 59.16) - open/close/unlink 3386 (time 1789367204.60 total 60.06 last 57.98) - open/close/unlink 3967 (time 1789367214.60 total 70.06 last 58.08) - open/close/unlink 4664 (time 1789367224.61 total 80.07 last 69.63) - open/close/unlink 5374 (time 1789367234.62 total 90.08 last 70.94) - open/close/unlink 5987 (time 1789367244.63 total 100.09 last 61.26) - open/close/unlink 6713 (time 1789367254.64 total 110.10 last 72.49) - open/close/unlink 7365 (time 1789367264.65 total 120.10 last 65.17) - open/close/unlink 8085 (time 1789367274.67 total 130.13 last 71.84) - open/close/unlink 8627 (time 1789367284.68 total 140.14 last 54.15) - open/close/unlink 9327 (time 1789367294.68 total 150.14 last 69.97) - open/close/unlink 9871 (time 1789367304.70 total 160.15 last 54.33) - open/close/unlink 10000 (time 1789367306.87 total 162.32 last 59.42) - open/close/unlink 10586 (time 1789367316.87 total 172.33 last 58.55) - open/close/unlink 11222 (time 1789367326.88 total 182.34 last 63.57) - open/close/unlink 11758 (time 1789367336.88 total 192.34 last 53.59) - open/close/unlink 12273 (time 1789367346.88 total 202.34 last 51.49) - open/close/unlink 12832 (time 1789367356.89 total 212.35 last 55.85) - open/close/unlink 13426 (time 1789367366.90 total 222.36 last 59.32) - open/close/unlink 14082 (time 1789367376.92 total 232.38 last 65.50) - open/close/unlink 14786 (time 1789367386.93 total 242.38 last 70.36) - open/close/unlink 15397 (time 1789367396.93 total 252.38 last 61.10) - open/close/unlink 16014 (time 1789367406.93 total 262.39 last 61.67) - open/close/unlink 16733 (time 1789367416.94 total 272.39 last 71.86) - open/close/unlink 17368 (time 1789367426.94 total 282.40 last 63.48) - open/close/unlink 18023 (time 1789367436.94 total 292.40 last 65.49) - open/close/unlink 18726 (time 1789367446.95 total 302.41 last 70.25) - open/close/unlink 19569 (time 1789367456.96 total 312.41 last 84.24) - open/close/unlink 20000 (time 1789367461.78 total 317.23 last 89.44) - open/close/unlink 20682 (time 1789367471.78 total 327.24 last 68.16) - open/close/unlink 21510 (time 1789367481.79 total 337.25 last 82.74) - open/close/unlink 22343 (time 1789367491.80 total 347.25 last 83.24) - open/close/unlink 23155 (time 1789367501.80 total 357.26 last 81.19) - open/close/unlink 23996 (time 1789367511.80 total 367.26 last 84.09) - open/close/unlink 24722 (time 1789367521.82 total 377.28 last 72.42) - open/close/unlink 25310 (time 1789367531.84 total 387.30 last 58.70) - open/close/unlink 25995 (time 1789367541.86 total 397.31 last 68.40) - open/close/unlink 26643 (time 1789367551.87 total 407.33 last 64.68) - open/close/unlink 27310 (time 1789367561.91 total 417.37 last 66.47) - open/close/unlink 27975 (time 1789367571.92 total 427.37 last 66.45) - open/close/unlink 28863 (time 1789367581.92 total 437.38 last 88.76) - open/close/unlink 29593 (time 1789367591.93 total 447.39 last 72.92) - open/close/unlink 30000 (time 1789367597.22 total 452.67 last 77.03) - open/close/unlink 30715 (time 1789367607.22 total 462.68 last 71.45) - open/close/unlink 31380 (time 1789367617.23 total 472.69 last 66.47) - open/close/unlink 32040 (time 1789367627.23 total 482.69 last 65.97) - open/close/unlink 32870 (time 1789367637.23 total 492.69 last 82.97) - open/close/unlink 33626 (time 1789367647.24 total 502.70 last 75.56) - open/close/unlink 34424 (time 1789367657.25 total 512.71 last 79.74) - open/close/unlink 35234 (time 1789367667.25 total 522.71 last 80.98) - open/close/unlink 36004 (time 1789367677.28 total 532.73 last 76.80) - open/close/unlink 36698 (time 1789367687.28 total 542.74 last 69.36) - open/close/unlink 37367 (time 1789367697.29 total 552.74 last 66.87) - open/close/unli - open/close/unlink 518 (time 1789367154.56 total 10.03 last 51.65) - open/close/unlink 1030 (time 1789367164.57 total 20.03 last 51.18) - open/close/unlink 1627 (time 1789367174.57 total 30.04 last 59.68) - open/close/unlink 2222 (time 1789367184.58 total 40.05 last 59.42) - open/close/unlink 2810 (time 1789367194.59 total 50.06 last 58.75) - open/close/unlink 3393 (time 1789367204.60 total 60.06 last 58.28) - open/close/unlink 3972 (time 1789367214.60 total 70.07 last 57.87) - open/close/unlink 4668 (time 1789367224.61 total 80.08 last 69.53) - open/close/unlink 5374 (time 1789367234.61 total 90.08 last 70.59) - open/close/unlink 5993 (time 1789367244.62 total 100.08 last 61.88) - open/close/unlink 6714 (time 1789367254.63 total 110.10 last 71.99) - open/close/unlink 7367 (time 1789367264.64 total 120.11 last 65.23) - open/close/unlink 8090 (time 1789367274.66 total 130.12 last 72.20) - open/close/unlink 8632 (time 1789367284.68 total 140.15 last 54.08) - open/close/unlink 9328 (time 1789367294.68 total 150.15 last 69.60) - open/close/unlink 9877 (time 1789367304.68 total 160.15 last 54.87) - open/close/unlink 10000 (time 1789367306.78 total 162.24 last 58.84) - open/close/unlink 10576 (time 1789367316.79 total 172.25 last 57.53) - open/close/unlink 11214 (time 1789367326.80 total 182.26 last 63.75) - open/close/unlink 11748 (time 1789367336.80 total 192.27 last 53.38) - open/close/unlink 12265 (time 1789367346.81 total 202.28 last 51.64) - open/close/unlink 12830 (time 1789367356.82 total 212.29 last 56.44) - open/close/unlink 13421 (time 1789367366.82 total 222.29 last 59.10) - open/close/unlink 14078 (time 1789367376.83 total 232.29 last 65.68) - open/close/unlink 14769 (time 1789367386.83 total 242.29 last 69.09) - open/close/unlink 15374 (time 1789367396.83 total 252.29 last 60.49) - open/close/unlink 16002 (time 1789367406.83 total 262.30 last 62.77) - open/close/unlink 16721 (time 1789367416.84 total 272.31 last 71.81) - open/close/unlink 17351 (time 1789367426.85 total 282.32 last 62.96) - open/close/unlink 18013 (time 1789367436.87 total 292.33 last 66.11) - open/close/unlink 18720 (time 1789367446.87 total 302.34 last 70.65) - open/close/unlink 19559 (time 1789367456.88 total 312.34 last 83.86) - open/close/unlink 20000 (time 1789367461.95 total 317.42 last 86.88) - open/close/unlink 20692 (time 1789367471.96 total 327.43 last 69.16) - open/close/unlink 21534 (time 1789367481.96 total 337.43 last 84.17) - open/close/unlink 22340 (time 1789367491.98 total 347.44 last 80.48) - open/close/unlink 23145 (time 1789367501.98 total 357.45 last 80.48) - open/close/unlink 23985 (time 1789367511.99 total 367.45 last 83.96) - open/close/unlink 24704 (time 1789367522.01 total 377.47 last 71.76) - open/close/unlink 25293 (time 1789367532.01 total 387.48 last 58.85) - open/close/unlink 25978 (time 1789367542.03 total 397.49 last 68.42) - open/close/unlink 26623 (time 1789367552.03 total 407.49 last 64.50) - open/close/unlink 27295 (time 1789367562.04 total 417.50 last 67.11) - open/close/unlink 27957 (time 1789367572.04 total 427.51 last 66.17) - open/close/unlink 28833 (time 1789367582.05 total 437.52 last 87.49) - open/close/unlink 29568 (time 1789367592.06 total 447.52 last 73.49) - open/close/unlink 30000 (time 1789367597.70 total 453.17 last 76.49) - open/close/unlink 30698 (time 1789367607.71 total 463.18 last 69.73) - open/close/unlink 31371 (time 1789367617.72 total 473.18 last 67.29) - open/close/unlink 32026 (time 1789367627.72 total 483.18 last 65.50) - open/close/unlink 32867 (time 1789367637.73 total 493.20 last 83.97) - open/close/unlink 33603 (time 1789367647.75 total 503.21 last 73.50) - open/close/unlink 34416 (time 1789367657.75 total 513.22 last 81.27) - open/close/unlink 35225 (time 1789367667.76 total 523.23 last 80.82) - open/close/unlink 35985 (time 1789367677.77 total 533.23 last 75.94) - open/close/unlink 36697 (time 1789367687.79 total 543.25 last 71.06) - open/close/unlink 37383 (time 1789367697.79 total 553.26 last 68.57) - open/close/unli - open/close/unlink 522 (time 1789367154.43 total 10.00 last 52.19) - open/close/unlink 1027 (time 1789367164.44 total 20.01 last 50.47) - open/close/unlink 1611 (time 1789367174.44 total 30.01 last 58.38) - open/close/unlink 2204 (time 1789367184.45 total 40.02 last 59.27) - open/close/unlink 2800 (time 1789367194.46 total 50.03 last 59.54) - open/close/unlink 3377 (time 1789367204.46 total 60.03 last 57.67) - open/close/unlink 3956 (time 1789367214.48 total 70.05 last 57.81) - open/close/unlink 4663 (time 1789367224.50 total 80.07 last 70.53) - open/close/unlink 5365 (time 1789367234.50 total 90.07 last 70.18) - open/close/unlink 5987 (time 1789367244.52 total 100.09 last 62.09) - open/close/unlink 6703 (time 1789367254.53 total 110.11 last 71.50) - open/close/unlink 7355 (time 1789367264.55 total 120.12 last 65.11) - open/close/unlink 8078 (time 1789367274.56 total 130.13 last 72.22) - open/close/unlink 8615 (time 1789367284.57 total 140.14 last 53.65) - open/close/unlink 9321 (time 1789367294.57 total 150.14 last 70.56) - open/close/unlink 9862 (time 1789367304.59 total 160.16 last 54.04) - open/close/unlink 10000 (time 1789367306.88 total 162.45 last 60.17) - open/close/unlink 10576 (time 1789367316.89 total 172.47 last 57.51) - open/close/unlink 11213 (time 1789367326.90 total 182.47 last 63.69) - open/close/unlink 11750 (time 1789367336.90 total 192.48 last 53.65) - open/close/unlink 12267 (time 1789367346.91 total 202.48 last 51.66) - open/close/unlink 12829 (time 1789367356.92 total 212.49 last 56.18) - open/close/unlink 13420 (time 1789367366.95 total 222.52 last 58.93) - open/close/unlink 14072 (time 1789367376.95 total 232.52 last 65.15) - open/close/unlink 14764 (time 1789367386.98 total 242.55 last 69.03) - open/close/unlink 15383 (time 1789367396.99 total 252.56 last 61.85) - open/close/unlink 16014 (time 1789367407.00 total 262.58 last 62.99) - open/close/unlink 16732 (time 1789367417.02 total 272.59 last 71.72) - open/close/unlink 17374 (time 1789367427.03 total 282.60 last 64.12) - open/close/unlink 18031 (time 1789367437.04 total 292.61 last 65.66) - open/close/unlink 18731 (time 1789367447.04 total 302.61 last 69.95) - open/close/unlink 19573 (time 1789367457.05 total 312.62 last 84.12) - open/close/unlink 20000 (time 1789367461.90 total 317.47 last 88.08) - open/close/unlink 20687 (time 1789367471.90 total 327.48 last 68.67) - open/close/unlink 21527 (time 1789367481.91 total 337.48 last 83.97) - open/close/unlink 22337 (time 1789367491.91 total 347.48 last 80.98) - open/close/unlink 23141 (time 1789367501.92 total 357.50 last 80.29) - open/close/unlink 23976 (time 1789367511.94 total 367.51 last 83.39) - open/close/unlink 24691 (time 1789367521.95 total 377.52 last 71.39) - open/close/unlink 25284 (time 1789367531.96 total 387.54 last 59.24) - open/close/unlink 25963 (time 1789367541.98 total 397.55 last 67.83) - open/close/unlink 26608 (time 1789367551.99 total 407.56 last 64.42) - open/close/unlink 27276 (time 1789367562.00 total 417.57 last 66.75) - open/close/unlink 27940 (time 1789367572.00 total 427.57 last 66.35) - open/close/unlink 28821 (time 1789367582.01 total 437.58 last 88.02) - open/close/unlink 29550 (time 1789367592.02 total 447.59 last 72.86) - open/close/unlink 30000 (time 1789367597.77 total 453.34 last 78.19) - open/close/unlink 30690 (time 1789367607.78 total 463.35 last 68.93) - open/close/unlink 31364 (time 1789367617.79 total 473.36 last 67.38) - open/close/unlink 32011 (time 1789367627.79 total 483.36 last 64.67) - open/close/unlink 32856 (time 1789367637.79 total 493.36 last 84.50) - open/close/unlink 33595 (time 1789367647.80 total 503.37 last 73.86) - open/close/unlink 34415 (time 1789367657.80 total 513.37 last 82.00) - open/close/unlink 35215 (time 1789367667.80 total 523.37 last 79.97) - open/close/unlink 35972 (time 1789367677.81 total 533.39 last 75.61) - open/close/unlink 36687 (time 1789367687.82 total 543.39 last 71.45) - open/close/unlink 37380 (time 1789367697.84 total 553.41 last 69.19) - open/close/unli - open/close/unlink 523 (time 1789367154.47 total 10.00 last 52.29) - open/close/unlink 1027 (time 1789367164.48 total 20.02 last 50.33) - open/close/unlink 1618 (time 1789367174.50 total 30.03 last 58.99) - open/close/unlink 2211 (time 1789367184.51 total 40.05 last 59.23) - open/close/unlink 2797 (time 1789367194.52 total 50.06 last 58.55) - open/close/unlink 3363 (time 1789367204.53 total 60.07 last 56.54) - open/close/unlink 3944 (time 1789367214.53 total 70.07 last 58.09) - open/close/unlink 4646 (time 1789367224.54 total 80.07 last 70.18) - open/close/unlink 5349 (time 1789367234.54 total 90.07 last 70.29) - open/close/unlink 5980 (time 1789367244.56 total 100.09 last 62.99) - open/close/unlink 6707 (time 1789367254.57 total 110.10 last 72.62) - open/close/unlink 7360 (time 1789367264.58 total 120.12 last 65.19) - open/close/unlink 8073 (time 1789367274.60 total 130.13 last 71.21) - open/close/unlink 8616 (time 1789367284.60 total 140.14 last 54.25) - open/close/unlink 9323 (time 1789367294.62 total 150.15 last 70.62) - open/close/unlink 9866 (time 1789367304.63 total 160.16 last 54.25) - open/close/unlink 10000 (time 1789367306.88 total 162.42 last 59.45) - open/close/unlink 10576 (time 1789367316.89 total 172.42 last 57.55) - open/close/unlink 11214 (time 1789367326.90 total 182.43 last 63.74) - open/close/unlink 11753 (time 1789367336.91 total 192.44 last 53.86) - open/close/unlink 12269 (time 1789367346.91 total 202.45 last 51.56) - open/close/unlink 12828 (time 1789367356.92 total 212.45 last 55.88) - open/close/unlink 13420 (time 1789367366.93 total 222.47 last 59.11) - open/close/unlink 14070 (time 1789367376.95 total 232.48 last 64.91) - open/close/unlink 14761 (time 1789367386.95 total 242.49 last 69.04) - open/close/unlink 15373 (time 1789367396.96 total 252.50 last 61.15) - open/close/unlink 15999 (time 1789367406.96 total 262.50 last 62.59) - open/close/unlink 16717 (time 1789367416.97 total 272.51 last 71.75) - open/close/unlink 17342 (time 1789367426.98 total 282.51 last 62.47) - open/close/unlink 18008 (time 1789367436.99 total 292.53 last 66.48) - open/close/unlink 18706 (time 1789367447.00 total 302.54 last 69.74) - open/close/unlink 19544 (time 1789367457.00 total 312.54 last 83.78) - open/close/unlink 20000 (time 1789367462.24 total 317.77 last 87.14) - open/close/unlink 20693 (time 1789367472.24 total 327.78 last 69.27) - open/close/unlink 21542 (time 1789367482.25 total 337.79 last 84.84) - open/close/unlink 22337 (time 1789367492.26 total 347.80 last 79.41) - open/close/unlink 23160 (time 1789367502.26 total 357.80 last 82.28) - open/close/unlink 23995 (time 1789367512.27 total 367.81 last 83.42) - open/close/unlink 24704 (time 1789367522.29 total 377.82 last 70.79) - open/close/unlink 25292 (time 1789367532.30 total 387.84 last 58.72) - open/close/unlink 25973 (time 1789367542.31 total 397.85 last 68.03) - open/close/unlink 26616 (time 1789367552.32 total 407.85 last 64.26) - open/close/unlink 27289 (time 1789367562.32 total 417.86 last 67.28) - open/close/unlink 27946 (time 1789367572.33 total 427.87 last 65.64) - open/close/unlink 28837 (time 1789367582.33 total 437.87 last 89.07) - open/close/unlink 29575 (time 1789367592.33 total 447.87 last 73.80) - open/close/unlink 30000 (time 1789367597.89 total 453.43 last 76.48) - open/close/unlink 30693 (time 1789367607.89 total 463.43 last 69.30) - open/close/unlink 31373 (time 1789367617.90 total 473.44 last 67.95) - open/close/unlink 32023 (time 1789367627.91 total 483.45 last 64.90) - open/close/unlink 32875 (time 1789367637.92 total 493.45 last 85.19) - open/close/unlink 33614 (time 1789367647.93 total 503.47 last 73.78) - open/close/unlink 34427 (time 1789367657.94 total 513.48 last 81.24) - open/close/unlink 35236 (time 1789367667.94 total 523.48 last 80.88) - open/close/unlink 35981 (time 1789367677.96 total 533.49 last 74.38) - open/close/unlink 36696 (time 1789367687.97 total 543.51 last 71.41) - open/close/unlink 37375 (time 1789367697.97 total 553.51 last 67.89) - open/close/unli - open/close/unlink 519 (time 1789367154.51 total 10.02 last 51.81) - open/close/unlink 1023 (time 1789367164.53 total 20.04 last 50.31) - open/close/unlink 1608 (time 1789367174.54 total 30.05 last 58.44) - open/close/unlink 2199 (time 1789367184.54 total 40.05 last 59.09) - open/close/unlink 2779 (time 1789367194.55 total 50.06 last 57.94) - open/close/unlink 3359 (time 1789367204.56 total 60.06 last 57.97) - open/close/unlink 3939 (time 1789367214.56 total 70.07 last 57.98) - open/close/unlink 4646 (time 1789367224.58 total 80.09 last 70.56) - open/close/unlink 5352 (time 1789367234.59 total 90.09 last 70.59) - open/close/unlink 5964 (time 1789367244.60 total 100.11 last 61.10) - open/close/unlink 6694 (time 1789367254.61 total 110.11 last 72.96) - open/close/unlink 7341 (time 1789367264.61 total 120.12 last 64.66) - open/close/unlink 8065 (time 1789367274.62 total 130.12 last 72.38) - open/close/unlink 8609 (time 1789367284.63 total 140.14 last 54.30) - open/close/unlink 9317 (time 1789367294.64 total 150.14 last 70.77) - open/close/unlink 9861 (time 1789367304.64 total 160.15 last 54.38) - open/close/unlink 10000 (time 1789367307.01 total 162.51 last 58.71) - open/close/unlink 10580 (time 1789367317.02 total 172.52 last 57.97) - open/close/unlink 11215 (time 1789367327.03 total 182.54 last 63.39) - open/close/unlink 11754 (time 1789367337.04 total 192.54 last 53.88) - open/close/unlink 12275 (time 1789367347.04 total 202.54 last 52.07) - open/close/unlink 12839 (time 1789367357.04 total 212.55 last 56.39) - open/close/unlink 13431 (time 1789367367.05 total 222.55 last 59.16) - open/close/unlink 14082 (time 1789367377.06 total 232.56 last 65.05) - open/close/unlink 14770 (time 1789367387.07 total 242.57 last 68.73) - open/close/unlink 15385 (time 1789367397.07 total 252.57 last 61.49) - open/close/unlink 16001 (time 1789367407.08 total 262.58 last 61.55) - open/close/unlink 16725 (time 1789367417.09 total 272.59 last 72.31) - open/close/unlink 17357 (time 1789367427.10 total 282.60 last 63.15) - open/close/unlink 18012 (time 1789367437.10 total 292.61 last 65.47) - open/close/unlink 18709 (time 1789367447.11 total 302.62 last 69.61) - open/close/unlink 19549 (time 1789367457.12 total 312.62 last 83.95) - open/close/unlink 20000 (time 1789367462.38 total 317.88 last 85.77) - open/close/unlink 20697 (time 1789367472.38 total 327.89 last 69.68) - open/close/unlink 21555 (time 1789367482.38 total 337.89 last 85.80) - open/close/unlink 22344 (time 1789367492.39 total 347.89 last 78.87) - open/close/unlink 23177 (time 1789367502.39 total 357.90 last 83.24) - open/close/unlink 24017 (time 1789367512.41 total 367.91 last 83.88) - open/close/unlink 24713 (time 1789367522.41 total 377.91 last 69.60) - open/close/unlink 25315 (time 1789367532.42 total 387.92 last 60.15) - open/close/unlink 25982 (time 1789367542.42 total 397.93 last 66.66) - open/close/unlink 26634 (time 1789367552.43 total 407.94 last 65.14) - open/close/unlink 27308 (time 1789367562.44 total 417.94 last 67.35) - open/close/unlink 27965 (time 1789367572.45 total 427.96 last 65.60) - open/close/unlink 28849 (time 1789367582.46 total 437.96 last 88.37) - open/close/unlink 29578 (time 1789367592.46 total 447.97 last 72.86) - open/close/unlink 30000 (time 1789367597.96 total 453.46 last 76.77) - open/close/unlink 30700 (time 1789367607.98 total 463.48 last 69.87) - open/close/unlink 31378 (time 1789367617.98 total 473.48 last 67.79) - open/close/unlink 32034 (time 1789367627.99 total 483.49 last 65.53) - open/close/unlink 32883 (time 1789367638.00 total 493.51 last 84.80) - open/close/unlink 33625 (time 1789367648.01 total 503.51 last 74.15) - open/close/unlink 34437 (time 1789367658.02 total 513.52 last 81.14) - open/close/unlink 35256 (time 1789367668.02 total 523.52 last 81.87) - open/close/unlink 36003 (time 1789367678.03 total 533.53 last 74.66) - open/close/unlink 36721 (time 1789367688.04 total 543.54 last 71.71) - open/close/unlink 37397 (time 1789367698.05 total 553.55 last 67.56) - open/close/unlink 38124 (time 1789367707.97 total 563.51 last 74.89) - open/close/unlink 39007 (time 1789367717.98 total 573.52 last 88.25) - open/close/unlink 39795 (time 1789367727.99 total 583.53 last 78.69) - open/close/unlink 40000 (time 1789367730.44 total 585.97 last 83.95) - open/close/unlink 40727 (time 1789367740.46 total 595.99 last 72.55) - open/close/unlink 41462 (time 1789367750.46 total 606.00 last 73.47) - open/close/unlink 42219 (time 1789367760.47 total 616.01 last 75.60) - open/close/unlink 42855 (time 1789367770.48 total 626.02 last 63.57) - open/close/unlink 43613 (time 1789367780.48 total 636.02 last 75.76) - open/close/unlink 44309 (time 1789367790.49 total 646.02 last 69.58) - open/close/unlink 45045 (time 1789367800.50 total 656.04 last 73.49) - open/close/unlink 45725 (time 1789367810.51 total 666.04 last 67.97) - open/close/unlink 46391 (time 1789367820.52 total 676.05 last 66.54) - open/close/unlink 46973 (time 1789367830.53 total 686.07 last 58.11) - open/close/unlink 47544 (time 1789367840.54 total 696.08 last 57.04) - open/close/unlink 48176 (time 1789367850.56 total 706.09 last 63.11) - open/close/unlink 48816 (time 1789367860.58 total 716.12 last 63.84) - open/close/unlink 49461 (time 1789367870.58 total 726.12 last 64.49) - open/close/unlink 50000 (time 1789367878.17 total 733.71 last 71.01) - open/close/unlink 50740 (time 1789367888.18 total 743.71 last 73.97) - open/close/unlink 51428 (time 1789367898.18 total 753.71 last 68.80) - open/close/unlink 52123 (time 1789367908.18 total 763.72 last 69.48) - open/close/unlink 52871 (time 1789367918.19 total 773.72 last 74.76) - open/close/unlink 53716 (time 1789367928.19 total 783.72 last 84.48) - open/close/unlink 54474 (time 1789367938.20 total 793.74 last 75.71) - open/close/unlink 55056 (time 1789367948.21 total 803.75 last 58.13) - open/close/unlink 55642 (time 1789367958.23 total 813.76 last 58.53) - open/close/unlink 56425 (time 1789367968.24 total 823.77 last 78.22) - open/close/unlink 57421 (time 1789367978.24 total 833.78 last 99.56) - open/close/unlink 58280 (time 1789367988.24 total 843.78 last 85.89) - open/close/unlink 59262 (time 1789367998.24 total 853.78 last 98.17) - open/close/unlink 60000 (time 1789368005.31 total 860.85 last 104.43) - open/close/unlink 61633 (time 1789368015.31 total 870.85 last 163.26) - open/close/unlink 63142 (time 1789368025.31 total 880.85 last 150.87) - open/close/unlink 64505 (time 1789368035.32 total 890.86 last 136.21) total: 64768 open/close/unlink in 893.08 seconds: 72.52 ops/second nk 38126 (time 1789367707.84 total 563.41 last 74.57) - open/close/unlink 39012 (time 1789367717.85 total 573.42 last 88.50) - open/close/unlink 39790 (time 1789367727.86 total 583.43 last 77.73) - open/close/unlink 40000 (time 1789367730.40 total 585.97 last 82.88) - open/close/unlink 40716 (time 1789367740.40 total 595.97 last 71.56) - open/close/unlink 41455 (time 1789367750.41 total 605.98 last 73.83) - open/close/unlink 42215 (time 1789367760.42 total 615.99 last 75.91) - open/close/unlink 42849 (time 1789367770.42 total 625.99 last 63.40) - open/close/unlink 43602 (time 1789367780.43 total 636.00 last 75.22) - open/close/unlink 44299 (time 1789367790.44 total 646.01 last 69.66) - open/close/unlink 45031 (time 1789367800.45 total 656.02 last 73.13) - open/close/unlink 45716 (time 1789367810.46 total 666.03 last 68.42) - open/close/unlink 46383 (time 1789367820.49 total 676.06 last 66.53) - open/close/unlink 46965 (time 1789367830.49 total 686.06 last 58.17) - open/close/unlink 47549 (time 1789367840.49 total 696.06 last 58.40) - open/close/unlink 48175 (time 1789367850.51 total 706.08 last 62.51) - open/close/unlink 48813 (time 1789367860.51 total 716.08 last 63.79) - open/close/unlink 49446 (time 1789367870.52 total 726.09 last 63.24) - open/close/unlink 50000 (time 1789367878.33 total 733.90 last 70.93) - open/close/unlink 50740 (time 1789367888.35 total 743.92 last 73.84) - open/close/unlink 51428 (time 1789367898.35 total 753.93 last 68.76) - open/close/unlink 52117 (time 1789367908.36 total 763.93 last 68.89) - open/close/unlink 52859 (time 1789367918.37 total 773.94 last 74.08) - open/close/unlink 53704 (time 1789367928.38 total 783.95 last 84.45) - open/close/unlink 54452 (time 1789367938.38 total 793.96 last 74.76) - open/close/unlink 55039 (time 1789367948.39 total 803.96 last 58.66) - open/close/unlink 55625 (time 1789367958.41 total 813.98 last 58.52) - open/close/unlink 56416 (time 1789367968.42 total 823.99 last 79.01) - open/close/unlink 57414 (time 1789367978.43 total 834.00 last 99.72) - open/close/unlink 58277 (time 1789367988.44 total 844.01 last 86.21) - open/close/unlink 59257 (time 1789367998.44 total 854.01 last 97.99) - open/close/unlink 60000 (time 1789368005.42 total 860.99 last 106.36) - open/close/unlink 61634 (time 1789368015.42 total 870.99 last 163.37) - open/close/unlink 63129 (time 1789368025.43 total 881.00 last 149.43) - open/close/unlink 64492 (time 1789368035.43 total 891.00 last 136.28) total: 64768 open/close/unlink in 893.40 seconds: 72.50 ops/second nk 38106 (time 1789367707.29 total 562.75 last 73.83) - open/close/unlink 38981 (time 1789367717.30 total 572.76 last 87.47) - open/close/unlink 39770 (time 1789367727.30 total 582.76 last 78.86) - open/close/unlink 40000 (time 1789367730.19 total 585.65 last 79.61) - open/close/unlink 40737 (time 1789367740.20 total 595.66 last 73.66) - open/close/unlink 41470 (time 1789367750.21 total 605.66 last 73.24) - open/close/unlink 42224 (time 1789367760.21 total 615.67 last 75.35) - open/close/unlink 42862 (time 1789367770.23 total 625.69 last 63.68) - open/close/unlink 43616 (time 1789367780.23 total 635.69 last 75.39) - open/close/unlink 44311 (time 1789367790.24 total 645.70 last 69.43) - open/close/unlink 45046 (time 1789367800.24 total 655.70 last 73.50) - open/close/unlink 45726 (time 1789367810.25 total 665.71 last 67.93) - open/close/unlink 46383 (time 1789367820.25 total 675.71 last 65.70) - open/close/unlink 46960 (time 1789367830.26 total 685.72 last 57.66) - open/close/unlink 47539 (time 1789367840.27 total 695.72 last 57.87) - open/close/unlink 48164 (time 1789367850.27 total 705.73 last 62.47) - open/close/unlink 48804 (time 1789367860.29 total 715.74 last 63.90) - open/close/unlink 49434 (time 1789367870.29 total 725.75 last 62.98) - open/close/unlink 50000 (time 1789367878.23 total 733.68 last 71.31) - open/close/unlink 50748 (time 1789367888.24 total 743.69 last 74.72) - open/close/unlink 51436 (time 1789367898.25 total 753.70 last 68.73) - open/close/unlink 52129 (time 1789367908.26 total 763.72 last 69.19) - open/close/unlink 52872 (time 1789367918.27 total 773.73 last 74.27) - open/close/unlink 53705 (time 1789367928.27 total 783.73 last 83.28) - open/close/unlink 54453 (time 1789367938.28 total 793.74 last 74.74) - open/close/unlink 55032 (time 1789367948.28 total 803.74 last 57.87) - open/close/unlink 55613 (time 1789367958.29 total 813.74 last 58.07) - open/close/unlink 56389 (time 1789367968.30 total 823.76 last 77.51) - open/close/unlink 57381 (time 1789367978.31 total 833.77 last 99.06) - open/close/unlink 58237 (time 1789367988.33 total 843.79 last 85.44) - open/close/unlink 59226 (time 1789367998.33 total 853.79 last 98.87) - open/close/unlink 60000 (time 1789368005.60 total 861.06 last 106.51) - open/close/unlink 61655 (time 1789368015.60 total 871.06 last 165.46) - open/close/unlink 63134 (time 1789368025.62 total 881.07 last 147.72) - open/close/unlink 64496 (time 1789368035.62 total 891.08 last 136.13) total: 64768 open/close/unlink in 893.62 seconds: 72.48 ops/second nk 38148 (time 1789367708.05 total 563.55 last 75.07) - open/close/unlink 39027 (time 1789367718.05 total 573.56 last 87.84) - open/close/unlink 39807 (time 1789367728.06 total 583.56 last 77.96) - open/close/unlink 40000 (time 1789367730.40 total 585.90 last 82.46) - open/close/unlink 40719 (time 1789367740.41 total 595.92 last 71.82) - open/close/unlink 41450 (time 1789367750.42 total 605.92 last 73.07) - open/close/unlink 42205 (time 1789367760.43 total 615.93 last 75.40) - open/close/unlink 42844 (time 1789367770.44 total 625.94 last 63.84) - open/close/unlink 43606 (time 1789367780.45 total 635.95 last 76.15) - open/close/unlink 44295 (time 1789367790.46 total 645.96 last 68.84) - open/close/unlink 45025 (time 1789367800.47 total 655.97 last 72.93) - open/close/unlink 45698 (time 1789367810.48 total 665.98 last 67.23) - open/close/unlink 46358 (time 1789367820.50 total 676.00 last 65.87) - open/close/unlink 46934 (time 1789367830.50 total 686.00 last 57.60) - open/close/unlink 47513 (time 1789367840.51 total 696.01 last 57.84) - open/close/unlink 48150 (time 1789367850.52 total 706.02 last 63.60) - open/close/unlink 48787 (time 1789367860.53 total 716.04 last 63.62) - open/close/unlink 49421 (time 1789367870.55 total 726.05 last 63.31) - open/close/unlink 50000 (time 1789367878.74 total 734.24 last 70.72) - open/close/unlink 50752 (time 1789367888.74 total 744.24 last 75.20) - open/close/unlink 51440 (time 1789367898.74 total 754.24 last 68.76) - open/close/unlink 52122 (time 1789367908.75 total 764.25 last 68.15) - open/close/unlink 52883 (time 1789367918.76 total 774.26 last 76.04) - open/close/unlink 53720 (time 1789367928.76 total 784.26 last 83.69) - open/close/unlink 54456 (time 1789367938.76 total 794.26 last 73.56) - open/close/unlink 55041 (time 1789367948.77 total 804.28 last 58.43) - open/close/unlink 55617 (time 1789367958.78 total 814.29 last 57.54) - open/close/unlink 56391 (time 1789367968.79 total 824.29 last 77.37) - open/close/unlink 57398 (time 1789367978.79 total 834.30 last 100.67) - open/close/unlink 58268 (time 1789367988.80 total 844.30 last 86.95) - open/close/unlink 59238 (time 1789367998.80 total 854.31 last 96.96) - open/close/unlink 60000 (time 1789368005.83 total 861.33 last 108.51) - open/close/unlink 61674 (time 1789368015.83 total 871.33 last 167.34) - open/close/unlink 63142 (time 1789368025.83 total 881.33 last 146.77) - open/close/unlink 64488 (time 1789368035.84 total 891.34 last 134.47) total: 64768 open/close/unlink in 894.03 seconds: 72.44 ops/second nk 38119 (time 1789367707.80 total 563.26 last 73.57) - open/close/unlink 39005 (time 1789367717.80 total 573.27 last 88.53) - open/close/unlink 39792 (time 1789367727.81 total 583.28 last 78.62) - open/close/unlink 40000 (time 1789367730.30 total 585.76 last 83.73) - open/close/unlink 40726 (time 1789367740.31 total 595.78 last 72.49) - open/close/unlink 41449 (time 1789367750.32 total 605.78 last 72.27) - open/close/unlink 42208 (time 1789367760.33 total 615.80 last 75.79) - open/close/unlink 42839 (time 1789367770.34 total 625.80 last 63.05) - open/close/unlink 43594 (time 1789367780.34 total 635.81 last 75.48) - open/close/unlink 44286 (time 1789367790.35 total 645.82 last 69.12) - open/close/unlink 45021 (time 1789367800.35 total 655.82 last 73.50) - open/close/unlink 45694 (time 1789367810.36 total 665.83 last 67.25) - open/close/unlink 46353 (time 1789367820.37 total 675.84 last 65.81) - open/close/unlink 46933 (time 1789367830.38 total 685.85 last 57.94) - open/close/unlink 47512 (time 1789367840.39 total 695.86 last 57.84) - open/close/unlink 48143 (time 1789367850.39 total 705.86 last 63.09) - open/close/unlink 48770 (time 1789367860.40 total 715.87 last 62.64) - open/close/unlink 49413 (time 1789367870.41 total 725.87 last 64.26) - open/close/unlink 50000 (time 1789367878.62 total 734.09 last 71.47) - open/close/unlink 50747 (time 1789367888.63 total 744.10 last 74.64) - open/close/unlink 51426 (time 1789367898.63 total 754.10 last 67.87) - open/close/unlink 52116 (time 1789367908.64 total 764.11 last 68.94) - open/close/unlink 52881 (time 1789367918.64 total 774.11 last 76.49) - open/close/unlink 53717 (time 1789367928.65 total 784.12 last 83.53) - open/close/unlink 54455 (time 1789367938.67 total 794.14 last 73.67) - open/close/unlink 55044 (time 1789367948.67 total 804.14 last 58.88) - open/close/unlink 55628 (time 1789367958.68 total 814.15 last 58.37) - open/close/unlink 56399 (time 1789367968.69 total 824.15 last 77.06) - open/close/unlink 57400 (time 1789367978.70 total 834.17 last 99.95) - open/close/unlink 58273 (time 1789367988.70 total 844.17 last 87.28) - open/close/unlink 59235 (time 1789367998.71 total 854.18 last 96.11) - open/close/unlink 60000 (time 1789368005.84 total 861.30 last 107.39) - open/close/unlink 61655 (time 1789368015.84 total 871.31 last 165.44) - open/close/unlink 63131 (time 1789368025.84 total 881.31 last 147.55) - open/close/unlink 64469 (time 1789368035.84 total 891.31 last 133.80) total: 64768 open/close/unlink in 894.37 seconds: 72.42 ops/second Waiting for MDT destroys to complete oleg237-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg237-client: oleg237-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 umount lustre on /mnt/lustre..... Stopping client oleg237-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg237-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg237-server stop mds service on oleg237-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg237-server stop mds service on oleg237-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg237-server unloading modules via unload_modules_local on: 'oleg237-server' oleg237-server: oleg237-server.virtnet: executing unload_modules_local oleg237-server: kmemleak disabled modules unloaded. pdsh@oleg237-client: oleg237-client: ssh exited with exit code 2 pdsh@oleg237-client: oleg237-server: ssh exited with exit code 2 pdsh@oleg237-client: oleg237-client: ssh exited with exit code 2 pdsh@oleg237-client: oleg237-server: ssh exited with exit code 2 PASS 106 (973s) Stopping clients: oleg237-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg237-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg237-client: oleg237-server: ssh exited with exit code 2 oleg237-server: oleg237-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x 1 green green 1921056 Sep 14 01:55 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg237-server' oleg237-server: oleg237-server.virtnet: executing load_modules_local oleg237-server: kmemleak disabled oleg237-server: Loading modules from /home/green/git/lustre-release/lustre oleg237-server: detected 4 online CPUs by sysfs oleg237-server: MODOPTS_LIBCFS= oleg237-server: Force libcfs to create 2 CPU partitions oleg237-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg237-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg237-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg237-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey == conf-sanity test complete, duration 1150 sec ========== 02:41:40 (1789368100) === conf-sanity: start cleanup 02:41:41 (1789368101) === === conf-sanity: finish cleanup 02:41:43 (1789368103) ===