-----============= acceptance-small: conf-sanity ============----- Thu Sep  3 08:26:21 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg413-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex
- see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683394 >= 34553653) for LU-16938, go 81
- see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683394 >= 34554143) for LU-18348, go 32b 32c
- see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683394 >= 34617107) for LU-17920, go 123ae 123ag
- see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683394 >= 34681950) for LU-19740, go 115
excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a
Stopping clients: oleg413-client.virtnet /mnt/lustre (opts:-f)
Stopping client oleg413-client.virtnet /mnt/lustre opts:-f
Stopping clients: oleg413-client.virtnet /mnt/lustre2 (opts:-f)
Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg413-server
oleg413-server: oleg413-server.virtnet: executing set_hostid
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg413-server'
oleg413-server: oleg413-server.virtnet: executing load_modules_local
oleg413-server: kmemleak disabled
oleg413-server: Loading modules from /home/green/git/lustre-release/lustre
oleg413-server: detected 4 online CPUs by sysfs
oleg413-server: MODOPTS_LIBCFS=
oleg413-server: Force libcfs to create 2 CPU partitions
oleg413-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
start mds service on oleg413-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Commit the device label on lustre-mdt1/mdt1
Started lustre-MDT0000
oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg413-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Commit the device label on lustre-ost1/ost1
Started lustre-OST0000
oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg413-server: oleg413-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg413-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
stop ost1 service on oleg413-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server
stop mds service on oleg413-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server

== conf-sanity test 45: long unlink handling in ptlrpcd == 08:29:18 (1788438558)
start mds service on oleg413-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg413-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-OST0000
oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg413-client.virtnet:  -o user_xattr,flock 192.168.204.113@tcp:/lustre /mnt/lustre
setup single mount lustre success
stop mds service on oleg413-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server
sleep 60 sec
fail_loc=0x8000050f
sleep 10 sec
manual umount lustre on /mnt/lustre....
df: /mnt/lustre: Input/output error
fail_loc=0x0
start mds service on oleg413-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg413-client.virtnet:  -o user_xattr,flock 192.168.204.113@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg413-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg413-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server
stop mds service on oleg413-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server
unloading modules via unload_modules_local on: 'oleg413-server'
oleg413-server: oleg413-server.virtnet: executing unload_modules_local
oleg413-server: kmemleak disabled
modules unloaded.
pdsh@oleg413-client: oleg413-client: ssh exited with exit code 2
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2
pdsh@oleg413-client: oleg413-client: ssh exited with exit code 2
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2
PASS 45 (213s)

== conf-sanity test 69: replace an OST with the same index ========================================================== 08:32:51 (1788438771)
start mds service on oleg413-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x  1 green green 1921056 Sep  3 07:51 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg413-server'
oleg413-server: oleg413-server.virtnet: executing load_modules_local
oleg413-server: kmemleak disabled
oleg413-server: Loading modules from /home/green/git/lustre-release/lustre
oleg413-server: detected 4 online CPUs by sysfs
oleg413-server: MODOPTS_LIBCFS=
oleg413-server: Force libcfs to create 2 CPU partitions
oleg413-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg413-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg413-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg413-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg413-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-OST0000
oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg413-client.virtnet:  -o user_xattr,flock 192.168.204.113@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
On OST0, 11904 inodes available. Want 99872. rc=0
 - open/close 655 (time 1788438852.24 total 10.01 last 65.41)
 - open/close 1285 (time 1788438862.24 total 20.02 last 62.98)
 - open/close 1843 (time 1788438872.28 total 30.06 last 55.58)
 - open/close 2448 (time 1788438882.30 total 40.08 last 60.38)
 - open/close 3022 (time 1788438892.31 total 50.09 last 57.31)
 - open/close 3588 (time 1788438902.32 total 60.09 last 56.58)
 - open/close 4215 (time 1788438912.32 total 70.10 last 62.68)
 - open/close 4903 (time 1788438922.32 total 80.10 last 68.77)
 - open/close 5609 (time 1788438932.33 total 90.11 last 70.56)
 - open/close 6283 (time 1788438942.34 total 100.11 last 67.36)
 - open/close 6899 (time 1788438952.36 total 110.13 last 61.48)
 - open/close 7532 (time 1788438962.37 total 120.15 last 63.21)
 - open/close 8136 (time 1788438972.37 total 130.15 last 60.39)
 - open/close 8723 (time 1788438982.38 total 140.16 last 58.64)
 - open/close 9305 (time 1788438992.38 total 150.16 last 58.18)
 - open/close 9970 (time 1788439002.39 total 160.17 last 66.45)
total: 10000 open/close in 160.80 seconds: 62.19 ops/second
 - unlinked 0 (time 1788439007 ; total 0 ; last 0)
total: 10000 unlinks in 92 seconds: 108.695656 unlinks/second
 - open/close 676 (time 1788439114.00 total 10.02 last 67.44)
 - open/close 1314 (time 1788439124.01 total 20.03 last 63.78)
 - open/close 1972 (time 1788439134.02 total 30.04 last 65.71)
 - open/close 2622 (time 1788439144.02 total 40.04 last 64.98)
 - open/close 3243 (time 1788439154.03 total 50.05 last 62.03)
 - open/close 3888 (time 1788439164.05 total 60.07 last 64.41)
 - open/close 4499 (time 1788439174.05 total 70.07 last 61.06)
 - open/close 5158 (time 1788439184.06 total 80.08 last 65.87)
 - open/close 5831 (time 1788439194.06 total 90.08 last 67.28)
 - open/close 6432 (time 1788439204.08 total 100.10 last 60.00)
 - open/close 7033 (time 1788439214.09 total 110.11 last 60.01)
 - open/close 7693 (time 1788439224.10 total 120.12 last 65.97)
 - open/close 8292 (time 1788439234.11 total 130.13 last 59.84)
 - open/close 8956 (time 1788439244.12 total 140.14 last 66.36)
 - open/close 9531 (time 1788439254.12 total 150.14 last 57.46)
total: 10000 open/close in 157.95 seconds: 63.31 ops/second
 - unlinked 0 (time 1788439266 ; total 0 ; last 0)
total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second
 - open/close 609 (time 1788439380.87 total 10.00 last 60.87)
 - open/close 1246 (time 1788439390.87 total 20.01 last 63.69)
 - open/close 1951 (time 1788439400.88 total 30.02 last 70.43)
 - open/close 2616 (time 1788439410.89 total 40.03 last 66.43)
 - open/close 3280 (time 1788439420.89 total 50.03 last 66.40)
 - open/close 3802 (time 1788439430.90 total 60.04 last 52.15)
 - open/close 4379 (time 1788439440.90 total 70.04 last 57.69)
 - open/close 4883 (time 1788439450.92 total 80.05 last 50.33)
 - open/close 5383 (time 1788439460.92 total 90.06 last 49.97)
 - open/close 5847 (time 1788439470.94 total 100.07 last 46.35)
 - open/close 6316 (time 1788439480.94 total 110.07 last 46.89)
 - open/close 6849 (time 1788439490.94 total 120.07 last 53.29)
 - open/close 7315 (time 1788439500.95 total 130.08 last 46.57)
 - open/close 7860 (time 1788439510.95 total 140.09 last 54.45)
 - open/close 8367 (time 1788439520.96 total 150.09 last 50.68)
 - open/close 8940 (time 1788439530.96 total 160.10 last 57.29)
 - open/close 9486 (time 1788439540.96 total 170.10 last 54.59)
total: 10000 open/close in 179.18 seconds: 55.81 ops/second
 - unlinked 0 (time 1788439555 ; total 0 ; last 0)
total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second
 - open/close 608 (time 1788439677.33 total 10.01 last 60.74)
 - open/close 1180 (time 1788439687.33 total 20.01 last 57.19)
 - open/close 1779 (time 1788439697.34 total 30.02 last 59.85)
 - open/close 2400 (time 1788439707.36 total 40.04 last 62.01)
 - open/close 2959 (time 1788439717.36 total 50.04 last 55.90)
 - open/close 3534 (time 1788439727.38 total 60.06 last 57.37)
 - open/close 4089 (time 1788439737.39 total 70.07 last 55.46)
 - open/close 4651 (time 1788439747.41 total 80.08 last 56.10)
 - open/close 5187 (time 1788439757.43 total 90.11 last 53.46)
 - open/close 5790 (time 1788439767.45 total 100.13 last 60.19)
 - open/close 6372 (time 1788439777.46 total 110.13 last 58.17)
 - open/close 6963 (time 1788439787.46 total 120.14 last 59.07)
 - open/close 7527 (time 1788439797.46 total 130.14 last 56.40)
 - open/close 8195 (time 1788439807.48 total 140.15 last 66.70)
 - open/close 8750 (time 1788439817.49 total 150.16 last 55.44)
 - open/close 9309 (time 1788439827.49 total 160.17 last 55.86)
 - open/close 9826 (time 1788439837.50 total 170.18 last 51.65)
total: 10000 open/close in 172.52 seconds: 57.97 ops/second
 - unlinked 0 (time 1788439845 ; total 0 ; last 0)
total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second
 - open/close 517 (time 1788439968.82 total 10.01 last 51.67)
 - open/close 1027 (time 1788439978.83 total 20.02 last 50.93)
 - open/close 1639 (time 1788439988.85 total 30.04 last 61.10)
 - open/close 2263 (time 1788439998.85 total 40.04 last 62.40)
 - open/close 2873 (time 1788440008.85 total 50.04 last 61.00)
 - open/close 3384 (time 1788440018.85 total 60.04 last 51.07)
 - open/close 3818 (time 1788440028.87 total 70.06 last 43.34)
 - open/close 4336 (time 1788440038.87 total 80.06 last 51.78)
 - open/close 4948 (time 1788440048.87 total 90.06 last 61.18)
 - open/close 5499 (time 1788440058.88 total 100.07 last 55.08)
 - open/close 6136 (time 1788440068.88 total 110.07 last 63.67)
 - open/close 6759 (time 1788440078.88 total 120.07 last 62.28)
 - open/close 7382 (time 1788440088.89 total 130.08 last 62.27)
 - open/close 7937 (time 1788440098.91 total 140.10 last 55.37)
 - open/close 8482 (time 1788440108.94 total 150.13 last 54.37)
 - open/close 9040 (time 1788440118.95 total 160.14 last 55.75)
 - open/close 9605 (time 1788440128.96 total 170.15 last 56.42)
total: 10000 open/close in 177.77 seconds: 56.25 ops/second
 - unlinked 0 (time 1788440141 ; total 0 ; last 0)
total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second
 - open/close 578 (time 1788440259.77 total 10.01 last 57.73)
 - open/close 1191 (time 1788440269.78 total 20.02 last 61.25)
 - open/close 1767 (time 1788440279.79 total 30.03 last 57.56)
 - open/close 2360 (time 1788440289.80 total 40.04 last 59.24)
 - open/close 3027 (time 1788440299.80 total 50.04 last 66.68)
 - open/close 3572 (time 1788440309.82 total 60.06 last 54.39)
 - open/close 4133 (time 1788440319.82 total 70.06 last 56.10)
 - open/close 4707 (time 1788440329.82 total 80.06 last 57.39)
 - open/close 5259 (time 1788440339.84 total 90.08 last 55.12)
 - open/close 5886 (time 1788440349.85 total 100.09 last 62.63)
 - open/close 6448 (time 1788440359.85 total 110.09 last 56.18)
 - open/close 6957 (time 1788440369.89 total 120.12 last 50.74)
 - open/close 7406 (time 1788440379.89 total 130.12 last 44.89)
 - open/close 7889 (time 1788440389.89 total 140.13 last 48.29)
 - open/close 8417 (time 1788440399.90 total 150.14 last 52.73)
 - open/close 8991 (time 1788440409.91 total 160.15 last 57.35)
 - open/close 9558 (time 1788440419.93 total 170.17 last 56.57)
total: 10000 open/close in 177.80 seconds: 56.24 ops/second
 - unlinked 0 (time 1788440432 ; total 0 ; last 0)
total: 10000 unlinks in 101 seconds: 99.009903 unlinks/second
 - open/close 601 (time 1788440549.23 total 10.01 last 60.06)
 - open/close 1222 (time 1788440559.24 total 20.02 last 62.03)
 - open/close 1822 (time 1788440569.24 total 30.02 last 60.00)
 - open/close 2445 (time 1788440579.25 total 40.03 last 62.24)
 - open/close 3077 (time 1788440589.26 total 50.04 last 63.12)
 - open/close 3653 (time 1788440599.27 total 60.05 last 57.54)
 - open/close 4228 (time 1788440609.30 total 70.08 last 57.33)
 - open/close 4740 (time 1788440619.32 total 80.10 last 51.13)
 - open/close 5239 (time 1788440629.32 total 90.10 last 49.89)
 - open/close 5757 (time 1788440639.32 total 100.10 last 51.77)
 - open/close 6320 (time 1788440649.33 total 110.11 last 56.28)
 - open/close 6899 (time 1788440659.36 total 120.14 last 57.74)
 - open/close 7436 (time 1788440669.36 total 130.14 last 53.69)
 - open/close 8049 (time 1788440679.38 total 140.16 last 61.18)
 - open/close 8697 (time 1788440689.38 total 150.16 last 64.77)
 - open/close 9312 (time 1788440699.39 total 160.17 last 61.46)
 - open/close 9961 (time 1788440709.39 total 170.17 last 64.87)
total: 10000 open/close in 170.73 seconds: 58.57 ops/second
 - unlinked 0 (time 1788440715 ; total 0 ; last 0)
total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second
 - open/close 591 (time 1788440837.40 total 10.00 last 59.10)
 - open/close 1242 (time 1788440847.41 total 20.01 last 65.07)
 - open/close 1812 (time 1788440857.42 total 30.01 last 56.95)
 - open/close 2427 (time 1788440867.43 total 40.03 last 61.40)
 - open/close 3000 (time 1788440877.44 total 50.04 last 57.27)
 - open/close 3564 (time 1788440887.44 total 60.04 last 56.39)
 - open/close 4151 (time 1788440897.44 total 70.04 last 58.69)
 - open/close 4854 (time 1788440907.45 total 80.05 last 70.24)
 - open/close 5469 (time 1788440917.46 total 90.06 last 61.45)
 - open/close 6075 (time 1788440927.47 total 100.07 last 60.54)
 - open/close 6650 (time 1788440937.48 total 110.08 last 57.43)
 - open/close 7228 (time 1788440947.49 total 120.08 last 57.76)
 - open/close 7832 (time 1788440957.49 total 130.09 last 60.37)
 - open/close 8476 (time 1788440967.51 total 140.11 last 64.28)
 - open/close 9022 (time 1788440977.52 total 150.12 last 54.56)
 - open/close 9514 (time 1788440987.53 total 160.13 last 49.14)
total: 10000 open/close in 169.50 seconds: 59.00 ops/second
 - unlinked 0 (time 1788441002 ; total 0 ; last 0)
total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second
 - open/close 626 (time 1788441121.75 total 10.00 last 62.57)
 - open/close 1280 (time 1788441131.75 total 20.01 last 65.36)
 - open/close 1985 (time 1788441141.76 total 30.01 last 70.47)
 - open/close 2545 (time 1788441151.76 total 40.02 last 55.97)
 - open/close 3058 (time 1788441161.77 total 50.03 last 51.27)
 - open/close 3694 (time 1788441171.78 total 60.04 last 63.54)
 - open/close 4308 (time 1788441181.78 total 70.04 last 61.37)
 - open/close 4968 (time 1788441191.80 total 80.05 last 65.92)
 - open/close 5602 (time 1788441201.80 total 90.06 last 63.35)
 - open/close 6221 (time 1788441211.81 total 100.06 last 61.88)
 - open/close 6827 (time 1788441221.83 total 110.09 last 60.47)
 - open/close 7437 (time 1788441231.85 total 120.11 last 60.87)
 - open/close 8053 (time 1788441241.86 total 130.11 last 61.56)
 - open/close 8664 (time 1788441251.86 total 140.12 last 61.05)
 - open/close 9194 (time 1788441261.87 total 150.13 last 52.96)
 - open/close 9670 (time 1788441271.88 total 160.14 last 47.53)
total: 10000 open/close in 167.13 seconds: 59.83 ops/second
 - unlinked 0 (time 1788441283 ; total 0 ; last 0)
total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second
 - open/close 595 (time 1788441402.90 total 10.01 last 59.45)
 - open/close 1235 (time 1788441412.92 total 20.03 last 63.88)
 - open/close 1848 (time 1788441422.93 total 30.03 last 61.29)
 - open/close 2488 (time 1788441432.94 total 40.05 last 63.90)
 - open/close 3100 (time 1788441442.95 total 50.06 last 61.13)
 - open/close 3703 (time 1788441452.96 total 60.06 last 60.28)
 - open/close 4302 (time 1788441462.97 total 70.07 last 59.85)
 - open/close 4857 (time 1788441472.98 total 80.08 last 55.42)
 - open/close 5472 (time 1788441482.98 total 90.09 last 61.49)
 - open/close 6068 (time 1788441492.99 total 100.10 last 59.54)
 - open/close 6667 (time 1788441502.99 total 110.10 last 59.89)
 - open/close 7329 (time 1788441513.00 total 120.10 last 66.18)
 - open/close 7938 (time 1788441523.00 total 130.11 last 60.86)
 - open/close 8589 (time 1788441533.05 total 140.15 last 64.80)
 - open/close 9211 (time 1788441543.05 total 150.16 last 62.19)
 - open/close 9854 (time 1788441553.06 total 160.16 last 64.27)
total: 10000 open/close in 162.55 seconds: 61.52 ops/second
 - unlinked 0 (time 1788441560 ; total 0 ; last 0)
total: 10000 unlinks in 99 seconds: 101.010101 unlinks/second
rm: missing operand
Try 'rm --help' for more information.
umount lustre on /mnt/lustre.....
Stopping client oleg413-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg413-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.113@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.113@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg413-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-OST0000
oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg413-server: oleg413-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg413-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg413-client.virtnet:  -o user_xattr,flock 192.168.204.113@tcp:/lustre /mnt/lustre
On OST0, 16870 used inodes rc=0
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 22
umount lustre on /mnt/lustre.....
Stopping client oleg413-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg413-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre:OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.113@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.113@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre:OST0000
checking for existing Lustre data: found

   Read previous values:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.113@tcp autodegrade=on sys.timeout=20

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.113@tcp autodegrade=on sys.timeout=20 autodegrade=on
  lustre:svname=lustre-OST0000
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.113@tcp
  lustre:autodegrade=on
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg413-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1
Started lustre-OST0000
oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg413-server: oleg413-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg413-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg413-client.virtnet:  -o user_xattr,flock 192.168.204.113@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg413-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg413-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server
stop mds service on oleg413-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server
unloading modules via unload_modules_local on: 'oleg413-server'
oleg413-server: oleg413-server.virtnet: executing unload_modules_local
oleg413-server: kmemleak disabled
modules unloaded.
pdsh@oleg413-client: oleg413-client: ssh exited with exit code 2
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2
pdsh@oleg413-client: oleg413-client: ssh exited with exit code 2
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2
PASS 69 (3046s)

== conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 09:23:38 (1788441818)

 SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs
SKIP 111 (4s)
Stopping clients: oleg413-client.virtnet /mnt/lustre (opts:-f)
Stopping clients: oleg413-client.virtnet /mnt/lustre2 (opts:-f)
pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2
oleg413-server: oleg413-server.virtnet: executing set_hostid
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x  1 green green 1921056 Sep  3 07:51 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg413-server'
oleg413-server: oleg413-server.virtnet: executing load_modules_local
oleg413-server: kmemleak disabled
oleg413-server: Loading modules from /home/green/git/lustre-release/lustre
oleg413-server: detected 4 online CPUs by sysfs
oleg413-server: MODOPTS_LIBCFS=
oleg413-server: Force libcfs to create 2 CPU partitions
oleg413-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg413-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg413-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg413-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
== conf-sanity test complete, duration 3516 sec ========== 09:24:58 (1788441898)
=== conf-sanity: start cleanup 09:25:01 (1788441901) ===
=== conf-sanity: finish cleanup 09:25:05 (1788441905) ===