-----============= acceptance-small: conf-sanity ============----- Sun Sep  6 23:47:25 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg420-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex
- see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683435 >= 34553653) for LU-16938, go 81
- see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683435 >= 34554143) for LU-18348, go 32b 32c
- see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683435 >= 34617107) for LU-17920, go 123ae 123ag
- see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683435 >= 34681950) for LU-19740, go 115
excepting tests: 32b 32c 32newtarball 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a
Stopping clients: oleg420-client.virtnet /mnt/lustre (opts:-f)
Stopping client oleg420-client.virtnet /mnt/lustre opts:-f
Stopping clients: oleg420-client.virtnet /mnt/lustre2 (opts:-f)
Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg420-server
oleg420-server: oleg420-server.virtnet: executing set_hostid
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg420-server'
oleg420-server: oleg420-server.virtnet: executing load_modules_local
oleg420-server: kmemleak disabled
oleg420-server: Loading modules from /home/green/git/lustre-release/lustre
oleg420-server: detected 4 online CPUs by sysfs
oleg420-server: MODOPTS_LIBCFS=
oleg420-server: Force libcfs to create 2 CPU partitions
oleg420-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
start mds service on oleg420-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Commit the device label on lustre-mdt1/mdt1
Started lustre-MDT0000
oleg420-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg420-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Commit the device label on lustre-ost1/ost1
Started lustre-OST0000
oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg420-server: oleg420-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg420-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
stop ost1 service on oleg420-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server
stop mds service on oleg420-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server

== conf-sanity test 45: long unlink handling in ptlrpcd == 23:50:21 (1788753021)
start mds service on oleg420-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg420-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg420-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-OST0000
oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg420-client.virtnet:  -o user_xattr,flock 192.168.204.120@tcp:/lustre /mnt/lustre
setup single mount lustre success
stop mds service on oleg420-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server
sleep 60 sec
fail_loc=0x8000050f
sleep 10 sec
manual umount lustre on /mnt/lustre....
df: /mnt/lustre: Input/output error
fail_loc=0x0
start mds service on oleg420-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg420-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg420-client.virtnet:  -o user_xattr,flock 192.168.204.120@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg420-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg420-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server
stop mds service on oleg420-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server
unloading modules via unload_modules_local on: 'oleg420-server'
oleg420-server: oleg420-server.virtnet: executing unload_modules_local
oleg420-server: kmemleak disabled
modules unloaded.
pdsh@oleg420-client: oleg420-client: ssh exited with exit code 2
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 2
pdsh@oleg420-client: oleg420-client: ssh exited with exit code 2
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 2
PASS 45 (233s)

== conf-sanity test 69: replace an OST with the same index ========================================================== 23:54:15 (1788753255)
start mds service on oleg420-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x. 1 green green 1931560 Sep  6 20:25 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg420-server'
oleg420-server: oleg420-server.virtnet: executing load_modules_local
oleg420-server: kmemleak disabled
oleg420-server: Loading modules from /home/green/git/lustre-release/lustre
oleg420-server: detected 4 online CPUs by sysfs
oleg420-server: MODOPTS_LIBCFS=
oleg420-server: Force libcfs to create 2 CPU partitions
oleg420-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg420-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg420-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg420-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg420-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg420-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-OST0000
oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg420-client.virtnet:  -o user_xattr,flock 192.168.204.120@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
On OST0, 11904 inodes available. Want 99872. rc=0
 - open/close 564 (time 1788753345.51 total 10.01 last 56.36)
 - open/close 1181 (time 1788753355.52 total 20.01 last 61.65)
 - open/close 1856 (time 1788753365.52 total 30.02 last 67.49)
 - open/close 2430 (time 1788753375.53 total 40.02 last 57.35)
 - open/close 3044 (time 1788753385.54 total 50.04 last 61.33)
 - open/close 3698 (time 1788753395.54 total 60.04 last 65.39)
 - open/close 4375 (time 1788753405.55 total 70.05 last 67.64)
 - open/close 5026 (time 1788753415.56 total 80.06 last 65.03)
 - open/close 5662 (time 1788753425.56 total 90.06 last 63.59)
 - open/close 6266 (time 1788753435.57 total 100.06 last 60.40)
 - open/close 6964 (time 1788753445.57 total 110.07 last 69.75)
 - open/close 7670 (time 1788753455.59 total 120.08 last 70.50)
 - open/close 8288 (time 1788753465.59 total 130.09 last 61.78)
 - open/close 8867 (time 1788753475.60 total 140.10 last 57.84)
 - open/close 9411 (time 1788753485.61 total 150.10 last 54.36)
 - open/close 9897 (time 1788753495.62 total 160.12 last 48.52)
total: 10000 open/close in 161.86 seconds: 61.78 ops/second
 - unlinked 0 (time 1788753501 ; total 0 ; last 0)
total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second
 - open/close 585 (time 1788753620.91 total 10.00 last 58.50)
 - open/close 1255 (time 1788753630.91 total 20.00 last 66.97)
 - open/close 1775 (time 1788753640.95 total 30.05 last 51.78)
 - open/close 2301 (time 1788753650.97 total 40.06 last 52.53)
 - open/close 2841 (time 1788753660.98 total 50.07 last 53.95)
 - open/close 3412 (time 1788753670.98 total 60.08 last 57.07)
 - open/close 4046 (time 1788753680.99 total 70.09 last 63.34)
 - open/close 4621 (time 1788753691.01 total 80.10 last 57.42)
 - open/close 5328 (time 1788753701.01 total 90.11 last 70.64)
 - open/close 5937 (time 1788753711.02 total 100.11 last 60.88)
 - open/close 6541 (time 1788753721.03 total 110.12 last 60.35)
 - open/close 7170 (time 1788753731.03 total 120.12 last 62.87)
 - open/close 7772 (time 1788753741.03 total 130.12 last 60.19)
 - open/close 8386 (time 1788753751.04 total 140.14 last 61.33)
 - open/close 8946 (time 1788753761.06 total 150.16 last 55.88)
 - open/close 9471 (time 1788753771.07 total 160.16 last 52.48)
total: 10000 open/close in 169.55 seconds: 58.98 ops/second
 - unlinked 0 (time 1788753785 ; total 0 ; last 0)
total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second
 - open/close 539 (time 1788753906.50 total 10.00 last 53.87)
 - open/close 1095 (time 1788753916.51 total 20.01 last 55.57)
 - open/close 1630 (time 1788753926.51 total 30.01 last 53.48)
 - open/close 2204 (time 1788753936.52 total 40.02 last 57.36)
 - open/close 2725 (time 1788753946.52 total 50.03 last 52.07)
 - open/close 3274 (time 1788753956.53 total 60.04 last 54.84)
 - open/close 3859 (time 1788753966.54 total 70.05 last 58.43)
 - open/close 4504 (time 1788753976.55 total 80.06 last 64.44)
 - open/close 5036 (time 1788753986.57 total 90.07 last 53.11)
 - open/close 5560 (time 1788753996.57 total 100.08 last 52.38)
 - open/close 6193 (time 1788754006.60 total 110.11 last 63.11)
 - open/close 6817 (time 1788754016.60 total 120.11 last 62.40)
 - open/close 7407 (time 1788754026.62 total 130.12 last 58.92)
 - open/close 7954 (time 1788754036.62 total 140.13 last 54.66)
 - open/close 8609 (time 1788754046.66 total 150.16 last 65.30)
 - open/close 9227 (time 1788754056.66 total 160.16 last 61.78)
 - open/close 9898 (time 1788754066.66 total 170.17 last 67.08)
total: 10000 open/close in 171.71 seconds: 58.24 ops/second
 - unlinked 0 (time 1788754073 ; total 0 ; last 0)
total: 10000 unlinks in 101 seconds: 99.009903 unlinks/second
 - open/close 674 (time 1788754190.16 total 10.02 last 67.27)
 - open/close 1301 (time 1788754200.19 total 20.05 last 62.51)
 - open/close 1898 (time 1788754210.21 total 30.06 last 59.63)
 - open/close 2544 (time 1788754220.23 total 40.08 last 64.47)
 - open/close 3206 (time 1788754230.24 total 50.09 last 66.14)
 - open/close 3835 (time 1788754240.24 total 60.09 last 62.89)
 - open/close 4504 (time 1788754250.25 total 70.11 last 66.81)
 - open/close 5112 (time 1788754260.26 total 80.11 last 60.77)
 - open/close 5713 (time 1788754270.26 total 90.11 last 60.08)
 - open/close 6348 (time 1788754280.26 total 100.12 last 63.49)
 - open/close 6989 (time 1788754290.28 total 110.13 last 64.01)
 - open/close 7635 (time 1788754300.28 total 120.13 last 64.59)
 - open/close 8247 (time 1788754310.29 total 130.14 last 61.15)
 - open/close 8797 (time 1788754320.30 total 140.15 last 54.95)
 - open/close 9428 (time 1788754330.30 total 150.15 last 63.07)
total: 10000 open/close in 159.36 seconds: 62.75 ops/second
 - unlinked 0 (time 1788754344 ; total 0 ; last 0)
total: 10000 unlinks in 99 seconds: 101.010101 unlinks/second
 - open/close 595 (time 1788754459.73 total 10.00 last 59.49)
 - open/close 1226 (time 1788754469.73 total 20.01 last 63.08)
 - open/close 1776 (time 1788754479.73 total 30.01 last 54.99)
 - open/close 2456 (time 1788754489.74 total 40.01 last 67.99)
 - open/close 3143 (time 1788754499.75 total 50.02 last 68.63)
 - open/close 3797 (time 1788754509.75 total 60.02 last 65.37)
 - open/close 4417 (time 1788754519.76 total 70.03 last 61.93)
 - open/close 5074 (time 1788754529.77 total 80.05 last 65.61)
 - open/close 5708 (time 1788754539.80 total 90.07 last 63.26)
 - open/close 6379 (time 1788754549.80 total 100.08 last 67.05)
 - open/close 6998 (time 1788754559.82 total 110.09 last 61.82)
 - open/close 7675 (time 1788754569.83 total 120.10 last 67.64)
 - open/close 8341 (time 1788754579.85 total 130.12 last 66.45)
 - open/close 9023 (time 1788754589.85 total 140.12 last 68.17)
 - open/close 9682 (time 1788754599.89 total 150.16 last 65.67)
total: 10000 open/close in 154.52 seconds: 64.71 ops/second
 - unlinked 0 (time 1788754608 ; total 0 ; last 0)
total: 10000 unlinks in 95 seconds: 105.263161 unlinks/second
 - open/close 626 (time 1788754718.05 total 10.01 last 62.56)
 - open/close 1265 (time 1788754728.05 total 20.01 last 63.89)
 - open/close 1890 (time 1788754738.06 total 30.02 last 62.45)
 - open/close 2469 (time 1788754748.07 total 40.02 last 57.85)
 - open/close 3134 (time 1788754758.08 total 50.04 last 66.41)
 - open/close 3773 (time 1788754768.09 total 60.05 last 63.83)
 - open/close 4424 (time 1788754778.10 total 70.06 last 65.03)
 - open/close 5083 (time 1788754788.11 total 80.07 last 65.84)
 - open/close 5728 (time 1788754798.13 total 90.09 last 64.38)
 - open/close 6336 (time 1788754808.14 total 100.10 last 60.74)
 - open/close 6901 (time 1788754818.16 total 110.11 last 56.41)
 - open/close 7511 (time 1788754828.16 total 120.12 last 60.98)
 - open/close 8044 (time 1788754838.16 total 130.12 last 53.28)
 - open/close 8616 (time 1788754848.18 total 140.13 last 57.12)
 - open/close 9172 (time 1788754858.20 total 150.15 last 55.50)
 - open/close 9815 (time 1788754868.21 total 160.16 last 64.23)
total: 10000 open/close in 163.41 seconds: 61.20 ops/second
 - unlinked 0 (time 1788754876 ; total 0 ; last 0)
total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second
 - open/close 644 (time 1788754997.38 total 10.01 last 64.31)
 - open/close 1344 (time 1788755007.38 total 20.02 last 69.94)
 - open/close 1959 (time 1788755017.39 total 30.02 last 61.50)
 - open/close 2617 (time 1788755027.40 total 40.04 last 65.71)
 - open/close 3253 (time 1788755037.43 total 50.07 last 63.42)
 - open/close 3935 (time 1788755047.46 total 60.09 last 68.00)
 - open/close 4572 (time 1788755057.47 total 70.10 last 63.64)
 - open/close 5249 (time 1788755067.47 total 80.10 last 67.69)
 - open/close 5882 (time 1788755077.48 total 90.11 last 63.23)
 - open/close 6499 (time 1788755087.48 total 100.12 last 61.65)
 - open/close 7061 (time 1788755097.49 total 110.13 last 56.17)
 - open/close 7609 (time 1788755107.50 total 120.14 last 54.74)
 - open/close 8162 (time 1788755117.52 total 130.15 last 55.22)
 - open/close 8790 (time 1788755127.53 total 140.17 last 62.71)
 - open/close 9385 (time 1788755137.54 total 150.18 last 59.43)
 - open/close 9993 (time 1788755147.55 total 160.19 last 60.75)
total: 10000 open/close in 160.29 seconds: 62.38 ops/second
 - unlinked 0 (time 1788755152 ; total 0 ; last 0)
total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second
 - open/close 512 (time 1788755271.15 total 10.03 last 51.03)
 - open/close 1041 (time 1788755281.17 total 20.05 last 52.79)
 - open/close 1660 (time 1788755291.17 total 30.06 last 61.88)
 - open/close 2309 (time 1788755301.19 total 40.08 last 64.74)
 - open/close 2863 (time 1788755311.20 total 50.09 last 55.36)
 - open/close 3481 (time 1788755321.21 total 60.10 last 61.72)
 - open/close 4197 (time 1788755331.23 total 70.11 last 71.50)
 - open/close 4880 (time 1788755341.24 total 80.13 last 68.18)
 - open/close 5599 (time 1788755351.26 total 90.15 last 71.77)
 - open/close 6220 (time 1788755361.28 total 100.16 last 62.01)
 - open/close 6857 (time 1788755371.29 total 110.17 last 63.64)
 - open/close 7518 (time 1788755381.30 total 120.19 last 66.02)
 - open/close 8144 (time 1788755391.33 total 130.21 last 62.42)
 - open/close 8821 (time 1788755401.33 total 140.22 last 67.68)
 - open/close 9488 (time 1788755411.33 total 150.22 last 66.70)
total: 10000 open/close in 156.69 seconds: 63.82 ops/second
 - unlinked 0 (time 1788755422 ; total 0 ; last 0)
total: 10000 unlinks in 91 seconds: 109.890106 unlinks/second
 - open/close 698 (time 1788755527.51 total 10.00 last 69.79)
 - open/close 1355 (time 1788755537.53 total 20.02 last 65.55)
 - open/close 1972 (time 1788755547.53 total 30.03 last 61.68)
 - open/close 2702 (time 1788755557.54 total 40.04 last 72.94)
 - open/close 3362 (time 1788755567.55 total 50.04 last 65.96)
 - open/close 4024 (time 1788755577.55 total 60.05 last 66.17)
 - open/close 4732 (time 1788755587.56 total 70.06 last 70.72)
 - open/close 5398 (time 1788755597.57 total 80.07 last 66.55)
 - open/close 6081 (time 1788755607.59 total 90.08 last 68.19)
 - open/close 6728 (time 1788755617.59 total 100.09 last 64.66)
 - open/close 7319 (time 1788755627.60 total 110.10 last 59.04)
 - open/close 7978 (time 1788755637.62 total 120.12 last 65.78)
 - open/close 8531 (time 1788755647.63 total 130.13 last 55.23)
 - open/close 9172 (time 1788755657.64 total 140.14 last 64.04)
 - open/close 9819 (time 1788755667.66 total 150.16 last 64.59)
total: 10000 open/close in 152.98 seconds: 65.37 ops/second
 - unlinked 0 (time 1788755674 ; total 0 ; last 0)
total: 10000 unlinks in 95 seconds: 105.263161 unlinks/second
 - open/close 595 (time 1788755784.48 total 10.00 last 59.49)
 - open/close 1223 (time 1788755794.49 total 20.01 last 62.73)
 - open/close 1796 (time 1788755804.50 total 30.02 last 57.29)
 - open/close 2413 (time 1788755814.50 total 40.02 last 61.68)
 - open/close 3040 (time 1788755824.51 total 50.03 last 62.64)
 - open/close 3709 (time 1788755834.51 total 60.03 last 66.86)
 - open/close 4358 (time 1788755844.51 total 70.04 last 64.89)
 - open/close 4997 (time 1788755854.52 total 80.04 last 63.90)
 - open/close 5624 (time 1788755864.56 total 90.08 last 62.41)
 - open/close 6281 (time 1788755874.57 total 100.09 last 65.66)
 - open/close 6909 (time 1788755884.58 total 110.10 last 62.72)
 - open/close 7524 (time 1788755894.59 total 120.11 last 61.44)
 - open/close 8168 (time 1788755904.60 total 130.12 last 64.36)
 - open/close 8836 (time 1788755914.61 total 140.13 last 66.75)
 - open/close 9462 (time 1788755924.61 total 150.13 last 62.58)
total: 10000 open/close in 158.09 seconds: 63.25 ops/second
 - unlinked 0 (time 1788755936 ; total 0 ; last 0)
total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second
rm: missing operand
Try 'rm --help' for more information.
umount lustre on /mnt/lustre.....
Stopping client oleg420-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg420-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.120@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.120@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg420-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-OST0000
oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg420-server: oleg420-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg420-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg420-client.virtnet:  -o user_xattr,flock 192.168.204.120@tcp:/lustre /mnt/lustre
On OST0, 13430 used inodes rc=0
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 22
umount lustre on /mnt/lustre.....
Stopping client oleg420-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg420-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre:OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.120@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.120@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre:OST0000
checking for existing Lustre data: found

   Read previous values:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.204.120@tcp

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.204.120@tcp autodegrade=on
  lustre:svname=lustre-OST0000
Writing lustre-ost1/ost1 properties
  lustre:autodegrade=on
  lustre:sys.timeout=20
  lustre:mgsnode=192.168.204.120@tcp
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg420-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1
Started lustre-OST0000
oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg420-server: oleg420-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg420-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg420-client.virtnet:  -o user_xattr,flock 192.168.204.120@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg420-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg420-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server
stop mds service on oleg420-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server
unloading modules via unload_modules_local on: 'oleg420-server'
oleg420-server: oleg420-server.virtnet: executing unload_modules_local
oleg420-server: kmemleak disabled
modules unloaded.
pdsh@oleg420-client: oleg420-client: ssh exited with exit code 2
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 2
pdsh@oleg420-client: oleg420-client: ssh exited with exit code 2
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 2
PASS 69 (2946s)

== conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 00:43:23 (1788756203)

 SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs
SKIP 111 (4s)
Stopping clients: oleg420-client.virtnet /mnt/lustre (opts:-f)
Stopping clients: oleg420-client.virtnet /mnt/lustre2 (opts:-f)
pdsh@oleg420-client: oleg420-server: ssh exited with exit code 2
oleg420-server: oleg420-server.virtnet: executing set_hostid
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x. 1 green green 1931560 Sep  6 20:25 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg420-server'
oleg420-server: oleg420-server.virtnet: executing load_modules_local
oleg420-server: kmemleak disabled
oleg420-server: Loading modules from /home/green/git/lustre-release/lustre
oleg420-server: detected 4 online CPUs by sysfs
oleg420-server: MODOPTS_LIBCFS=
oleg420-server: Force libcfs to create 2 CPU partitions
oleg420-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg420-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg420-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg420-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
== conf-sanity test complete, duration 3437 sec ========== 00:44:44 (1788756284)
=== conf-sanity: start cleanup 00:44:46 (1788756286) ===
=== conf-sanity: finish cleanup 00:44:49 (1788756289) ===