-----============= acceptance-small: conf-sanity ============----- Sun Sep  6 04:40:04 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg443-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex
- see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683394 >= 34553653) for LU-16938, go 81
- see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683394 >= 34554143) for LU-18348, go 32b 32c
- see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683394 >= 34617107) for LU-17920, go 123ae 123ag
- see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683394 >= 34681950) for LU-19740, go 115
excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a
Stopping clients: oleg443-client.virtnet /mnt/lustre (opts:-f)
Stopping client oleg443-client.virtnet /mnt/lustre opts:-f
Stopping clients: oleg443-client.virtnet /mnt/lustre2 (opts:-f)
Stopping /mnt/lustre-mds1 (opts:-f) on oleg443-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg443-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg443-server
oleg443-server: oleg443-server.virtnet: executing set_hostid
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg443-server'
oleg443-server: oleg443-server.virtnet: executing load_modules_local
oleg443-server: kmemleak disabled
oleg443-server: Loading modules from /home/green/git/lustre-release/lustre
oleg443-server: detected 4 online CPUs by sysfs
oleg443-server: MODOPTS_LIBCFS=
oleg443-server: Force libcfs to create 2 CPU partitions
oleg443-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
start mds service on oleg443-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Commit the device label on lustre-mdt1/mdt1
Started lustre-MDT0000
oleg443-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg443-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Commit the device label on lustre-ost1/ost1
Started lustre-OST0000
oleg443-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg443-server: oleg443-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg443-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
stop ost1 service on oleg443-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg443-server
stop mds service on oleg443-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg443-server

== conf-sanity test 45: long unlink handling in ptlrpcd == 04:43:08 (1788684188)
start mds service on oleg443-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg443-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg443-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-OST0000
oleg443-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg443-client.virtnet:  -o user_xattr,flock 192.168.204.143@tcp:/lustre /mnt/lustre
setup single mount lustre success
stop mds service on oleg443-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg443-server
sleep 60 sec
fail_loc=0x8000050f
sleep 10 sec
manual umount lustre on /mnt/lustre....
df: /mnt/lustre: Input/output error
fail_loc=0x0
start mds service on oleg443-server
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg443-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg443-client.virtnet:  -o user_xattr,flock 192.168.204.143@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg443-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg443-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg443-server
stop mds service on oleg443-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg443-server
unloading modules via unload_modules_local on: 'oleg443-server'
oleg443-server: oleg443-server.virtnet: executing unload_modules_local
oleg443-server: kmemleak disabled
modules unloaded.
pdsh@oleg443-client: oleg443-client: ssh exited with exit code 2
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 2
pdsh@oleg443-client: oleg443-client: ssh exited with exit code 2
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 2
PASS 45 (227s)

== conf-sanity test 69: replace an OST with the same index ========================================================== 04:46:56 (1788684416)
start mds service on oleg443-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x. 1 green green 1921056 Sep  5 18:57 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg443-server'
oleg443-server: oleg443-server.virtnet: executing load_modules_local
oleg443-server: kmemleak disabled
oleg443-server: Loading modules from /home/green/git/lustre-release/lustre
oleg443-server: detected 4 online CPUs by sysfs
oleg443-server: MODOPTS_LIBCFS=
oleg443-server: Force libcfs to create 2 CPU partitions
oleg443-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg443-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg443-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg443-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg443-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg443-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-OST0000
oleg443-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg443-client.virtnet:  -o user_xattr,flock 192.168.204.143@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
On OST0, 11904 inodes available. Want 99872. rc=0
 - open/close 648 (time 1788684508.70 total 10.01 last 64.76)
 - open/close 1247 (time 1788684518.71 total 20.02 last 59.81)
 - open/close 1953 (time 1788684528.73 total 30.04 last 70.48)
 - open/close 2586 (time 1788684538.73 total 40.04 last 63.27)
 - open/close 3192 (time 1788684548.74 total 50.05 last 60.54)
 - open/close 3782 (time 1788684558.75 total 60.06 last 58.93)
 - open/close 4388 (time 1788684568.76 total 70.07 last 60.58)
 - open/close 4913 (time 1788684578.76 total 80.08 last 52.46)
 - open/close 5559 (time 1788684588.77 total 90.08 last 64.54)
 - open/close 6159 (time 1788684598.78 total 100.09 last 59.98)
 - open/close 6717 (time 1788684608.78 total 110.09 last 55.78)
 - open/close 7334 (time 1788684618.79 total 120.10 last 61.63)
 - open/close 8015 (time 1788684628.80 total 130.11 last 68.05)
 - open/close 8647 (time 1788684638.80 total 140.11 last 63.19)
 - open/close 9296 (time 1788684648.83 total 150.14 last 64.73)
 - open/close 9952 (time 1788684658.84 total 160.15 last 65.53)
total: 10000 open/close in 160.88 seconds: 62.16 ops/second
 - unlinked 0 (time 1788684663 ; total 0 ; last 0)
total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second
 - open/close 637 (time 1788684781.15 total 10.00 last 63.70)
 - open/close 1233 (time 1788684791.16 total 20.01 last 59.53)
 - open/close 1891 (time 1788684801.16 total 30.02 last 65.77)
 - open/close 2550 (time 1788684811.16 total 40.02 last 65.89)
 - open/close 3193 (time 1788684821.16 total 50.02 last 64.30)
 - open/close 3795 (time 1788684831.16 total 60.02 last 60.19)
 - open/close 4398 (time 1788684841.19 total 70.04 last 60.16)
 - open/close 5025 (time 1788684851.19 total 80.05 last 62.67)
 - open/close 5631 (time 1788684861.20 total 90.06 last 60.55)
 - open/close 6230 (time 1788684871.21 total 100.06 last 59.85)
 - open/close 6802 (time 1788684881.23 total 110.08 last 57.11)
 - open/close 7352 (time 1788684891.23 total 120.08 last 54.98)
 - open/close 7938 (time 1788684901.25 total 130.11 last 58.46)
 - open/close 8526 (time 1788684911.26 total 140.12 last 58.76)
 - open/close 9086 (time 1788684921.26 total 150.12 last 55.98)
 - open/close 9653 (time 1788684931.32 total 160.17 last 56.40)
total: 10000 open/close in 167.06 seconds: 59.86 ops/second
 - unlinked 0 (time 1788684944 ; total 0 ; last 0)
total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second
 - open/close 613 (time 1788685058.35 total 10.01 last 61.24)
 - open/close 1260 (time 1788685068.36 total 20.02 last 64.65)
 - open/close 1886 (time 1788685078.36 total 30.02 last 62.60)
 - open/close 2407 (time 1788685088.36 total 40.02 last 52.07)
 - open/close 3037 (time 1788685098.39 total 50.05 last 62.85)
 - open/close 3632 (time 1788685108.39 total 60.05 last 59.47)
 - open/close 4248 (time 1788685118.40 total 70.06 last 61.57)
 - open/close 4936 (time 1788685128.42 total 80.08 last 68.67)
 - open/close 5604 (time 1788685138.42 total 90.08 last 66.79)
 - open/close 6222 (time 1788685148.45 total 100.11 last 61.59)
 - open/close 6826 (time 1788685158.46 total 110.12 last 60.36)
 - open/close 7392 (time 1788685168.48 total 120.13 last 56.50)
 - open/close 7994 (time 1788685178.49 total 130.15 last 60.14)
 - open/close 8586 (time 1788685188.50 total 140.16 last 59.14)
 - open/close 9181 (time 1788685198.50 total 150.16 last 59.46)
 - open/close 9808 (time 1788685208.52 total 160.18 last 62.60)
total: 10000 open/close in 163.07 seconds: 61.32 ops/second
 - unlinked 0 (time 1788685215 ; total 0 ; last 0)
total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second
 - open/close 633 (time 1788685330.23 total 10.01 last 63.25)
 - open/close 1299 (time 1788685340.24 total 20.01 last 66.55)
 - open/close 1931 (time 1788685350.25 total 30.02 last 63.15)
 - open/close 2568 (time 1788685360.25 total 40.02 last 63.70)
 - open/close 3172 (time 1788685370.26 total 50.03 last 60.34)
 - open/close 3781 (time 1788685380.26 total 60.04 last 60.86)
 - open/close 4435 (time 1788685390.28 total 70.06 last 65.30)
 - open/close 5091 (time 1788685400.28 total 80.06 last 65.56)
 - open/close 5791 (time 1788685410.29 total 90.06 last 69.98)
 - open/close 6437 (time 1788685420.30 total 100.07 last 64.52)
 - open/close 7037 (time 1788685430.30 total 110.08 last 59.97)
 - open/close 7623 (time 1788685440.37 total 120.14 last 58.22)
 - open/close 8113 (time 1788685450.37 total 130.15 last 48.99)
 - open/close 8543 (time 1788685460.41 total 140.19 last 42.83)
 - open/close 9074 (time 1788685470.42 total 150.20 last 53.05)
 - open/close 9676 (time 1788685480.43 total 160.20 last 60.15)
total: 10000 open/close in 166.40 seconds: 60.10 ops/second
 - unlinked 0 (time 1788685491 ; total 0 ; last 0)
total: 10000 unlinks in 97 seconds: 103.092781 unlinks/second
 - open/close 696 (time 1788685602.62 total 10.00 last 69.59)
 - open/close 1266 (time 1788685612.65 total 20.03 last 56.87)
 - open/close 1906 (time 1788685622.65 total 30.03 last 64.00)
 - open/close 2458 (time 1788685632.66 total 40.04 last 55.10)
 - open/close 2940 (time 1788685642.67 total 50.05 last 48.17)
 - open/close 3534 (time 1788685652.68 total 60.06 last 59.32)
 - open/close 4149 (time 1788685662.69 total 70.07 last 61.47)
 - open/close 4738 (time 1788685672.70 total 80.08 last 58.85)
 - open/close 5338 (time 1788685682.70 total 90.09 last 59.96)
 - open/close 6049 (time 1788685692.71 total 100.09 last 71.09)
 - open/close 6773 (time 1788685702.71 total 110.09 last 72.37)
 - open/close 7452 (time 1788685712.71 total 120.09 last 67.88)
 - open/close 8158 (time 1788685722.73 total 130.11 last 70.52)
 - open/close 8810 (time 1788685732.73 total 140.11 last 65.15)
 - open/close 9501 (time 1788685742.77 total 150.15 last 68.83)
total: 10000 open/close in 158.92 seconds: 62.93 ops/second
 - unlinked 0 (time 1788685756 ; total 0 ; last 0)
total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second
 - open/close 616 (time 1788685872.79 total 10.00 last 61.59)
 - open/close 1153 (time 1788685882.80 total 20.01 last 53.65)
 - open/close 1787 (time 1788685892.81 total 30.02 last 63.32)
 - open/close 2463 (time 1788685902.82 total 40.03 last 67.56)
 - open/close 3106 (time 1788685912.83 total 50.04 last 64.24)
 - open/close 3734 (time 1788685922.84 total 60.04 last 62.77)
 - open/close 4403 (time 1788685932.84 total 70.05 last 66.87)
 - open/close 5012 (time 1788685942.84 total 80.05 last 60.89)
 - open/close 5663 (time 1788685952.85 total 90.06 last 65.06)
 - open/close 6352 (time 1788685962.86 total 100.07 last 68.82)
 - open/close 6954 (time 1788685972.87 total 110.07 last 60.17)
 - open/close 7609 (time 1788685982.87 total 120.08 last 65.47)
 - open/close 8182 (time 1788685992.88 total 130.09 last 57.23)
 - open/close 8714 (time 1788686002.90 total 140.10 last 53.13)
 - open/close 9340 (time 1788686012.91 total 150.12 last 62.49)
 - open/close 9988 (time 1788686022.93 total 160.14 last 64.70)
total: 10000 open/close in 160.45 seconds: 62.33 ops/second
 - unlinked 0 (time 1788686028 ; total 0 ; last 0)
total: 10000 unlinks in 95 seconds: 105.263161 unlinks/second
 - open/close 627 (time 1788686139.26 total 10.01 last 62.65)
 - open/close 1268 (time 1788686149.26 total 20.01 last 64.09)
 - open/close 1919 (time 1788686159.27 total 30.01 last 65.07)
 - open/close 2548 (time 1788686169.28 total 40.02 last 62.84)
 - open/close 3226 (time 1788686179.28 total 50.02 last 67.80)
 - open/close 3901 (time 1788686189.29 total 60.03 last 67.44)
 - open/close 4569 (time 1788686199.29 total 70.04 last 66.78)
 - open/close 5154 (time 1788686209.29 total 80.04 last 58.47)
 - open/close 5759 (time 1788686219.30 total 90.04 last 60.48)
 - open/close 6423 (time 1788686229.30 total 100.05 last 66.38)
 - open/close 7064 (time 1788686239.31 total 110.05 last 64.05)
 - open/close 7697 (time 1788686249.31 total 120.06 last 63.29)
 - open/close 8357 (time 1788686259.33 total 130.08 last 65.86)
 - open/close 9007 (time 1788686269.34 total 140.09 last 64.94)
 - open/close 9656 (time 1788686279.35 total 150.09 last 64.86)
total: 10000 open/close in 154.97 seconds: 64.53 ops/second
 - unlinked 0 (time 1788686288 ; total 0 ; last 0)
total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second
 - open/close 700 (time 1788686407.29 total 10.00 last 69.97)
 - open/close 1332 (time 1788686417.30 total 20.01 last 63.14)
 - open/close 1974 (time 1788686427.30 total 30.01 last 64.19)
 - open/close 2688 (time 1788686437.30 total 40.02 last 71.38)
 - open/close 3389 (time 1788686447.30 total 50.02 last 70.09)
 - open/close 4024 (time 1788686457.32 total 60.04 last 63.39)
 - open/close 4539 (time 1788686467.35 total 70.06 last 51.38)
 - open/close 5061 (time 1788686477.36 total 80.08 last 52.11)
 - open/close 5635 (time 1788686487.37 total 90.09 last 57.34)
 - open/close 6254 (time 1788686497.37 total 100.09 last 61.90)
 - open/close 6943 (time 1788686507.39 total 110.10 last 68.80)
 - open/close 7611 (time 1788686517.40 total 120.11 last 66.75)
 - open/close 8276 (time 1788686527.41 total 130.12 last 66.42)
 - open/close 8864 (time 1788686537.43 total 140.14 last 58.67)
 - open/close 9529 (time 1788686547.43 total 150.15 last 66.47)
total: 10000 open/close in 156.51 seconds: 63.89 ops/second
 - unlinked 0 (time 1788686557 ; total 0 ; last 0)
total: 10000 unlinks in 93 seconds: 107.526878 unlinks/second
 - open/close 686 (time 1788686664.11 total 10.01 last 68.53)
 - open/close 1399 (time 1788686674.11 total 20.02 last 71.26)
 - open/close 2055 (time 1788686684.11 total 30.02 last 65.59)
 - open/close 2737 (time 1788686694.11 total 40.02 last 68.19)
 - open/close 3422 (time 1788686704.12 total 50.02 last 68.47)
 - open/close 4108 (time 1788686714.12 total 60.03 last 68.56)
 - open/close 4764 (time 1788686724.14 total 70.04 last 65.52)
 - open/close 5372 (time 1788686734.14 total 80.04 last 60.80)
 - open/close 5925 (time 1788686744.15 total 90.05 last 55.26)
 - open/close 6542 (time 1788686754.15 total 100.05 last 61.68)
 - open/close 7209 (time 1788686764.16 total 110.06 last 66.63)
 - open/close 7883 (time 1788686774.16 total 120.07 last 67.38)
 - open/close 8592 (time 1788686784.18 total 130.08 last 70.81)
 - open/close 9219 (time 1788686794.22 total 140.12 last 62.43)
 - open/close 9875 (time 1788686804.22 total 150.13 last 65.58)
total: 10000 open/close in 152.11 seconds: 65.74 ops/second
 - unlinked 0 (time 1788686810 ; total 0 ; last 0)
total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second
 - open/close 658 (time 1788686921.23 total 10.00 last 65.78)
 - open/close 1278 (time 1788686931.24 total 20.01 last 61.95)
 - open/close 1854 (time 1788686941.25 total 30.02 last 57.54)
 - open/close 2354 (time 1788686951.27 total 40.04 last 49.92)
 - open/close 3018 (time 1788686961.27 total 50.04 last 66.37)
 - open/close 3679 (time 1788686971.28 total 60.05 last 66.06)
 - open/close 4389 (time 1788686981.28 total 70.05 last 70.97)
 - open/close 5008 (time 1788686991.28 total 80.06 last 61.89)
 - open/close 5645 (time 1788687001.28 total 90.06 last 63.69)
 - open/close 6260 (time 1788687011.30 total 100.07 last 61.42)
 - open/close 6977 (time 1788687021.30 total 110.08 last 71.65)
 - open/close 7645 (time 1788687031.32 total 120.09 last 66.71)
 - open/close 8299 (time 1788687041.33 total 130.10 last 65.31)
 - open/close 8936 (time 1788687051.34 total 140.12 last 63.63)
 - open/close 9605 (time 1788687061.36 total 150.13 last 66.82)
total: 10000 open/close in 156.00 seconds: 64.10 ops/second
 - unlinked 0 (time 1788687071 ; total 0 ; last 0)
total: 10000 unlinks in 92 seconds: 108.695656 unlinks/second
rm: missing operand
Try 'rm --help' for more information.
umount lustre on /mnt/lustre.....
Stopping client oleg443-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg443-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg443-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.143@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.143@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg443-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-OST0000
oleg443-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg443-server: oleg443-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg443-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg443-client.virtnet:  -o user_xattr,flock 192.168.204.143@tcp:/lustre /mnt/lustre
On OST0, 20326 used inodes rc=0
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 22
umount lustre on /mnt/lustre.....
Stopping client oleg443-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg443-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg443-server

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre:OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.204.143@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1/ost1
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1/ost1 properties
  lustre:mgsnode=192.168.204.143@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre:OST0000
checking for existing Lustre data: found

   Read previous values:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: sys.timeout=20 autodegrade=on mgsnode=192.168.204.143@tcp

   Permanent disk data:
Device:     lustre-ost1/ost1
Target:     lustre-OST0000
Index:      0
Lustre FS:  lustre
Mount type: zfs
Flags:      0x42
              (OST update )
Persistent mount opts: 
Parameters: sys.timeout=20 autodegrade=on mgsnode=192.168.204.143@tcp autodegrade=on
  lustre:svname=lustre-OST0000
Writing lustre-ost1/ost1 properties
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:mgsnode=192.168.204.143@tcp
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=66
  lustre:index=0
  lustre:fsname=lustre
  lustre:svname=lustre-OST0000
start ost1 service on oleg443-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg443-server: oleg443-server.virtnet: executing set_default_debug -1 all
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 1
Started lustre-OST0000
oleg443-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
oleg443-server: oleg443-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg443-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
mount lustre  on /mnt/lustre.....
Starting client: oleg443-client.virtnet:  -o user_xattr,flock 192.168.204.143@tcp:/lustre /mnt/lustre
umount lustre on /mnt/lustre.....
Stopping client oleg443-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg443-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg443-server
stop mds service on oleg443-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg443-server
unloading modules via unload_modules_local on: 'oleg443-server'
oleg443-server: oleg443-server.virtnet: executing unload_modules_local
oleg443-server: kmemleak disabled
modules unloaded.
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 2
pdsh@oleg443-client: oleg443-client: ssh exited with exit code 2
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 2
pdsh@oleg443-client: oleg443-client: ssh exited with exit code 2
PASS 69 (2882s)

== conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 05:34:59 (1788687299)

 SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs
SKIP 111 (3s)
Stopping clients: oleg443-client.virtnet /mnt/lustre (opts:-f)
Stopping clients: oleg443-client.virtnet /mnt/lustre2 (opts:-f)
pdsh@oleg443-client: oleg443-server: ssh exited with exit code 2
oleg443-server: oleg443-server.virtnet: executing set_hostid
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x. 1 green green 1921056 Sep  5 18:57 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg443-server'
oleg443-server: oleg443-server.virtnet: executing load_modules_local
oleg443-server: kmemleak disabled
oleg443-server: Loading modules from /home/green/git/lustre-release/lustre
oleg443-server: detected 4 online CPUs by sysfs
oleg443-server: MODOPTS_LIBCFS=
oleg443-server: Force libcfs to create 2 CPU partitions
oleg443-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg443-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg443-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg443-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
== conf-sanity test complete, duration 3372 sec ========== 05:36:18 (1788687378)
=== conf-sanity: start cleanup 05:36:21 (1788687381) ===
=== conf-sanity: finish cleanup 05:36:24 (1788687384) ===