== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 06:14:40 (1744020880)
start mds service on oleg308-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
ln: failed to create symbolic link '/sbin/.libs': Read-only file system
loading modules on: 'oleg308-server'
oleg308-server: oleg308-server.virtnet: executing load_modules_local
oleg308-server: Loading modules from /home/green/git/lustre-release/lustre
oleg308-server: detected 4 online CPUs by sysfs
oleg308-server: MODOPTS_LIBCFS=
oleg308-server: Force libcfs to create 2 CPU partitions
oleg308-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg308-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all
pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg308-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg308-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg308-server: oleg308-server.virtnet: executing set_default_debug -1 all
pdsh@oleg308-client: oleg308-server: ssh exited with exit code 1
Started lustre-OST0000
oleg308-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg308-client.virtnet:  -o user_xattr,flock 192.168.203.108@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 613 (time 1744020917.21 total 10.14 last 60.48)
 - open/close 1223 (time 1744020927.35 total 20.28 last 60.16)
 - open/close 1924 (time 1744020937.71 total 30.64 last 67.65)
 - open/close 2568 (time 1744020947.92 total 40.84 last 63.10)
 - open/close 3102 (time 1744020957.98 total 50.91 last 53.04)
 - open/close 3773 (time 1744020968.25 total 61.18 last 65.33)
 - open/close 4579 (time 1744020978.77 total 71.70 last 76.62)
 - open/close 5225 (time 1744020988.96 total 81.89 last 63.40)
 - open/close 5977 (time 1744020999.38 total 92.31 last 72.19)
 - open/close 6543 (time 1744021009.67 total 102.60 last 54.99)
 - open/close 7021 (time 1744021019.93 total 112.86 last 46.58)
 - open/close 7352 (time 1744021029.93 total 122.86 last 33.10)
 - open/close 7683 (time 1744021040.74 total 133.67 last 30.63)
 - open/close 8023 (time 1744021051.50 total 144.42 last 31.62)
 - open/close 8502 (time 1744021061.50 total 154.43 last 47.88)
 - open/close 9127 (time 1744021071.79 total 164.72 last 60.73)
 - open/close 9750 (time 1744021082.56 total 175.48 last 57.87)
 - open/close 10000 (time 1744021087.12 total 180.04 last 54.83)
 - open/close 10645 (time 1744021097.41 total 190.34 last 62.67)
 - open/close 11222 (time 1744021107.52 total 200.45 last 57.07)
 - open/close 11870 (time 1744021117.83 total 210.76 last 62.86)
 - open/close 12272 (time 1744021129.78 total 222.71 last 33.63)
 - open/close 12722 (time 1744021139.81 total 232.74 last 44.88)
 - open/close 13270 (time 1744021149.98 total 242.91 last 53.86)
 - open/close 17377 (time 1744021159.98 total 252.91 last 410.65)
 - open/close 20000 (time 1744021165.97 total 258.89 last 438.37)
 - open/close 25180 (time 1744021175.97 total 268.89 last 517.96)
 - open/close 29927 (time 1744021185.97 total 278.90 last 474.59)
 - open/close 34882 (time 1744021195.97 total 288.90 last 495.46)
 - open/close 39347 (time 1744021205.97 total 298.90 last 446.46)
 - open/close 43571 (time 1744021215.97 total 308.90 last 422.33)
 - open/close 48306 (time 1744021225.97 total 318.90 last 473.48)
total: 50000 open/close in 322.40 seconds: 155.09 ops/second
 - unlinked 0 (time 1744021230 ; total 0 ; last 0)
 - unlinked 10000 (time 1744021241 ; total 11 ; last 11)
 - unlinked 20000 (time 1744021253 ; total 23 ; last 12)
 - unlinked 30000 (time 1744021265 ; total 35 ; last 12)
 - unlinked 40000 (time 1744021277 ; total 47 ; last 12)
total: 50000 unlinks in 58 seconds: 862.068970 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg308-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg308-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg308-server
stop mds service on oleg308-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg308-server
unloading modules via unload_modules_local on: 'oleg308-server'
oleg308-server: oleg308-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg308-client: oleg308-client: ssh exited with exit code 2
pdsh@oleg308-client: oleg308-server: ssh exited with exit code 2
pdsh@oleg308-client: oleg308-client: ssh exited with exit code 2
pdsh@oleg308-client: oleg308-server: ssh exited with exit code 2