== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 03:51:19 (1749541879)
start mds service on oleg359-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
libkmod: kmod_module_get_size: failed to read coresize from /sys/module/pcc_cpufreq
libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
ln: failed to create symbolic link '/sbin/.libs': Read-only file system
loading modules on: 'oleg359-server'
oleg359-server: oleg359-server.virtnet: executing load_modules_local
oleg359-server: Loading modules from /home/green/git/lustre-release/lustre
oleg359-server: detected 4 online CPUs by sysfs
oleg359-server: MODOPTS_LIBCFS=
oleg359-server: Force libcfs to create 2 CPU partitions
oleg359-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory
oleg359-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg359-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg359-server: oleg359-server.virtnet: executing set_default_debug -1 all
pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg359-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg359-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg359-server: oleg359-server.virtnet: executing set_default_debug -1 all
pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1
Started lustre-OST0000
oleg359-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg359-client.virtnet:  -o user_xattr,flock 192.168.203.159@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 951 (time 1749541914.28 total 10.71 last 88.81)
 - open/close 1596 (time 1749541924.45 total 20.87 last 63.45)
 - open/close 2545 (time 1749541935.19 total 31.61 last 88.37)
 - open/close 3382 (time 1749541945.73 total 42.16 last 79.35)
 - open/close 4021 (time 1749541955.93 total 52.35 last 62.69)
 - open/close 4692 (time 1749541966.28 total 62.71 last 64.80)
 - open/close 5291 (time 1749541976.40 total 72.83 last 59.17)
 - open/close 6097 (time 1749541986.88 total 83.31 last 76.91)
 - open/close 7018 (time 1749541997.59 total 94.02 last 86.01)
 - open/close 7627 (time 1749542007.72 total 104.15 last 60.10)
 - open/close 8433 (time 1749542018.31 total 114.74 last 76.13)
 - open/close 9328 (time 1749542029.09 total 125.52 last 83.03)
 - open/close 10000 (time 1749542036.35 total 132.77 last 92.63)
 - open/close 10597 (time 1749542046.63 total 143.06 last 58.03)
 - open/close 10954 (time 1749542057.43 total 153.86 last 33.05)
 - open/close 11685 (time 1749542067.83 total 164.26 last 70.32)
 - open/close 12221 (time 1749542077.83 total 174.26 last 53.60)
 - open/close 13013 (time 1749542088.43 total 184.86 last 74.72)
 - open/close 13725 (time 1749542098.88 total 195.31 last 68.13)
 - open/close 14363 (time 1749542109.11 total 205.54 last 62.34)
 - open/close 15199 (time 1749542119.72 total 216.14 last 78.85)
 - open/close 16118 (time 1749542130.46 total 226.88 last 85.57)
 - open/close 16917 (time 1749542140.98 total 237.41 last 75.92)
 - open/close 20000 (time 1749542150.74 total 247.17 last 315.71)
 - open/close 25489 (time 1749542160.75 total 257.17 last 548.84)
 - open/close 30000 (time 1749542169.03 total 265.46 last 544.49)
 - open/close 35381 (time 1749542179.03 total 275.46 last 538.09)
 - open/close 40000 (time 1749542187.70 total 284.13 last 532.76)
 - open/close 45364 (time 1749542197.70 total 294.13 last 536.33)
total: 50000 open/close in 303.01 seconds: 165.01 ops/second
 - unlinked 0 (time 1749542207 ; total 0 ; last 0)
 - unlinked 10000 (time 1749542218 ; total 11 ; last 11)
 - unlinked 20000 (time 1749542229 ; total 22 ; last 11)
 - unlinked 30000 (time 1749542239 ; total 32 ; last 10)
 - unlinked 40000 (time 1749542251 ; total 44 ; last 12)
total: 50000 unlinks in 54 seconds: 925.925903 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg359-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg359-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg359-server
stop mds service on oleg359-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg359-server
unloading modules via unload_modules_local on: 'oleg359-server'
oleg359-server: oleg359-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg359-client: oleg359-server: ssh exited with exit code 2
pdsh@oleg359-client: oleg359-client: ssh exited with exit code 2
pdsh@oleg359-client: oleg359-client: ssh exited with exit code 2
pdsh@oleg359-client: oleg359-server: ssh exited with exit code 2