== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 11:39:15 (1740674355)
start mds service on oleg111-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
ln: failed to create symbolic link '/sbin/.libs': Read-only file system
loading modules on: 'oleg111-server'
oleg111-server: oleg111-server.virtnet: executing load_modules_local
oleg111-server: Loading modules from /home/green/git/lustre-release/lustre
oleg111-server: detected 4 online CPUs by sysfs
oleg111-server: MODOPTS_LIBCFS=
oleg111-server: Force libcfs to create 2 CPU partitions
oleg111-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory
oleg111-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg111-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg111-server: oleg111-server.virtnet: executing set_default_debug -1 all
pdsh@oleg111-client: oleg111-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg111-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg111-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg111-server: oleg111-server.virtnet: executing set_default_debug -1 all
pdsh@oleg111-client: oleg111-server: ssh exited with exit code 1
Started lustre-OST0000
oleg111-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg111-client.virtnet:  -o user_xattr,flock 192.168.201.111@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 486 (time 1740674392.63 total 10.34 last 46.99)
 - open/close 1108 (time 1740674403.12 total 20.83 last 59.33)
 - open/close 1381 (time 1740674414.07 total 31.78 last 24.92)
 - open/close 1814 (time 1740674424.34 total 42.05 last 42.17)
 - open/close 2525 (time 1740674435.18 total 52.88 last 65.63)
 - open/close 2925 (time 1740674446.08 total 63.79 last 36.67)
 - open/close 3392 (time 1740674457.60 total 75.31 last 40.55)
 - open/close 3899 (time 1740674468.08 total 85.79 last 48.36)
 - open/close 4561 (time 1740674478.08 total 95.79 last 66.19)
 - open/close 4943 (time 1740674488.21 total 105.92 last 37.71)
 - open/close 5499 (time 1740674498.81 total 116.52 last 52.46)
 - open/close 5831 (time 1740674508.89 total 126.60 last 32.95)
 - open/close 6279 (time 1740674519.26 total 136.97 last 43.19)
 - open/close 6674 (time 1740674529.31 total 147.01 last 39.32)
 - open/close 7201 (time 1740674539.51 total 157.22 last 51.65)
 - open/close 7534 (time 1740674549.51 total 167.22 last 33.29)
 - open/close 8062 (time 1740674559.56 total 177.27 last 52.55)
 - open/close 8937 (time 1740674570.27 total 187.98 last 81.70)
 - open/close 9447 (time 1740674580.43 total 198.14 last 50.19)
 - open/close 10000 (time 1740674588.51 total 206.22 last 68.45)
 - open/close 10703 (time 1740674598.88 total 216.59 last 67.77)
 - open/close 11466 (time 1740674609.34 total 227.05 last 72.97)
 - open/close 12116 (time 1740674619.58 total 237.29 last 63.46)
 - open/close 12599 (time 1740674629.58 total 247.29 last 48.30)
 - open/close 13223 (time 1740674639.74 total 257.45 last 61.43)
 - open/close 14091 (time 1740674650.45 total 268.16 last 81.04)
 - open/close 18570 (time 1740674660.45 total 278.16 last 447.88)
 - open/close 20000 (time 1740674663.16 total 280.87 last 527.35)
 - open/close 25068 (time 1740674673.16 total 290.87 last 506.72)
 - open/close 29751 (time 1740674683.17 total 300.87 last 468.27)
 - open/close 34342 (time 1740674693.17 total 310.88 last 459.05)
 - open/close 39846 (time 1740674703.17 total 320.88 last 550.33)
 - open/close 45480 (time 1740674713.17 total 330.88 last 563.39)
total: 50000 open/close in 339.22 seconds: 147.40 ops/second
 - unlinked 0 (time 1740674722 ; total 0 ; last 0)
 - unlinked 10000 (time 1740674733 ; total 11 ; last 11)
 - unlinked 20000 (time 1740674748 ; total 26 ; last 15)
 - unlinked 30000 (time 1740674776 ; total 54 ; last 28)
 - unlinked 40000 (time 1740674798 ; total 76 ; last 22)
total: 50000 unlinks in 97 seconds: 515.463928 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg111-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg111-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg111-server
stop mds service on oleg111-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg111-server
unloading modules via unload_modules_local on: 'oleg111-server'
oleg111-server: oleg111-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg111-client: oleg111-client: ssh exited with exit code 2
pdsh@oleg111-client: oleg111-server: ssh exited with exit code 2
pdsh@oleg111-client: oleg111-client: ssh exited with exit code 2
pdsh@oleg111-client: oleg111-server: ssh exited with exit code 2