== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:22:50 (1717557770)
start mds service on oleg145-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
loading modules on: 'oleg145-server'
oleg145-server: oleg145-server.virtnet: executing load_modules_local
oleg145-server: Loading modules from /home/green/git/lustre-release/lustre
oleg145-server: detected 4 online CPUs by sysfs
oleg145-server: Force libcfs to create 2 CPU partitions
oleg145-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg145-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all
pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg145-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg145-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all
pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1
Started lustre-OST0000
oleg145-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg145-client.virtnet:  -o user_xattr,flock oleg145-server@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 611 (time 1717557803.47 total 10.21 last 59.86)
 - open/close 924 (time 1717557815.08 total 21.82 last 26.96)
 - open/close 1526 (time 1717557825.38 total 32.12 last 58.44)
 - open/close 1999 (time 1717557836.33 total 43.07 last 43.19)
 - open/close 2996 (time 1717557847.19 total 53.93 last 91.77)
 - open/close 3564 (time 1717557857.35 total 64.09 last 55.93)
 - open/close 4180 (time 1717557867.50 total 74.24 last 60.66)
 - open/close 4806 (time 1717557877.76 total 84.50 last 61.02)
 - open/close 5351 (time 1717557889.95 total 96.69 last 44.71)
 - open/close 5933 (time 1717557900.29 total 107.03 last 56.30)
 - open/close 6376 (time 1717557912.55 total 119.29 last 36.14)
 - open/close 6651 (time 1717557923.47 total 130.20 last 25.19)
 - open/close 6821 (time 1717557934.99 total 141.72 last 14.76)
 - open/close 7515 (time 1717557945.59 total 152.33 last 65.42)
 - open/close 8066 (time 1717557956.79 total 163.53 last 49.21)
 - open/close 8552 (time 1717557967.72 total 174.46 last 44.45)
 - open/close 9290 (time 1717557978.15 total 184.89 last 70.79)
 - open/close 9637 (time 1717557988.83 total 195.56 last 32.51)
 - open/close 10000 (time 1717557995.64 total 202.37 last 53.28)
 - open/close 10437 (time 1717558006.56 total 213.30 last 40.02)
 - open/close 10967 (time 1717558016.56 total 223.30 last 53.00)
 - open/close 11577 (time 1717558026.78 total 233.52 last 59.67)
 - open/close 12137 (time 1717558036.85 total 243.59 last 55.62)
 - open/close 12615 (time 1717558046.86 total 253.60 last 47.74)
 - open/close 13653 (time 1717558056.86 total 263.60 last 103.80)
 - open/close 18540 (time 1717558066.86 total 273.60 last 488.70)
 - open/close 20000 (time 1717558069.47 total 276.20 last 560.32)
 - open/close 25298 (time 1717558079.47 total 286.20 last 529.78)
 - open/close 30000 (time 1717558088.14 total 294.88 last 542.24)
 - open/close 35108 (time 1717558098.14 total 304.88 last 510.77)
 - open/close 40000 (time 1717558107.58 total 314.31 last 518.38)
 - open/close 45214 (time 1717558117.58 total 324.32 last 521.31)
total: 50000 open/close in 333.48 seconds: 149.93 ops/second
 - unlinked 0 (time 1717558127 ; total 0 ; last 0)
 - unlinked 10000 (time 1717558138 ; total 11 ; last 11)
 - unlinked 20000 (time 1717558150 ; total 23 ; last 12)
 - unlinked 30000 (time 1717558161 ; total 34 ; last 11)
 - unlinked 40000 (time 1717558172 ; total 45 ; last 11)
total: 50000 unlinks in 56 seconds: 892.857117 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg145-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg145-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg145-server
stop mds service on oleg145-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg145-server
unloading modules on: 'oleg145-server'
oleg145-server: oleg145-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg145-client: oleg145-client: ssh exited with exit code 2
pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2
pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2
pdsh@oleg145-client: oleg145-client: ssh exited with exit code 2