== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 04:19:27 (1715588367)
start mds service on oleg439-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
loading modules on: 'oleg439-server'
oleg439-server: oleg439-server.virtnet: executing load_modules_local
oleg439-server: Loading modules from /home/green/git/lustre-release/lustre
oleg439-server: detected 4 online CPUs by sysfs
oleg439-server: Force libcfs to create 2 CPU partitions
oleg439-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg439-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg439-server: oleg439-server.virtnet: executing set_default_debug -1 all
pdsh@oleg439-client: oleg439-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg439-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg439-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg439-server: oleg439-server.virtnet: executing set_default_debug -1 all
pdsh@oleg439-client: oleg439-server: ssh exited with exit code 1
Started lustre-OST0000
oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg439-client.virtnet:  -o user_xattr,flock oleg439-server@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 702 (time 1715588404.13 total 10.00 last 70.19)
 - open/close 1160 (time 1715588414.61 total 20.48 last 43.71)
 - open/close 1756 (time 1715588425.40 total 31.27 last 55.24)
 - open/close 2296 (time 1715588435.85 total 41.72 last 51.65)
 - open/close 2638 (time 1715588446.02 total 51.89 last 33.65)
 - open/close 3289 (time 1715588456.32 total 62.19 last 63.19)
 - open/close 4049 (time 1715588466.79 total 72.66 last 72.59)
 - open/close 4763 (time 1715588477.23 total 83.11 last 68.35)
 - open/close 5443 (time 1715588487.52 total 93.39 last 66.11)
 - open/close 6033 (time 1715588497.71 total 103.58 last 57.89)
 - open/close 6804 (time 1715588508.19 total 114.06 last 73.57)
 - open/close 7471 (time 1715588518.48 total 124.35 last 64.87)
 - open/close 8162 (time 1715588528.85 total 134.72 last 66.62)
 - open/close 8648 (time 1715588539.10 total 144.97 last 47.42)
 - open/close 9179 (time 1715588549.70 total 155.57 last 50.09)
 - open/close 9715 (time 1715588560.22 total 166.09 last 50.95)
 - open/close 10000 (time 1715588569.32 total 175.19 last 31.31)
 - open/close 10579 (time 1715588579.32 total 185.19 last 57.89)
 - open/close 10938 (time 1715588589.45 total 195.32 last 35.44)
 - open/close 11606 (time 1715588599.85 total 205.73 last 64.21)
 - open/close 12297 (time 1715588610.26 total 216.13 last 66.43)
 - open/close 13046 (time 1715588620.71 total 226.58 last 71.64)
 - open/close 13660 (time 1715588630.89 total 236.77 last 60.31)
 - open/close 14276 (time 1715588641.23 total 247.10 last 59.60)
 - open/close 17005 (time 1715588651.99 total 257.86 last 253.60)
 - open/close 20000 (time 1715588660.51 total 266.38 last 351.54)
 - open/close 25428 (time 1715588670.51 total 276.38 last 542.72)
 - open/close 30000 (time 1715588678.97 total 284.84 last 540.38)
 - open/close 35250 (time 1715588688.97 total 294.85 last 524.91)
 - open/close 40000 (time 1715588697.94 total 303.82 last 529.52)
 - open/close 45346 (time 1715588707.95 total 313.82 last 534.58)
 - open/close 49966 (time 1715588717.95 total 323.82 last 461.94)
total: 50000 open/close in 323.94 seconds: 154.35 ops/second
 - unlinked 0 (time 1715588719 ; total 0 ; last 0)
 - unlinked 10000 (time 1715588732 ; total 13 ; last 13)
 - unlinked 20000 (time 1715588744 ; total 25 ; last 12)
 - unlinked 30000 (time 1715588755 ; total 36 ; last 11)
 - unlinked 40000 (time 1715588767 ; total 48 ; last 12)
total: 50000 unlinks in 59 seconds: 847.457642 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg439-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg439-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg439-server
stop mds service on oleg439-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg439-server
unloading modules on: 'oleg439-server'
oleg439-server: oleg439-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg439-client: oleg439-client: ssh exited with exit code 2
pdsh@oleg439-client: oleg439-server: ssh exited with exit code 2
pdsh@oleg439-client: oleg439-client: ssh exited with exit code 2
pdsh@oleg439-client: oleg439-server: ssh exited with exit code 2