== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 00:13:49 (1721880829) start mds service on oleg236-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg236-server' oleg236-server: oleg236-server.virtnet: executing load_modules_local oleg236-server: Loading modules from /home/green/git/lustre-release/lustre oleg236-server: detected 4 online CPUs by sysfs oleg236-server: Force libcfs to create 2 CPU partitions oleg236-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg236-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg236-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg236-server: oleg236-server.virtnet: executing set_default_debug -1 all pdsh@oleg236-client: oleg236-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg236-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg236-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg236-server: oleg236-server.virtnet: executing set_default_debug -1 all pdsh@oleg236-client: oleg236-server: ssh exited with exit code 1 Started lustre-OST0000 oleg236-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg236-client.virtnet: -o user_xattr,flock oleg236-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 744 (time 1721880863.80 total 10.41 last 71.44) - open/close 1471 (time 1721880874.16 total 20.78 last 70.16) - open/close 2195 (time 1721880884.49 total 31.11 last 70.05) - open/close 2930 (time 1721880894.86 total 41.48 last 70.91) - open/close 3676 (time 1721880905.31 total 51.92 last 71.41) - open/close 4256 (time 1721880915.68 total 62.30 last 55.90) - open/close 4732 (time 1721880925.86 total 72.48 last 46.75) - open/close 5355 (time 1721880936.06 total 82.68 last 61.10) - open/close 6006 (time 1721880946.34 total 92.95 last 63.36) - open/close 6922 (time 1721880957.16 total 103.78 last 84.60) - open/close 7423 (time 1721880967.25 total 113.86 last 49.69) - open/close 8104 (time 1721880977.66 total 124.28 last 65.37) - open/close 8718 (time 1721880987.92 total 134.54 last 59.86) - open/close 9599 (time 1721880998.63 total 145.25 last 82.29) - open/close 10000 (time 1721881003.41 total 150.02 last 83.91) - open/close 10625 (time 1721881013.66 total 160.28 last 60.95) - open/close 11301 (time 1721881023.99 total 170.61 last 65.45) - open/close 11890 (time 1721881034.17 total 180.79 last 57.86) - open/close 12608 (time 1721881044.61 total 191.23 last 68.73) - open/close 13193 (time 1721881059.85 total 206.46 last 38.40) - open/close 13858 (time 1721881070.15 total 216.77 last 64.53) - open/close 14492 (time 1721881080.40 total 227.02 last 61.86) - open/close 15143 (time 1721881090.66 total 237.28 last 63.45) - open/close 20000 (time 1721881099.71 total 246.32 last 536.95) - open/close 25356 (time 1721881109.71 total 256.32 last 535.58) - open/close 30000 (time 1721881118.58 total 265.20 last 523.36) - open/close 35182 (time 1721881128.58 total 275.20 last 518.15) - open/close 40000 (time 1721881137.73 total 284.35 last 526.44) - open/close 45127 (time 1721881147.73 total 294.35 last 512.68) total: 50000 open/close in 303.77 seconds: 164.60 ops/second - unlinked 0 (time 1721881158 ; total 0 ; last 0) - unlinked 10000 (time 1721881169 ; total 11 ; last 11) - unlinked 20000 (time 1721881180 ; total 22 ; last 11) - unlinked 30000 (time 1721881192 ; total 34 ; last 12) - unlinked 40000 (time 1721881203 ; total 45 ; last 11) total: 50000 unlinks in 56 seconds: 892.857117 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg236-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg236-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg236-server stop mds service on oleg236-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg236-server unloading modules on: 'oleg236-server' oleg236-server: oleg236-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg236-client: oleg236-client: ssh exited with exit code 2 pdsh@oleg236-client: oleg236-server: ssh exited with exit code 2 pdsh@oleg236-client: oleg236-client: ssh exited with exit code 2 pdsh@oleg236-client: oleg236-server: ssh exited with exit code 2