== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 05:42:58 (1734432178) start mds service on oleg312-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing load_modules_local oleg312-server: Loading modules from /home/green/git/lustre-release/lustre oleg312-server: detected 4 online CPUs by sysfs oleg312-server: MODOPTS_LIBCFS= oleg312-server: Force libcfs to create 2 CPU partitions oleg312-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg312-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg312-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg312-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg312-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg312-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg312-server: oleg312-server.virtnet: executing set_default_debug -1 all pdsh@oleg312-client: oleg312-server: ssh exited with exit code 1 Started lustre-OST0000 oleg312-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg312-client.virtnet: -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 270 (time 1734432216.54 total 10.00 last 26.99) - open/close 521 (time 1734432227.52 total 20.98 last 22.85) - open/close 865 (time 1734432238.11 total 31.57 last 32.50) - open/close 1037 (time 1734432248.78 total 42.24 last 16.12) - open/close 1266 (time 1734432258.78 total 52.24 last 22.90) - open/close 1438 (time 1734432269.40 total 62.86 last 16.20) - open/close 1617 (time 1734432280.09 total 73.56 last 16.73) - open/close 1896 (time 1734432290.20 total 83.66 last 27.62) - open/close 2209 (time 1734432300.59 total 94.05 last 30.13) - open/close 2558 (time 1734432311.34 total 104.81 last 32.44) - open/close 2807 (time 1734432321.35 total 114.81 last 24.90) - open/close 3209 (time 1734432332.33 total 125.79 last 36.61) - open/close 3478 (time 1734432342.41 total 135.88 last 26.67) - open/close 3760 (time 1734432352.57 total 146.03 last 27.78) - open/close 4137 (time 1734432363.24 total 156.71 last 35.31) - open/close 4365 (time 1734432374.13 total 167.59 last 20.95) - open/close 4733 (time 1734432384.91 total 178.37 last 34.12) - open/close 5007 (time 1734432395.22 total 188.68 last 26.58) - open/close 5274 (time 1734432405.72 total 199.19 last 25.42) - open/close 5555 (time 1734432416.00 total 209.46 last 27.36) - open/close 5864 (time 1734432426.44 total 219.90 last 29.59) - open/close 6162 (time 1734432436.80 total 230.26 last 28.76) - open/close 6417 (time 1734432447.21 total 240.68 last 24.48) - open/close 6780 (time 1734432458.08 total 251.54 last 33.42) - open/close 7083 (time 1734432468.74 total 262.20 last 28.42) - open/close 7310 (time 1734432478.92 total 272.38 last 22.30) - open/close 7654 (time 1734432489.68 total 283.14 last 31.97) - open/close 8318 (time 1734432499.68 total 293.14 last 66.39) - open/close 10000 (time 1734432507.56 total 301.02 last 213.45) - open/close 12584 (time 1734432517.56 total 311.02 last 258.36) - open/close 14984 (time 1734432527.56 total 321.02 last 239.99) - open/close 16801 (time 1734432537.56 total 331.03 last 181.63) - open/close 18786 (time 1734432547.56 total 341.03 last 198.45) - open/close 20000 (time 1734432552.40 total 345.86 last 251.05) - open/close 22918 (time 1734432562.40 total 355.86 last 291.77) - open/close 25775 (time 1734432572.40 total 365.87 last 285.67) - open/close 29216 (time 1734432582.40 total 375.87 last 344.02) - open/close 30000 (time 1734432585.12 total 378.59 last 288.29) - open/close 33301 (time 1734432595.12 total 388.59 last 330.08) - open/close 36589 (time 1734432605.13 total 398.59 last 328.75) - open/close 39561 (time 1734432615.13 total 408.59 last 297.20) - open/close 42906 (time 1734432625.13 total 418.59 last 334.46) - open/close 46394 (time 1734432635.13 total 428.59 last 348.78) total: 50000 open/close in 437.04 seconds: 114.41 ops/second - unlinked 0 (time 1734432644 ; total 0 ; last 0) - unlinked 10000 (time 1734432657 ; total 13 ; last 13) - unlinked 20000 (time 1734432671 ; total 27 ; last 14) - unlinked 30000 (time 1734432685 ; total 41 ; last 14) - unlinked 40000 (time 1734432702 ; total 58 ; last 17) total: 50000 unlinks in 74 seconds: 675.675659 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg312-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg312-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg312-server stop mds service on oleg312-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg312-server unloading modules via unload_modules_local on: 'oleg312-server' oleg312-server: oleg312-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg312-client: oleg312-client: ssh exited with exit code 2 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 2 pdsh@oleg312-client: oleg312-client: ssh exited with exit code 2 pdsh@oleg312-client: oleg312-server: ssh exited with exit code 2