== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 10:31:22 (1749479482) start mds service on oleg249-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg249-server' oleg249-server: oleg249-server.virtnet: executing load_modules_local oleg249-server: Loading modules from /home/green/git/lustre-release/lustre oleg249-server: detected 4 online CPUs by sysfs oleg249-server: MODOPTS_LIBCFS= oleg249-server: Force libcfs to create 2 CPU partitions oleg249-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg249-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg249-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg249-server: oleg249-server.virtnet: executing set_default_debug -1 all pdsh@oleg249-client: oleg249-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg249-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg249-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg249-server: oleg249-server.virtnet: executing set_default_debug -1 all pdsh@oleg249-client: oleg249-server: ssh exited with exit code 1 Started lustre-OST0000 oleg249-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg249-client.virtnet: -o user_xattr,flock 192.168.202.149@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 974 (time 1749479517.75 total 10.77 last 90.46) - open/close 1900 (time 1749479528.44 total 21.46 last 86.62) - open/close 2831 (time 1749479539.13 total 32.15 last 87.09) - open/close 3611 (time 1749479549.57 total 42.59 last 74.71) - open/close 4460 (time 1749479560.14 total 53.16 last 80.34) - open/close 5366 (time 1749479570.87 total 63.89 last 84.40) - open/close 6213 (time 1749479581.48 total 74.50 last 79.82) - open/close 6987 (time 1749479591.92 total 84.94 last 74.19) - open/close 7659 (time 1749479602.21 total 95.23 last 65.27) - open/close 8393 (time 1749479612.61 total 105.63 last 70.58) - open/close 8987 (time 1749479622.79 total 115.81 last 58.38) - open/close 9529 (time 1749479633.14 total 126.15 last 52.38) - open/close 10000 (time 1749479641.45 total 134.46 last 56.68) - open/close 10388 (time 1749479651.45 total 144.46 last 38.80) - open/close 11021 (time 1749479661.65 total 154.67 last 62.01) - open/close 11290 (time 1749479672.31 total 165.33 last 25.25) - open/close 12022 (time 1749479682.91 total 175.93 last 69.01) - open/close 12523 (time 1749479693.06 total 186.08 last 49.39) - open/close 13028 (time 1749479703.16 total 196.18 last 49.98) - open/close 13694 (time 1749479713.69 total 206.71 last 63.25) - open/close 14517 (time 1749479724.22 total 217.24 last 78.16) - open/close 15345 (time 1749479734.76 total 227.78 last 78.57) - open/close 16156 (time 1749479745.26 total 238.28 last 77.20) - open/close 16920 (time 1749479755.69 total 248.71 last 73.29) - open/close 20000 (time 1749479763.29 total 256.31 last 405.22) - open/close 25632 (time 1749479773.29 total 266.31 last 563.19) - open/close 30000 (time 1749479781.17 total 274.19 last 554.34) - open/close 35366 (time 1749479791.17 total 284.19 last 536.60) - open/close 40000 (time 1749479799.59 total 292.61 last 550.10) - open/close 45468 (time 1749479809.59 total 302.61 last 546.75) total: 50000 open/close in 310.95 seconds: 160.80 ops/second - unlinked 0 (time 1749479818 ; total 0 ; last 0) - unlinked 10000 (time 1749479829 ; total 11 ; last 11) - unlinked 20000 (time 1749479840 ; total 22 ; last 11) - unlinked 30000 (time 1749479851 ; total 33 ; last 11) - unlinked 40000 (time 1749479862 ; total 44 ; last 11) total: 50000 unlinks in 56 seconds: 892.857117 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg249-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg249-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg249-server stop mds service on oleg249-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg249-server unloading modules via unload_modules_local on: 'oleg249-server' oleg249-server: oleg249-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg249-client: oleg249-client: ssh exited with exit code 2 pdsh@oleg249-client: oleg249-server: ssh exited with exit code 2 pdsh@oleg249-client: oleg249-client: ssh exited with exit code 2 pdsh@oleg249-client: oleg249-server: ssh exited with exit code 2