== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 08:07:05 (1746792425) start mds service on oleg401-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing load_modules_local oleg401-server: Loading modules from /home/green/git/lustre-release/lustre oleg401-server: detected 4 online CPUs by sysfs oleg401-server: MODOPTS_LIBCFS= oleg401-server: Force libcfs to create 2 CPU partitions oleg401-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg401-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg401-server: oleg401-server.virtnet: executing set_default_debug -1 all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg401-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg401-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg401-server: oleg401-server.virtnet: executing set_default_debug -1 all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Started lustre-OST0000 oleg401-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg401-client.virtnet: -o user_xattr,flock 192.168.204.101@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 390 (time 1746792462.60 total 10.80 last 36.13) - open/close 990 (time 1746792474.11 total 22.30 last 52.13) - open/close 1620 (time 1746792484.34 total 32.54 last 61.55) - open/close 2208 (time 1746792494.66 total 42.86 last 56.99) - open/close 2711 (time 1746792505.12 total 53.32 last 48.09) - open/close 3190 (time 1746792515.28 total 63.48 last 47.16) - open/close 3709 (time 1746792525.30 total 73.50 last 51.79) - open/close 4384 (time 1746792535.64 total 83.84 last 65.29) - open/close 4816 (time 1746792545.66 total 93.86 last 43.08) - open/close 5148 (time 1746792555.76 total 103.96 last 32.88) - open/close 5600 (time 1746792565.93 total 114.13 last 44.47) - open/close 6155 (time 1746792576.49 total 124.69 last 52.55) - open/close 6726 (time 1746792586.49 total 134.69 last 57.09) - open/close 7295 (time 1746792596.75 total 144.95 last 55.46) - open/close 7740 (time 1746792606.75 total 154.95 last 44.50) - open/close 8145 (time 1746792616.75 total 164.95 last 40.50) - open/close 8904 (time 1746792628.22 total 176.42 last 66.17) - open/close 9586 (time 1746792638.50 total 186.70 last 66.35) - open/close 10000 (time 1746792644.27 total 192.47 last 71.77) - open/close 10785 (time 1746792654.85 total 203.05 last 74.20) - open/close 11410 (time 1746792665.09 total 213.29 last 61.02) - open/close 12287 (time 1746792675.78 total 223.98 last 82.03) - open/close 12981 (time 1746792686.07 total 234.27 last 67.46) - open/close 13708 (time 1746792696.42 total 244.62 last 70.24) - open/close 14206 (time 1746792706.42 total 254.62 last 49.79) - open/close 18599 (time 1746792716.42 total 264.62 last 439.25) - open/close 20000 (time 1746792719.22 total 267.42 last 501.37) - open/close 24162 (time 1746792729.22 total 277.42 last 416.19) - open/close 27903 (time 1746792739.22 total 287.42 last 374.04) - open/close 30000 (time 1746792746.06 total 294.26 last 306.37) - open/close 33562 (time 1746792756.06 total 304.26 last 356.11) - open/close 36192 (time 1746792766.07 total 314.27 last 262.95) - open/close 39583 (time 1746792776.07 total 324.27 last 338.99) - open/close 43380 (time 1746792786.07 total 334.27 last 379.68) - open/close 47985 (time 1746792796.07 total 344.27 last 460.46) total: 50000 open/close in 348.28 seconds: 143.56 ops/second - unlinked 0 (time 1746792800 ; total 0 ; last 0) - unlinked 10000 (time 1746792816 ; total 16 ; last 16) - unlinked 20000 (time 1746792827 ; total 27 ; last 11) - unlinked 30000 (time 1746792838 ; total 38 ; last 11) - unlinked 40000 (time 1746792849 ; total 49 ; last 11) total: 50000 unlinks in 60 seconds: 833.333313 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg401-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg401-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg401-server stop mds service on oleg401-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg401-server unloading modules via unload_modules_local on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg401-client: oleg401-client: ssh exited with exit code 2 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 2 pdsh@oleg401-client: oleg401-client: ssh exited with exit code 2 pdsh@oleg401-client: oleg401-server: ssh exited with exit code 2