== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 14:00:31 (1734116431) start mds service on oleg430-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg430-server' oleg430-server: oleg430-server.virtnet: executing load_modules_local oleg430-server: Loading modules from /home/green/git/lustre-release/lustre oleg430-server: detected 4 online CPUs by sysfs oleg430-server: MODOPTS_LIBCFS= oleg430-server: Force libcfs to create 2 CPU partitions oleg430-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg430-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg430-server: oleg430-server.virtnet: executing set_default_debug -1 all pdsh@oleg430-client: oleg430-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg430-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg430-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg430-server: oleg430-server.virtnet: executing set_default_debug -1 all pdsh@oleg430-client: oleg430-server: ssh exited with exit code 1 Started lustre-OST0000 oleg430-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg430-client.virtnet: -o user_xattr,flock 192.168.204.130@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 889 (time 1734116467.03 total 10.68 last 83.27) - open/close 1678 (time 1734116477.52 total 21.18 last 75.15) - open/close 2415 (time 1734116487.98 total 31.63 last 70.50) - open/close 3166 (time 1734116498.43 total 42.08 last 71.88) - open/close 4020 (time 1734116509.03 total 52.69 last 80.51) - open/close 4835 (time 1734116519.62 total 63.27 last 76.99) - open/close 5381 (time 1734116529.89 total 73.54 last 53.18) - open/close 6150 (time 1734116540.39 total 84.05 last 73.18) - open/close 6893 (time 1734116550.78 total 94.43 last 71.56) - open/close 7560 (time 1734116560.98 total 104.63 last 65.40) - open/close 8269 (time 1734116571.41 total 115.06 last 67.94) - open/close 8837 (time 1734116581.55 total 125.20 last 56.03) - open/close 9654 (time 1734116592.05 total 135.70 last 77.82) - open/close 10000 (time 1734116596.70 total 140.35 last 74.32) - open/close 10681 (time 1734116607.00 total 150.66 last 66.10) - open/close 11261 (time 1734116617.10 total 160.75 last 57.44) - open/close 12007 (time 1734116627.51 total 171.16 last 71.68) - open/close 12773 (time 1734116637.93 total 181.58 last 73.51) - open/close 13526 (time 1734116648.32 total 191.97 last 72.49) - open/close 14263 (time 1734116658.71 total 202.36 last 70.92) - open/close 14799 (time 1734116670.72 total 214.38 last 44.61) - open/close 15512 (time 1734116681.07 total 224.72 last 68.92) - open/close 16258 (time 1734116691.47 total 235.12 last 71.73) - open/close 20000 (time 1734116701.03 total 244.68 last 391.32) - open/close 25499 (time 1734116711.03 total 254.68 last 549.86) - open/close 30000 (time 1734116719.30 total 262.95 last 544.40) - open/close 35449 (time 1734116729.30 total 272.95 last 544.83) - open/close 40000 (time 1734116737.66 total 281.31 last 544.81) - open/close 45345 (time 1734116747.66 total 291.31 last 534.41) total: 50000 open/close in 300.01 seconds: 166.66 ops/second - unlinked 0 (time 1734116757 ; total 0 ; last 0) - unlinked 10000 (time 1734116767 ; total 10 ; last 10) - unlinked 20000 (time 1734116779 ; total 22 ; last 12) - unlinked 30000 (time 1734116790 ; total 33 ; last 11) - unlinked 40000 (time 1734116801 ; total 44 ; last 11) total: 50000 unlinks in 55 seconds: 909.090881 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg430-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg430-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg430-server stop mds service on oleg430-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg430-server unloading modules via unload_modules_local on: 'oleg430-server' oleg430-server: oleg430-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg430-client: oleg430-client: ssh exited with exit code 2 pdsh@oleg430-client: oleg430-server: ssh exited with exit code 2 pdsh@oleg430-client: oleg430-client: ssh exited with exit code 2 pdsh@oleg430-client: oleg430-server: ssh exited with exit code 2