== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 16:54:23 (1741899263) start mds service on oleg428-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg428-server' oleg428-server: oleg428-server.virtnet: executing load_modules_local oleg428-server: Loading modules from /home/green/git/lustre-release/lustre oleg428-server: detected 4 online CPUs by sysfs oleg428-server: MODOPTS_LIBCFS= oleg428-server: Force libcfs to create 2 CPU partitions oleg428-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg428-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg428-server: oleg428-server.virtnet: executing set_default_debug -1 all pdsh@oleg428-client: oleg428-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg428-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg428-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg428-server: oleg428-server.virtnet: executing set_default_debug -1 all pdsh@oleg428-client: oleg428-server: ssh exited with exit code 1 Started lustre-OST0000 oleg428-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg428-client.virtnet: -o user_xattr,flock 192.168.204.128@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 329 (time 1741899300.35 total 10.01 last 32.87) - open/close 502 (time 1741899312.92 total 22.58 last 13.76) - open/close 752 (time 1741899323.01 total 32.67 last 24.78) - open/close 1055 (time 1741899333.40 total 43.06 last 29.16) - open/close 1764 (time 1741899344.18 total 53.84 last 65.78) - open/close 2282 (time 1741899354.67 total 64.33 last 49.37) - open/close 2899 (time 1741899365.16 total 74.81 last 58.86) - open/close 3266 (time 1741899375.16 total 84.81 last 36.70) - open/close 3699 (time 1741899385.35 total 95.01 last 42.47) - open/close 4379 (time 1741899396.01 total 105.66 last 63.83) - open/close 5168 (time 1741899406.01 total 115.66 last 78.90) - open/close 5788 (time 1741899416.44 total 126.09 last 59.43) - open/close 6180 (time 1741899427.38 total 137.03 last 35.84) - open/close 6797 (time 1741899437.71 total 147.36 last 59.71) - open/close 7466 (time 1741899448.26 total 157.91 last 63.42) - open/close 8003 (time 1741899458.63 total 168.28 last 51.79) - open/close 8503 (time 1741899468.91 total 178.57 last 48.62) - open/close 9183 (time 1741899479.54 total 189.19 last 64.00) - open/close 9798 (time 1741899490.03 total 199.68 last 58.62) - open/close 10000 (time 1741899492.54 total 202.19 last 80.45) - open/close 10574 (time 1741899502.92 total 212.57 last 55.30) - open/close 11267 (time 1741899513.42 total 223.08 last 65.99) - open/close 11980 (time 1741899524.18 total 233.84 last 66.26) - open/close 12614 (time 1741899534.75 total 244.40 last 60.01) - open/close 16028 (time 1741899544.75 total 254.40 last 341.37) - open/close 20000 (time 1741899554.70 total 264.35 last 399.12) - open/close 24024 (time 1741899564.70 total 274.35 last 402.37) - open/close 27993 (time 1741899574.70 total 284.36 last 396.85) - open/close 30000 (time 1741899579.85 total 289.51 last 389.72) - open/close 33637 (time 1741899589.85 total 299.51 last 363.62) - open/close 37854 (time 1741899599.86 total 309.51 last 421.62) - open/close 40000 (time 1741899604.82 total 314.48 last 431.99) - open/close 43997 (time 1741899614.82 total 324.48 last 399.64) - open/close 48503 (time 1741899624.83 total 334.48 last 450.52) total: 50000 open/close in 337.73 seconds: 148.05 ops/second - unlinked 0 (time 1741899628 ; total 0 ; last 0) - unlinked 10000 (time 1741899641 ; total 13 ; last 13) - unlinked 20000 (time 1741899654 ; total 26 ; last 13) - unlinked 30000 (time 1741899668 ; total 40 ; last 14) - unlinked 40000 (time 1741899681 ; total 53 ; last 13) total: 50000 unlinks in 65 seconds: 769.230774 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg428-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg428-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg428-server stop mds service on oleg428-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg428-server unloading modules via unload_modules_local on: 'oleg428-server' oleg428-server: oleg428-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg428-client: oleg428-client: ssh exited with exit code 2 pdsh@oleg428-client: oleg428-server: ssh exited with exit code 2 pdsh@oleg428-client: oleg428-client: ssh exited with exit code 2 pdsh@oleg428-client: oleg428-server: ssh exited with exit code 2