== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 13:55:25 (1771440925) start mds service on oleg128-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg128-server' oleg128-server: oleg128-server.virtnet: executing load_modules_local oleg128-server: Loading modules from /home/green/git/lustre-release/lustre oleg128-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg128-server: detected 4 online CPUs by sysfs oleg128-server: MODOPTS_LIBCFS= oleg128-server: Force libcfs to create 2 CPU partitions oleg128-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg128-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg128-server: oleg128-server.virtnet: executing set_default_debug -1 all pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg128-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg128-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg128-server: oleg128-server.virtnet: executing set_default_debug -1 all pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Started lustre-OST0000 oleg128-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg128-client.virtnet: -o user_xattr,flock 192.168.201.128@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 217 (time 1771440966.37 total 10.58 last 20.52) - open/close 397 (time 1771440976.60 total 20.81 last 17.58) - open/close 1040 (time 1771440987.55 total 31.76 last 58.74) - open/close 1663 (time 1771440998.04 total 42.26 last 59.37) - open/close 2210 (time 1771441008.22 total 52.43 last 53.75) - open/close 2749 (time 1771441018.23 total 62.44 last 53.88) - open/close 3115 (time 1771441029.15 total 73.36 last 33.51) - open/close 3712 (time 1771441039.15 total 83.36 last 59.68) - open/close 4414 (time 1771441049.31 total 93.52 last 69.12) - open/close 5011 (time 1771441060.06 total 104.27 last 55.53) - open/close 5487 (time 1771441070.56 total 114.77 last 45.34) - open/close 6044 (time 1771441081.37 total 125.58 last 51.51) - open/close 6597 (time 1771441092.12 total 136.33 last 51.44) - open/close 7315 (time 1771441102.12 total 146.33 last 71.80) - open/close 8030 (time 1771441112.35 total 156.56 last 69.92) - open/close 8631 (time 1771441122.35 total 166.56 last 60.10) - open/close 9230 (time 1771441132.35 total 176.56 last 59.88) - open/close 9744 (time 1771441143.19 total 187.41 last 47.41) - open/close 10000 (time 1771441146.95 total 191.16 last 68.21) - open/close 10583 (time 1771441157.53 total 201.74 last 55.08) - open/close 11095 (time 1771441168.10 total 212.31 last 48.46) - open/close 11630 (time 1771441178.72 total 222.93 last 50.39) - open/close 12204 (time 1771441189.54 total 233.75 last 53.05) - open/close 12863 (time 1771441199.77 total 243.98 last 64.38) - open/close 13370 (time 1771441210.40 total 254.61 last 47.72) - open/close 13768 (time 1771441220.64 total 264.85 last 38.87) - open/close 14487 (time 1771441230.81 total 275.03 last 70.63) - open/close 15134 (time 1771441240.82 total 285.03 last 64.70) - open/close 15763 (time 1771441251.16 total 295.38 last 60.78) - open/close 16420 (time 1771441261.34 total 305.55 last 64.57) - open/close 17594 (time 1771441271.34 total 315.55 last 117.37) - open/close 20000 (time 1771441278.49 total 322.70 last 336.64) - open/close 24632 (time 1771441288.49 total 332.70 last 463.16) - open/close 28760 (time 1771441298.49 total 342.70 last 412.75) - open/close 30000 (time 1771441301.57 total 345.78 last 402.91) - open/close 33661 (time 1771441311.57 total 355.78 last 366.08) - open/close 37400 (time 1771441321.57 total 365.78 last 373.84) - open/close 40000 (time 1771441328.06 total 372.27 last 400.93) - open/close 43831 (time 1771441338.06 total 382.27 last 382.98) - open/close 47064 (time 1771441348.06 total 392.27 last 323.30) total: 50000 open/close in 400.19 seconds: 124.94 ops/second - unlinked 0 (time 1771441357 ; total 0 ; last 0) - unlinked 10000 (time 1771441372 ; total 15 ; last 15) - unlinked 20000 (time 1771441390 ; total 33 ; last 18) - unlinked 30000 (time 1771441405 ; total 48 ; last 15) - unlinked 40000 (time 1771441418 ; total 61 ; last 13) total: 50000 unlinks in 75 seconds: 666.666687 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg128-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg128-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg128-server stop mds service on oleg128-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg128-server unloading modules via unload_modules_local on: 'oleg128-server' oleg128-server: oleg128-server.virtnet: executing unload_modules_local oleg128-server: modules unloaded. pdsh@oleg128-client: oleg128-client: ssh exited with exit code 2 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 2 pdsh@oleg128-client: oleg128-client: ssh exited with exit code 2 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 2