== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:20:05 (1709785205) start mds service on oleg145-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg145-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg145-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg145-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg145-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg145-server: oleg145-server.virtnet: executing set_default_debug -1 all pdsh@oleg145-client: oleg145-server: ssh exited with exit code 1 Started lustre-OST0000 oleg145-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg145-client.virtnet: -o user_xattr,flock oleg145-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 441 (time 1709785235.47 total 10.94 last 40.31) - open/close 1242 (time 1709785246.10 total 21.58 last 75.31) - open/close 1996 (time 1709785256.77 total 32.24 last 70.70) - open/close 2658 (time 1709785267.31 total 42.78 last 62.80) - open/close 3316 (time 1709785277.94 total 53.41 last 61.91) - open/close 4000 (time 1709785290.81 total 66.28 last 53.14) - open/close 4450 (time 1709785301.09 total 76.57 last 43.75) - open/close 4977 (time 1709785311.65 total 87.13 last 49.90) - open/close 5581 (time 1709785322.28 total 97.75 last 56.83) - open/close 6179 (time 1709785333.06 total 108.53 last 55.48) - open/close 6764 (time 1709785343.90 total 119.37 last 53.96) - open/close 7257 (time 1709785354.40 total 129.87 last 46.97) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-7665) error: No space left on device total: 7665 open/close in 138.15 seconds: 55.48 ops/second /home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8267: kill: (3011) - No such process - unlinked 0 (time 1709785365 ; total 0 ; last 0) unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-7665) error: No such file or directory total: 7665 unlinks in 12 seconds: 638.750000 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg145-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg145-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg145-server stop mds service on oleg145-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg145-server stop mds service on oleg145-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg145-server unloading modules on: 'oleg145-server' oleg145-server: oleg145-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg145-client: oleg145-client: ssh exited with exit code 2 pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2 pdsh@oleg145-client: oleg145-client: ssh exited with exit code 2 pdsh@oleg145-client: oleg145-server: ssh exited with exit code 2