== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:44:16 (1709786656) start mds service on oleg238-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg238-server: oleg238-server.virtnet: executing set_default_debug -1 all pdsh@oleg238-client: oleg238-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg238-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg238-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg238-server: oleg238-server.virtnet: executing set_default_debug -1 all pdsh@oleg238-client: oleg238-server: ssh exited with exit code 1 Started lustre-OST0000 oleg238-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg238-client.virtnet: -o user_xattr,flock oleg238-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 110 (time 1709786686.65 total 10.65 last 10.32) - open/close 385 (time 1709786696.66 total 20.66 last 27.50) - open/close 612 (time 1709786706.80 total 30.80 last 22.38) - open/close 941 (time 1709786717.46 total 41.46 last 30.86) - open/close 1085 (time 1709786729.94 total 53.94 last 11.54) - open/close 1365 (time 1709786740.32 total 64.32 last 26.97) - open/close 1580 (time 1709786750.81 total 74.81 last 20.49) - open/close 1714 (time 1709786760.89 total 84.89 last 13.29) - open/close 1910 (time 1709786771.78 total 95.78 last 18.01) - open/close 2164 (time 1709786782.25 total 106.25 last 24.25) - open/close 2501 (time 1709786792.46 total 116.46 last 33.00) - open/close 2710 (time 1709786802.88 total 126.89 last 20.06) - open/close 2891 (time 1709786813.18 total 137.18 last 17.58) - open/close 3022 (time 1709786823.23 total 147.23 last 13.03) - open/close 3126 (time 1709786834.10 total 158.10 last 9.57) - open/close 3249 (time 1709786844.15 total 168.15 last 12.24) - open/close 3512 (time 1709786854.82 total 178.83 last 24.63) - open/close 3688 (time 1709786865.57 total 189.57 last 16.39) - open/close 3897 (time 1709786875.57 total 199.57 last 20.89) - open/close 4141 (time 1709786885.69 total 209.69 last 24.11) - open/close 4282 (time 1709786896.46 total 220.46 last 13.10) - open/close 4550 (time 1709786906.60 total 230.60 last 26.43) - open/close 4778 (time 1709786916.60 total 240.60 last 22.79) - open/close 4989 (time 1709786927.07 total 251.07 last 20.16) - open/close 5180 (time 1709786937.40 total 261.41 last 18.47) - open/close 5285 (time 1709786948.26 total 272.26 last 9.67) - open/close 5344 (time 1709786962.36 total 286.36 last 4.19) - open/close 5571 (time 1709786973.16 total 297.16 last 21.00) - open/close 5805 (time 1709786984.80 total 308.80 last 20.11) - open/close 5978 (time 1709786995.15 total 319.15 last 16.71) - open/close 6134 (time 1709787005.16 total 329.16 last 15.59) - open/close 6236 (time 1709787015.17 total 339.17 last 10.18) - open/close 6466 (time 1709787027.27 total 351.27 last 19.01) - open/close 6626 (time 1709787037.45 total 361.45 last 15.72) - open/close 6780 (time 1709787048.20 total 372.20 last 14.32) - open/close 6976 (time 1709787058.46 total 382.47 last 19.10) - open/close 7135 (time 1709787068.91 total 392.91 last 15.22) - open/close 7235 (time 1709787079.34 total 403.34 last 9.59) - open/close 7312 (time 1709787095.08 total 419.08 last 4.89) - open/close 7478 (time 1709787105.61 total 429.61 last 15.76) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-7601) error: No space left on device total: 7601 open/close in 432.95 seconds: 17.56 ops/second /home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8267: kill: (29796) - No such process - unlinked 0 (time 1709787115 ; total 0 ; last 0) unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-7601) error: No such file or directory total: 7601 unlinks in 75 seconds: 101.346664 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg238-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg238-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg238-server stop mds service on oleg238-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg238-server unloading modules on: 'oleg238-server' oleg238-server: oleg238-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg238-client: oleg238-client: ssh exited with exit code 2 pdsh@oleg238-client: oleg238-server: ssh exited with exit code 2 pdsh@oleg238-client: oleg238-client: ssh exited with exit code 2 pdsh@oleg238-client: oleg238-server: ssh exited with exit code 2