== sanityn test 15: test out-of-space with multiple writers ===================================================================== 06:11:31 (1787825491) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky Waiting for MDT destroys to complete 0 STRIPECOUNT=2 ORIGFREE=7207684 MAXFREE=2097152000 0 lustre-OST0000 avl=896 grnt=8700 diff=-7804 limit=46331 FULL lustre-OST0001 avl=336 grnt=312 diff=24 limit=46331 FULL ERROR: dd blocks 7194301 != file size 7194320 LOG LOG2 file /tmp/oos2.log:dd: error writing '/mnt/lustre/oosfile': No space left on device /tmp/oos2.log:3598254+0 records in /tmp/oos2.log:3598253+0 records out /tmp/oos2.log:3684611072 bytes (3.7 GB, 3.4 GiB) copied, 893.956 s, 4.1 MB/s /tmp/oos2.log2:dd: error writing '/mnt/lustre2/oosfile2': No space left on device /tmp/oos2.log2:3596049+0 records in /tmp/oos2.log2:3596048+0 records out /tmp/oos2.log2:3682353152 bytes (3.7 GB, 3.4 GiB) copied, 891.113 s, 4.1 MB/s oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 Waiting for MDT destroys to complete oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 Waiting for MDT destroys to complete oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 oleg321-server: ssh: connect to host oleg321-server port 22: Connection timed out pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 oleg321-server: ssh: connect to host oleg321-server port 22: No route to host pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 oleg321-server: ssh: connect to host oleg321-server port 22: No route to host pdsh@oleg321-client: oleg321-server: ssh exited with exit code 255 waiting ping -c 1 -w 3 oleg321-server, 60 secs left ... waiting ping -c 1 -w 3 oleg321-server, 55 secs left ... waiting ping -c 1 -w 3 oleg321-server, 50 secs left ... waiting ping -c 1 -w 3 oleg321-server, 45 secs left ... waiting ping -c 1 -w 3 oleg321-server, 40 secs left ... waiting ping -c 1 -w 3 oleg321-server, 35 secs left ... waiting ping -c 1 -w 3 oleg321-server, 30 secs left ... waiting ping -c 1 -w 3 oleg321-server, 25 secs left ... waiting ping -c 1 -w 3 oleg321-server, 20 secs left ... waiting ping -c 1 -w 3 oleg321-server, 15 secs left ... waiting ping -c 1 -w 3 oleg321-server, 10 secs left ... waiting ping -c 1 -w 3 oleg321-server, 5 secs left ... 06:29:49 (1787826589) waited for oleg321-server network 60s