-----============= acceptance-small: sanity ============----- Sat Nov 2 14:46:57 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 42a 42c 42b 118c 118d 407 119i 411b skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 === sanity: start setup 14:47:02 (1730573222) === oleg242-client.virtnet: executing check_config_client /mnt/lustre oleg242-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg242-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5998000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5998000.idle_timeout=debug disable quota as required oleg242-server: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity: finish setup 14:47:12 (1730573232) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6862] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119r: dio fallback with AIO across stripe boundary ========================================================== 14:47:15 (1730573235) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.10861 s, 19.3 MB/s fail_loc=0x1429 fail_val=1048576 PASS 119r (69s) == sanity test 119s: race aio vs aio ===================== 14:48:24 (1730573304) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.32729 s, 19.8 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 2088960 got -22 read missed bytes at 0 expected 1044480 got -22 sanity test_119s: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15098:test_119s() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15112:main() Dumping lctl log to /tmp/testlogs//sanity.test_119s.*.1730573307.log rsync: chown "/tmp/testlogs/.sanity.test_119s.debug_log.oleg242-server.1730573307.log.yzQ8Fi" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119s.dmesg.oleg242-server.1730573307.log.bA4Ezl" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119s (6s) == sanity test 119t: race aio vs bio ===================== 14:48:30 (1730573310) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.36366 s, 19.2 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.735061 s, 35.7 MB/s sanity test_119t: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15165:test_119t() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15179:main() Dumping lctl log to /tmp/testlogs//sanity.test_119t.*.1730573315.log rsync: chown "/tmp/testlogs/.sanity.test_119t.debug_log.oleg242-server.1730573315.log.fXNRdP" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119t.dmesg.oleg242-server.1730573315.log.sfuHp9" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119t (7s) == sanity test 119u: race aio vs buffered i/o ============ 14:48:37 (1730573317) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.39325 s, 18.8 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.09695 s, 23.9 MB/s sanity test_119u: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15231:test_119u() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15245:main() Dumping lctl log to /tmp/testlogs//sanity.test_119u.*.1730573322.log rsync: chown "/tmp/testlogs/.sanity.test_119u.debug_log.oleg242-server.1730573322.log.MO2y7s" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119u.dmesg.oleg242-server.1730573322.log.CRLJi6" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119u (8s) == sanity test complete, duration 112 sec ================ 14:48:49 (1730573329) sanity: FAIL: test_119s aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119t aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119u aio copy 1 w/bsize 1044480 failed: 1 === sanity: start cleanup 14:48:50 (1730573330) === === sanity: finish cleanup 14:48:51 (1730573331) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck