-----============= acceptance-small: sanity ============----- Sat Nov 2 14:46:57 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 42a 42c 42b 118c 118d 407 119i 411b skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 === sanity: start setup 14:47:01 (1730573221) === oleg124-client.virtnet: executing check_config_client /mnt/lustre oleg124-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg124-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ad8a0800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ad8a0800.idle_timeout=debug disable quota as required oleg124-server: oleg124-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity: finish setup 14:47:10 (1730573230) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6881] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119r: dio fallback with AIO across stripe boundary ========================================================== 14:47:13 (1730573233) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0994965 s, 21.1 MB/s fail_loc=0x1429 fail_val=1048576 PASS 119r (67s) == sanity test 119s: race aio vs aio ===================== 14:48:20 (1730573300) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.34169 s, 19.5 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 2088960 got -22 read missed bytes at 0 expected 1044480 got -22 sanity test_119s: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15098:test_119s() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15112:main() Dumping lctl log to /tmp/testlogs//sanity.test_119s.*.1730573304.log rsync: chown "/tmp/testlogs/.sanity.test_119s.debug_log.oleg124-server.1730573304.log.etrtPk" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119s.dmesg.oleg124-server.1730573304.log.Re2Utb" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119s (6s) == sanity test 119t: race aio vs bio ===================== 14:48:27 (1730573307) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.37575 s, 19.1 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.782429 s, 33.5 MB/s sanity test_119t: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15165:test_119t() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15179:main() Dumping lctl log to /tmp/testlogs//sanity.test_119t.*.1730573311.log rsync: chown "/tmp/testlogs/.sanity.test_119t.debug_log.oleg124-server.1730573311.log.6MTrmI" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119t.dmesg.oleg124-server.1730573311.log.QX7Y7P" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119t (6s) == sanity test 119u: race aio vs buffered i/o ============ 14:48:34 (1730573314) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.41519 s, 18.5 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.08305 s, 24.2 MB/s sanity test_119u: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15231:test_119u() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15245:main() Dumping lctl log to /tmp/testlogs//sanity.test_119u.*.1730573318.log rsync: chown "/tmp/testlogs/.sanity.test_119u.debug_log.oleg124-server.1730573318.log.O8Frj9" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119u.dmesg.oleg124-server.1730573318.log.Pu9LAz" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119u (8s) == sanity test complete, duration 107 sec ================ 14:48:44 (1730573324) sanity: FAIL: test_119s aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119t aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119u aio copy 1 w/bsize 1044480 failed: 1 === sanity: start cleanup 14:48:45 (1730573325) === === sanity: finish cleanup 14:48:46 (1730573326) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck