-----============= acceptance-small: sanity ============----- Sat Nov 2 14:47:07 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 42a 42c 42b 118c 118d 407 119i 411b skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 === sanity: start setup 14:47:14 (1730573234) === oleg102-client.virtnet: executing check_config_client /mnt/lustre oleg102-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg102-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a5b7800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a5b7800.idle_timeout=debug disable quota as required oleg102-server: oleg102-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity: finish setup 14:47:28 (1730573248) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7571] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119r: dio fallback with AIO across stripe boundary ========================================================== 14:47:32 (1730573252) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.112196 s, 18.7 MB/s fail_loc=0x1429 fail_val=1048576 PASS 119r (68s) == sanity test 119s: race aio vs aio ===================== 14:48:40 (1730573320) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.26438 s, 20.7 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 2088960 got -22 read missed bytes at 0 expected 1044480 got -22 sanity test_119s: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15098:test_119s() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15112:main() Dumping lctl log to /tmp/testlogs//sanity.test_119s.*.1730573323.log rsync: chown "/tmp/testlogs/.sanity.test_119s.debug_log.oleg102-server.1730573323.log.q0C4UL" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119s.dmesg.oleg102-server.1730573323.log.H8zAeA" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119s (6s) == sanity test 119t: race aio vs bio ===================== 14:48:46 (1730573326) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.24581 s, 21.0 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.599679 s, 43.7 MB/s sanity test_119t: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15165:test_119t() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15179:main() Dumping lctl log to /tmp/testlogs//sanity.test_119t.*.1730573329.log rsync: chown "/tmp/testlogs/.sanity.test_119t.debug_log.oleg102-server.1730573329.log.NUJN9Z" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119t.dmesg.oleg102-server.1730573329.log.KD2tV2" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119t (6s) == sanity test 119u: race aio vs buffered i/o ============ 14:48:52 (1730573332) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.20143 s, 21.8 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.03908 s, 25.2 MB/s sanity test_119u: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15231:test_119u() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15245:main() Dumping lctl log to /tmp/testlogs//sanity.test_119u.*.1730573336.log rsync: chown "/tmp/testlogs/.sanity.test_119u.debug_log.oleg102-server.1730573336.log.JW0rcr" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119u.dmesg.oleg102-server.1730573336.log.muITYJ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119u (6s) == sanity test complete, duration 113 sec ================ 14:49:01 (1730573341) sanity: FAIL: test_119s aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119t aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119u aio copy 1 w/bsize 1044480 failed: 1 === sanity: start cleanup 14:49:02 (1730573342) === === sanity: finish cleanup 14:49:02 (1730573342) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck