-----============= acceptance-small: sanity ============----- Sat Nov 2 14:47:03 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 42a 42c 42b 118c 118d 407 119i 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 14:47:08 (1730573228) === oleg239-client.virtnet: executing check_config_client /mnt/lustre oleg239-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg239-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6e13800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6e13800.idle_timeout=debug disable quota as required oleg239-server: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 14:47:20 (1730573240) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7727] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119r: dio fallback with AIO across stripe boundary ========================================================== 14:47:24 (1730573244) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.12308 s, 17.0 MB/s fail_loc=0x1429 fail_val=1048576 PASS 119r (102s) == sanity test 119s: race aio vs aio ===================== 14:49:06 (1730573346) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.911086 s, 28.8 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 2088960 got -22 read missed bytes at 0 expected 1044480 got -22 sanity test_119s: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15098:test_119s() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15112:main() Dumping lctl log to /tmp/testlogs//sanity.test_119s.*.1730573348.log rsync: chown "/tmp/testlogs/.sanity.test_119s.debug_log.oleg239-server.1730573348.log.fzQfG1" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119s.dmesg.oleg239-server.1730573348.log.xKCjYQ" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119s (4s) == sanity test 119t: race aio vs bio ===================== 14:49:11 (1730573351) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.01965 s, 25.7 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.735348 s, 35.6 MB/s sanity test_119t: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15165:test_119t() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15179:main() Dumping lctl log to /tmp/testlogs//sanity.test_119t.*.1730573354.log rsync: chown "/tmp/testlogs/.sanity.test_119t.debug_log.oleg239-server.1730573354.log.tkYGHL" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119t.dmesg.oleg239-server.1730573354.log.KDzugR" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119t (5s) == sanity test 119u: race aio vs buffered i/o ============ 14:49:18 (1730573358) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.890717 s, 29.4 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.648858 s, 40.4 MB/s sanity test_119u: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15231:test_119u() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15245:main() Dumping lctl log to /tmp/testlogs//sanity.test_119u.*.1730573360.log rsync: chown "/tmp/testlogs/.sanity.test_119u.debug_log.oleg239-server.1730573360.log.GJGzAN" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119u.dmesg.oleg239-server.1730573360.log.Zp4gj8" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119u (4s) == sanity test complete, duration 143 sec ================ 14:49:26 (1730573366) sanity: FAIL: test_119s aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119t aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119u aio copy 1 w/bsize 1044480 failed: 1 === sanity: start cleanup 14:49:26 (1730573366) === === sanity: finish cleanup 14:49:27 (1730573367) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck