-----============= acceptance-small: sanity ============----- Sat Nov 2 14:47:02 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 42a 42c 42b 118c 118d 407 119i 411b skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 === sanity: start setup 14:47:07 (1730573227) === oleg237-client.virtnet: executing check_config_client /mnt/lustre oleg237-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg237-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3208800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3208800.idle_timeout=debug disable quota as required oleg237-server: oleg237-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity: finish setup 14:47:18 (1730573238) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6882] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119r: dio fallback with AIO across stripe boundary ========================================================== 14:47:22 (1730573242) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.105368 s, 19.9 MB/s fail_loc=0x1429 fail_val=1048576 PASS 119r (67s) == sanity test 119s: race aio vs aio ===================== 14:48:29 (1730573309) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.42853 s, 18.4 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 2088960 got -22 read missed bytes at 0 expected 1044480 got -22 sanity test_119s: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15098:test_119s() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15112:main() Dumping lctl log to /tmp/testlogs//sanity.test_119s.*.1730573313.log rsync: chown "/tmp/testlogs/.sanity.test_119s.debug_log.oleg237-server.1730573313.log.mLXHsY" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119s.dmesg.oleg237-server.1730573313.log.PwhSwi" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119s (7s) == sanity test 119t: race aio vs bio ===================== 14:48:36 (1730573316) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.47751 s, 17.7 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.699515 s, 37.5 MB/s sanity test_119t: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15165:test_119t() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15179:main() Dumping lctl log to /tmp/testlogs//sanity.test_119t.*.1730573320.log rsync: chown "/tmp/testlogs/.sanity.test_119t.debug_log.oleg237-server.1730573320.log.2ZnKgg" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119t.dmesg.oleg237-server.1730573320.log.aLdbpR" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119t (6s) == sanity test 119u: race aio vs buffered i/o ============ 14:48:43 (1730573323) /home/green/git/lustre-release/lustre/tests/aiocp 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 1.28524 s, 20.4 MB/s bs: 1044480, align: 8, file_size 26214400 read missed bytes at 0 expected 1044480 got -22 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.03365 s, 25.4 MB/s sanity test_119u: @@@@@@ FAIL: aio copy 1 w/bsize 1044480 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15231:test_119u() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7424:run_test() = /home/green/git/lustre-release/lustre/tests/sanity.sh:15245:main() Dumping lctl log to /tmp/testlogs//sanity.test_119u.*.1730573327.log rsync: chown "/tmp/testlogs/.sanity.test_119u.debug_log.oleg237-server.1730573327.log.EpYoGx" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity.test_119u.dmesg.oleg237-server.1730573327.log.hlOJZq" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 119u (8s) == sanity test complete, duration 110 sec ================ 14:48:53 (1730573333) sanity: FAIL: test_119s aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119t aio copy 1 w/bsize 1044480 failed: 1 sanity: FAIL: test_119u aio copy 1 w/bsize 1044480 failed: 1 === sanity: start cleanup 14:48:54 (1730573334) === === sanity: finish cleanup 14:48:55 (1730573335) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck