-----============= acceptance-small: sanityn ============----- Fri Mar 28 19:06:55 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg258-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 skipping tests SLOW=no: 33a === sanityn: start setup 19:07:00 (1743203220) === Starting client oleg258-client.virtnet: -o user_xattr,flock 192.168.202.158@tcp:/lustre /mnt/lustre2 Started clients oleg258-client.virtnet: 192.168.202.158@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg258-client.virtnet: executing check_config_client /mnt/lustre oleg258-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg258-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5e11800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b604c000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5e11800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b604c000.idle_timeout=debug disable quota as required oleg258-server: oleg258-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanityn: finish setup 19:07:09 (1743203229) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119364 s, 87.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7626] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 19:07:09 (1743203229) PASS 0 (2s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 19:07:11 (1743203231) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 19:07:13 (1743203233) -rw-r--r-- 1 root root 0 Mar 28 19:07 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (1s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 19:07:14 (1743203234) -rw-r--r-- 1 root root 0 Mar 28 19:07 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 19:07:16 (1743203236) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (1s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 19:07:17 (1743203237) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 19:07:19 (1743203239) total 0 -rwxrwxrwx 1 root root 0 Mar 28 19:07 f2a -rwxrwxrwx 1 root root 0 Mar 28 19:07 f2b total 0 -rwxrwxrwx 1 root root 0 Mar 28 19:07 f2a -rwxrwxrwx 1 root root 0 Mar 28 19:07 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00264742 s, 193 kB/s PASS 2e (1s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 19:07:20 (1743203240) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 19:07:22 (1743203242) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0454462 s, 46.1 MB/s /mnt/lustre/f2g.sanityn has 4096 blocks /mnt/lustre2/f2g.sanityn has 4096 blocks PASS 2g (1s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 19:07:23 (1743203243) PASS 3 (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 19:07:25 (1743203245) PASS 4 (2s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 19:07:27 (1743203247) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 19:07:29 (1743203249) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 19:07:30 (1743203250) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (1s) == sanityn test 8: remove of open special file on other node ==================================================================== 19:07:31 (1743203251) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 19:07:33 (1743203253) PASS 9a (1s) == sanityn test 9b: append to striped sparse file ======== 19:07:34 (1743203254) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120818 s, 86.8 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0155819 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 19:07:36 (1743203256) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00125845 s, 0.8 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00187978 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0016442 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00151991 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00156208 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00146218 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00154349 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0014549 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00156445 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00173325 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00182269 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00188328 s, 0.5 kB/s PASS 10a (1s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 19:07:37 (1743203257) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00277899 s, 1.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00760244 s, 539 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00017262 s, 17.8 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 19:07:39 (1743203259) striped dir -i1 -c2 -H all_char /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (1s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 19:07:40 (1743203260) warning: '-runtime' deprecated, use '-t runtime' instead - link 2801 (time 1743203271.41 total 10.00 last 280.10) - link 6078 (time 1743203281.41 total 20.00 last 327.68) - link 9251 (time 1743203291.41 total 30.00 last 317.22) - link 10000 (time 1743203294.09 total 32.68 last 279.45) - link 12921 (time 1743203304.09 total 42.68 last 292.10) - link 15638 (time 1743203314.09 total 52.68 last 271.68) - link 18414 (time 1743203324.09 total 62.69 last 277.55) - link 20000 (time 1743203331.04 total 69.63 last 228.27) - link 22432 (time 1743203341.05 total 79.64 last 243.06) - link 25300 (time 1743203351.05 total 89.64 last 286.79) - link 28631 (time 1743203361.05 total 99.64 last 333.06) total: 28758 link in 100.00 seconds: 287.57 ops/second using seed 81753033 running for 100 seconds - stat 10000 (time 1743203265 ; total 3 ; last 3) - stat 20000 (time 1743203268 ; total 6 ; last 3) - stat 30000 (time 1743203270 ; total 8 ; last 2) - stat 40000 (time 1743203273 ; total 11 ; last 3) - stat 50000 (time 1743203276 ; total 14 ; last 3) - stat 60000 (time 1743203278 ; total 16 ; last 2) - stat 70000 (time 1743203281 ; total 19 ; last 3) - stat 80000 (time 1743203283 ; total 21 ; last 2) - stat 90000 (time 1743203285 ; total 23 ; last 2) - stat 100000 (time 1743203288 ; total 26 ; last 3) - stat 110000 (time 1743203291 ; total 29 ; last 3) - stat 120000 (time 1743203293 ; total 31 ; last 2) - stat 130000 (time 1743203296 ; total 34 ; last 3) - stat 140000 (time 1743203298 ; total 36 ; last 2) - stat 150000 (time 1743203301 ; total 39 ; last 3) - stat 160000 (time 1743203304 ; total 42 ; last 3) - stat 170000 (time 1743203307 ; total 45 ; last 3) - stat 180000 (time 1743203310 ; total 48 ; last 3) - stat 190000 (time 1743203313 ; total 51 ; last 3) - stat 200000 (time 1743203321 ; total 59 ; last 8) - stat 210000 (time 1743203331 ; total 69 ; last 10) - stat 220000 (time 1743203340 ; total 78 ; last 9) - stat 230000 (time 1743203349 ; total 87 ; last 9) - stat 240000 (time 1743203356 ; total 94 ; last 7) total: 248136 stats in 100 seconds: 2481.360107 stats/second - unlinked 0 (time 1743203312 ; total 0 ; last 0) - unlinked 10000 (time 1743203362 ; total 50 ; last 50) - unlinked 20000 (time 1743203383 ; total 71 ; last 21) unlink(/mnt/lustre2/lockdir/lockfile28758) error: No such file or directory total: 28757 unlinks in 89 seconds: 323.112366 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (23334) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (23337) - No such process PASS 12 (142s) == sanityn test 13: test directory page revocation ======= 19:10:02 (1743203402) striped dir -i1 -c2 -H all_char /mnt/lustre/d13 f13 f13 PASS 13 (2s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 19:10:04 (1743203404) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7626 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4884: 24749 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (1s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 19:10:05 (1743203405) striped dir -i0 -c2 -H all_char /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4884: 25394 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 19:10:07 (1743203407) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 26039 Terminated $DIR1/$tdir/sleep 60 PASS 14b (1s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 19:10:08 (1743203408) striped dir -i0 -c2 -H all_char /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 26685 Terminated $DIR1/$tdir/sleep 60 PASS 14c (1s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 19:10:09 (1743203409) striped dir -i0 -c2 -H all_char /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 27331 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 19:10:11 (1743203411) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7207396 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7207396kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed Waiting for MDT destroys to complete SKIP 15 (6s) == sanityn test 16a: 2500 iterations of dual-mount fsx === 19:10:17 (1743203417) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.122134 s, 68.7 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.0947302 s, 88.6 MB/s Chance of close/open is 1 in 50 Seed set to 3418 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x947fa7 fallocating to largest ever: 0x9abed9 fallocating to largest ever: 0x9cb53e 000100[0] 1743203419.700900 read 0x35cd05 thru 0x3680d1 (0xb3cd bytes) 000200[1] 1743203420.327489 fallocate 0x17338c thru 0x17e602 (0xb277 bytes) truncating to largest ever: 0x9f17ad 000500[1] 1743203422.388719 mapwrite 0x316535 thru 0x322d47 (0xc813 bytes) 000700[0] 1743203423.775376 fallocate 0x4920c2 thru 0x498de7 (0x6d26 bytes) 000800[1] 1743203424.359801 mapread 0x6960b7 thru 0x69d311 (0x725b bytes) 001000[1] 1743203425.350620 fallocate 0x03be57 thru 0x0483a9 (0xc553 bytes) 001100[1] 1743203425.932430 write 0x0a4949 thru 0x0acebf (0x8577 bytes) 001300[0] 1743203427.075149 mapread 0x016f0e thru 0x0184e3 (0x15d6 bytes) 001400[1] 1743203427.674165 mapread 0x6b7095 thru 0x6bb56c (0x44d8 bytes) 001500[0] 1743203428.350384 read 0x549f4c thru 0x54e5fe (0x46b3 bytes) 001600[0] 1743203428.960231 punch from 0x063bd6 to 0x07162a (0xda55 bytes) 001700[0] 1743203429.588489 write 0x0c1dce thru 0x0c1ee4 (0x117 bytes) fallocating to largest ever: 0x9f5e96 001900[1] 1743203430.761576 write 0x40b8c0 thru 0x4166bf (0xae00 bytes) 002100[1] 1743203431.930699 trunc from 0x2f1f5f to 0x3b1ab5 (0xbfb57 bytes) 002200[0] 1743203432.568736 trunc from 0x6b9735 to 0x9ae2f7 (0x2f4bc3 bytes) 002300[0] 1743203433.139630 write 0x5847fe thru 0x58f3b3 (0xabb6 bytes) fallocating to largest ever: 0x9f648b 002400[0] 1743203433.668633 punch from 0x46755f to 0x4721d8 (0xac7a bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 3434 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x8e59da fallocating to largest ever: 0x9e0489 000200[1] 1743203435.486464 punch from 0x22b861 to 0x23a029 (0xe7c9 bytes) fallocating to largest ever: 0x9e2e52 000300[1] 1743203436.140253 trunc from 0x9816d2 to 0x017964 (0x969d6d bytes) fallocating to largest ever: 0x9f163e fallocating to largest ever: 0xa00000 000500[0] 1743203437.284611 mapread 0x6bc000 thru 0x6c2a14 (0x6a15 bytes) 000600[0] 1743203437.886356 fallocate 0x92954f thru 0x9316bc (0x816e bytes) 000800[1] 1743203438.923115 mapread 0x3e1000 thru 0x3e6599 (0x559a bytes) 000900[1] 1743203439.488545 read_OD 0x17f000 thru 0x17ffff (0x1000 bytes) 001000[1] 1743203440.124575 read_OD 0x171000 thru 0x172fff (0x2000 bytes) 001100[0] 1743203440.777183 fallocate 0x4c7fb4 thru 0x4d21c4 (0xa211 bytes) 001200[1] 1743203441.224958 write 0x9c0000 thru 0x9c7f91 (0x7f92 bytes) 001300[0] 1743203441.816724 read 0x474000 thru 0x477d90 (0x3d91 bytes) 001500[0] 1743203442.900994 mapwrite 0x508000 thru 0x50822f (0x230 bytes) 001600[1] 1743203443.475913 write 0x35c000 thru 0x366a13 (0xaa14 bytes) 001700[0] 1743203443.945791 mapread 0x718000 thru 0x7221d4 (0xa1d5 bytes) 001800[1] 1743203444.484195 mapwrite 0x4f0000 thru 0x4f935e (0x935f bytes) 001900[0] 1743203445.124251 fallocate 0x40b195 thru 0x416c6d (0xbad9 bytes) 002100[1] 1743203446.220719 write 0x9db000 thru 0x9de4e8 (0x34e9 bytes) 002200[0] 1743203446.852997 punch from 0x8b1849 to 0x8c1394 (0xfb4c bytes) 002300[0] 1743203447.292571 read 0x742000 thru 0x748252 (0x6253 bytes) 002500[0] 1743203448.548406 write 0x305000 thru 0x30d630 (0x8631 bytes) All operations completed A-OK! PASS 16a (32s) == sanityn test 16b: 2500 iterations of dual-mount fsx at small size ========================================================== 19:10:49 (1743203449) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.115206 s, 72.8 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.110725 s, 75.8 MB/s Chance of close/open is 1 in 50 Seed set to 3450 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero length punch hole fallocating to largest ever: 0x9bbbec skipping zero size read skipping zero size read skipping zero size read fallocating to largest ever: 0x9e2ef0 000200[1] 1743203452.086529 read 0x4b24cf thru 0x4b2637 (0x169 bytes) 000500[1] 1743203453.987334 mapread 0x7417bf thru 0x741dbe (0x600 bytes) fallocating to largest ever: 0x9ef6aa 000600[0] 1743203454.566817 mapread 0x0704b1 thru 0x070af6 (0x646 bytes) fallocating to largest ever: 0x9f0648 000900[1] 1743203456.345539 write 0x23f3e6 thru 0x23f766 (0x381 bytes) 001000[1] 1743203456.858621 mapwrite 0x04ef7c thru 0x050b2d (0x1bb2 bytes) 001100[1] 1743203457.486822 fallocate 0x98a98b thru 0x98c3f3 (0x1a69 bytes) 001400[1] 1743203459.278317 mapwrite 0x656296 thru 0x65630e (0x79 bytes) truncating to largest ever: 0x9f60c9 001600[1] 1743203460.371237 mapwrite 0x7fd456 thru 0x7fe7b7 (0x1362 bytes) fallocating to largest ever: 0x9fe6fa 001700[1] 1743203460.950949 mapwrite 0x5537e5 thru 0x555215 (0x1a31 bytes) 001800[1] 1743203461.632571 trunc from 0x47f701 to 0x787ecd (0x3087cd bytes) 001900[1] 1743203462.225293 fallocate 0x754c60 thru 0x756218 (0x15b9 bytes) 002000[1] 1743203462.817414 punch from 0x8ddf6d to 0x8df2c3 (0x1357 bytes) 002100[1] 1743203463.433556 punch from 0x3d4585 to 0x3d63b4 (0x1e30 bytes) 002200[0] 1743203464.139880 trunc from 0x738efb to 0x38c8bf (0x3ac63b bytes) 002300[0] 1743203465.016045 trunc from 0x7a864c to 0x357e89 (0x4507c2 bytes) All operations completed A-OK! PASS 16b (18s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 19:11:07 (1743203467) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.110837 s, 75.7 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.113684 s, 73.8 MB/s Waiting for MDT destroys to complete Chance of close/open is 1 in 50 Seed set to 3478 fd 0: /mnt/lustre/f16c.sanityn fd 1: /mnt/lustre2/f16c.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x1d8d0b truncating to largest ever: 0x31322c truncating to largest ever: 0x31d8fb fallocating to largest ever: 0x72544e fallocating to largest ever: 0x8cd556 truncating to largest ever: 0x9f44a3 000100[1] 1743203479.138635 mapwrite 0x0e8006 thru 0x0e9f13 (0x1f0e bytes) 000200[1] 1743203479.781554 mapread 0x7811a8 thru 0x7812e7 (0x140 bytes) 000300[0] 1743203480.683719 fallocate 0x521e4a thru 0x5304ac (0xe663 bytes) truncating to largest ever: 0x9fab4e 000500[0] 1743203482.510226 read 0x00b5fa thru 0x00ecde (0x36e5 bytes) 000700[0] 1743203484.290989 mapwrite 0x74ad2e thru 0x750344 (0x5617 bytes) fallocating to largest ever: 0x9ff93d 000800[0] 1743203485.442287 trunc from 0x937d4e to 0x841377 (0xf69d6 bytes) 001000[0] 1743203487.464610 fallocate 0x574229 thru 0x57df0e (0x9ce6 bytes) 001200[0] 1743203489.216174 trunc from 0x70a118 to 0x060d13 (0x6a9404 bytes) fallocating to largest ever: 0xa00000 001500[1] 1743203491.779358 mapwrite 0x2339be thru 0x23b92e (0x7f71 bytes) 001600[0] 1743203492.666709 mapread 0x62a4a2 thru 0x6343e5 (0x9f44 bytes) 001800[1] 1743203494.384275 read 0x2f4fb1 thru 0x2f5d84 (0xdd4 bytes) 001900[0] 1743203495.165882 punch from 0x49b436 to 0x4a9424 (0xdfef bytes) 002000[1] 1743203495.919625 write 0x8e2ba1 thru 0x8ecf3f (0xa39f bytes) 002200[0] 1743203497.524656 write 0x11e594 thru 0x1225ff (0x406c bytes) 002300[0] 1743203498.308787 mapread 0x442a8c thru 0x44ae4b (0x83c0 bytes) 002400[0] 1743203499.244490 mapread 0x2642f4 thru 0x26ee59 (0xab66 bytes) 002500[0] 1743203500.226029 trunc from 0x71290f to 0x0fc4ea (0x616424 bytes) All operations completed A-OK! PASS 16c (34s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 19:11:41 (1743203501) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.108497 s, 77.3 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.101952 s, 82.3 MB/s ldlm.namespaces.MGC192.168.202.158@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b5e11800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b604c000.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff8800b5e11800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff8800b604c000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b5e11800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b604c000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b5e11800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b604c000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.88533 s, 55.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.770513 s, 136 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.735099 s, 143 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.55793 s, 67.3 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.986429 s, 106 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.903564 s, 116 MB/s PASS 16d (10s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 19:11:51 (1743203511) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0817648 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116751 s, 89.8 MB/s PASS 16e (2s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 19:11:53 (1743203513) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 19:12:15 (1743203535) TIMEOUT PASS 16g (21s) == sanityn test 16h: mmap read after truncate file ======= 19:12:36 (1743203556) striped dir -i0 -c2 -H crush2 /mnt/lustre/d16h.sanityn ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (2s) == sanityn test 16i: read after truncate file ============ 19:12:38 (1743203558) striped dir -i0 -c2 -H all_char /mnt/lustre/d16i.sanityn ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (1s) == sanityn test 16j: race dio with buffered i/o ========== 19:12:39 (1743203559) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.355199 s, 73.8 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.261409 s, 100 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.337213 s, 77.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.178198 s, 147 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.249569 s, 105 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.18372 s, 143 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.328996 s, 79.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.31584 s, 83.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.328703 s, 79.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.331421 s, 79.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.403255 s, 65.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.250382 s, 105 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.344812 s, 76.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.372391 s, 70.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.413245 s, 63.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.26718 s, 98.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.332496 s, 78.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.347348 s, 75.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.410722 s, 63.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (7s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 19:12:46 (1743203566) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3428364 skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3428364 skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3428364 skipping zero size read truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3428364 skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fallocating to largest ever: 0x3428364 skipping zero size read truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db fallocating to largest ever: 0x3f1a2be fallocating to largest ever: 0x3f1a2be fallocating to largest ever: 0x3f1a2be truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db fallocating to largest ever: 0x3f1a2be fallocating to largest ever: 0x3f1a2be fallocating to largest ever: 0x3f8dc08 fallocating to largest ever: 0x3f8dc08 fallocating to largest ever: 0x3f8dc08 fallocating to largest ever: 0x3f8dc08 fallocating to largest ever: 0x3f8dc08 All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Fri Mar 28 19:12:51 EDT 2025 All operations completed A-OK! All operations completed A-OK! + fsx 2 done: rc=0 Fri Mar 28 19:12:51 EDT 2025 + fsx 3 done: rc=0 Fri Mar 28 19:12:51 EDT 2025 + fsx 4 done: rc=0 Fri Mar 28 19:12:51 EDT 2025 + fsx 5 done: rc=0 Fri Mar 28 19:12:51 EDT 2025 PASS 16k (9s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 19:12:55 (1743203575) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 19:12:59 (1743203579) mmap test1: basic mmap operation (PASS, 0.020357s) mmap test2: MAP_PRIVATE not write back (PASS, 0.014313s) mmap test3: concurrent mmap ops on two nodes (PASS, 20.688s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.0717s)