-----============= acceptance-small: sanityn ============----- Tue Sep 8 07:13:39 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg457-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 40a skipping tests SLOW=no: 33a === sanityn: start setup 07:14:01 (1788866041) === Starting client oleg457-client.virtnet: -o user_xattr,flock 192.168.204.157@tcp:/lustre /mnt/lustre2 Mount client oleg457-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.157@tcp:/lustre /mnt/lustre2 Started clients oleg457-client.virtnet: 192.168.204.157@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg457-client.virtnet: executing check_config_client /mnt/lustre oleg457-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg457-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9019c802c800.idle_timeout=debug osc.lustre-OST0000-osc-ffff9019d202e800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9019c802c800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9019d202e800.idle_timeout=debug disable quota as required oleg457-server: oleg457-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanityn: finish setup 07:14:46 (1788866086) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0609666 s, 17.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8234] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 07:14:49 (1788866089) PASS 0 (9s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 07:14:59 (1788866099) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (7s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 07:15:06 (1788866106) -rw-r--r-- 1 root root 0 Sep 8 07:15 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (8s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 07:15:14 (1788866114) -rw-r--r-- 1 root root 0 Sep 8 07:15 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (8s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 07:15:22 (1788866122) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (8s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 07:15:30 (1788866130) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (8s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 07:15:38 (1788866138) total 0 -rwxrwxrwx 1 root root 0 Sep 8 07:15 f2a -rwxrwxrwx 1 root root 0 Sep 8 07:15 f2b total 0 -rwxrwxrwx 1 root root 0 Sep 8 07:15 f2a -rwxrwxrwx 1 root root 0 Sep 8 07:15 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.0137105 s, 37.3 kB/s PASS 2e (8s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 07:15:46 (1788866146) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (9s) == sanityn test 2g: check blocks update on sync write ==== 07:15:55 (1788866155) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.265172 s, 7.9 MB/s /mnt/lustre/f2g.sanityn has 4096 blocks /mnt/lustre2/f2g.sanityn has 4096 blocks PASS 2g (8s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 07:16:03 (1788866163) PASS 3 (7s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 07:16:10 (1788866170) PASS 4 (8s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 07:16:18 (1788866178) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (8s) == sanityn test 6: remove of open file on other node ============================================================================ 07:16:26 (1788866186) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (7s) == sanityn test 7: remove of open directory on other node ======================================================================= 07:16:33 (1788866193) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (8s) == sanityn test 8: remove of open special file on other node ==================================================================== 07:16:41 (1788866201) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (8s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 07:16:49 (1788866209) PASS 9a (10s) == sanityn test 9b: append to striped sparse file ======== 07:16:59 (1788866219) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0460834 s, 22.8 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0783218 s, 0.0 kB/s Data read (expecting 'foo'): foo PASS 9b (9s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 07:17:08 (1788866228) 1+0 records in 1+0 records out 1 byte copied, 0.0190611 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.019643 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0149386 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0186713 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0184927 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0275038 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0197004 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0274163 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0313771 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0354536 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00830086 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0251533 s, 0.0 kB/s PASS 10a (11s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 07:17:19 (1788866239) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0153411 s, 200 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0294565 s, 139 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000230563 s, 13.3 MB/s PASS 10b (10s) == sanityn test 11: execution of file opened for write should return error ============================================================== 07:17:29 (1788866249) striped dir -i1 -c2 -H all_char /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8234 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 298: /mnt/lustre2/d11/f: Text file busy PASS 11 (10s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 07:17:40 (1788866260) warning: '-runtime' deprecated, use '-t runtime' instead - link 270 (time 1788866274.30 total 10.05 last 26.87) - link 527 (time 1788866284.33 total 20.07 last 25.64) - link 800 (time 1788866294.34 total 30.08 last 27.27) - link 1083 (time 1788866304.34 total 40.08 last 28.29) - link 1382 (time 1788866314.36 total 50.11 last 29.83) - link 1674 (time 1788866324.38 total 60.12 last 29.17) - link 1997 (time 1788866334.38 total 70.13 last 32.28) - link 2332 (time 1788866344.39 total 80.13 last 33.48) - link 2675 (time 1788866354.40 total 90.15 last 34.25) total: 2989 link in 100.07 seconds: 29.87 ops/second using seed 1283679831 running for 100 seconds - stat 5165 (time 1788866276 ; total 11 ; last 11) - stat 10000 (time 1788866285 ; total 20 ; last 9) - stat 15534 (time 1788866296 ; total 31 ; last 11) - stat 20000 (time 1788866305 ; total 40 ; last 9) - stat 26149 (time 1788866316 ; total 51 ; last 11) - stat 29254 (time 1788866327 ; total 62 ; last 11) - stat 30000 (time 1788866329 ; total 64 ; last 2) - stat 32926 (time 1788866340 ; total 75 ; last 11) - stat 36551 (time 1788866351 ; total 86 ; last 11) - stat 39826 (time 1788866362 ; total 97 ; last 11) - stat 40000 (time 1788866362 ; total 97 ; last 0) total: 40741 stats in 100 seconds: 407.410004 stats/second - unlinked 0 (time 1788866315 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile2989) error: No such file or directory total: 2988 unlinks in 78 seconds: 38.307693 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22721) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22723) - No such process PASS 12 (139s) == sanityn test 13: test directory page revocation ======= 07:19:58 (1788866398) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d13 f13 f13 PASS 13 (8s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 07:20:06 (1788866406) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.8234 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 333: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5114: 23930 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (8s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 07:20:15 (1788866415) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5114: 24521 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (8s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 07:20:23 (1788866423) striped dir -i0 -c2 -H crush /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 348: 25113 Terminated $DIR1/$tdir/sleep 60 PASS 14b (7s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 07:20:30 (1788866430) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 360: 25707 Terminated $DIR1/$tdir/sleep 60 PASS 14c (7s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 07:20:37 (1788866437) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 371: 26302 Terminated $DIR1/$tdir/sleep 60 PASS 14d (10s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 07:20:47 (1788866447) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky Waiting for MDT destroys to complete 0 STRIPECOUNT=2 ORIGFREE=7207412 MAXFREE=2097152000 0 lustre-OST0000 avl=336 grnt=311 diff=25 limit=46331 FULL lustre-OST0001 avl=4980 grnt=4083 diff=897 limit=46331 FULL ERROR: dd blocks 7195043 != file size 7195060 LOG LOG2 file /tmp/oos2.log:dd: error writing '/mnt/lustre/oosfile': No space left on device /tmp/oos2.log:3600069+0 records in /tmp/oos2.log:3600068+0 records out /tmp/oos2.log:3686469632 bytes (3.7 GB, 3.4 GiB) copied, 997.752 s, 3.7 MB/s /tmp/oos2.log2:dd: error writing '/mnt/lustre2/oosfile2': No space left on device /tmp/oos2.log2:3594976+0 records in /tmp/oos2.log2:3594975+0 records out /tmp/oos2.log2:3681254400 bytes (3.7 GB, 3.4 GiB) copied, 997.744 s, 3.7 MB/s Waiting for MDT destroys to complete Waiting for MDT destroys to complete PASS 15 (1064s) == sanityn test 16a: 2500 iterations of dual-mount fsx === 07:38:31 (1788867511) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.166799 s, 50.3 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.217054 s, 38.6 MB/s Chance of close/open is 1 in 50 Seed set to 7515 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fallocating to largest ever: 0x143b1c fallocating to largest ever: 0x35077e fallocating to largest ever: 0x5384b1 fallocating to largest ever: 0x71447d truncating to largest ever: 0x824ab9 truncating to largest ever: 0x8dbb8a 000100[0] 1788867521.086777 mapwrite 0x65c3b8 thru 0x66431d (0x7f66 bytes) fallocating to largest ever: 0xa00000 000200[1] 1788867525.449560 trunc from 0x5a3120 to 0x9b1c37 (0x40eb18 bytes) 000300[1] 1788867530.147876 trunc from 0x2dff29 to 0x5ea3ab (0x30a483 bytes) 000500[0] 1788867539.184617 trunc from 0x78a105 to 0x78d668 (0x3564 bytes) 000800[0] 1788867553.310562 mapread 0x09920d thru 0x09bb53 (0x2947 bytes) 000900[0] 1788867558.572098 fallocate 0x610e87 thru 0x613c22 (0x2d9c bytes) 001000[1] 1788867564.506958 write 0x37e548 thru 0x386948 (0x8401 bytes) 001200[1] 1788867577.692065 fallocate 0x9116d4 thru 0x91477f (0x30ac bytes) 001400[0] 1788867588.792798 fallocate 0x788eb3 thru 0x795c56 (0xcda4 bytes) 001500[1] 1788867594.156175 fallocate 0x47ecf8 thru 0x4822e3 (0x35ec bytes) 001600[1] 1788867598.588006 write 0x5b78c9 thru 0x5c4d90 (0xd4c8 bytes) 001700[0] 1788867603.498044 punch from 0x0fde88 to 0x0fea3e (0xbb7 bytes) 001800[1] 1788867609.155923 mapread 0x25c9b8 thru 0x269723 (0xcd6c bytes) 001900[1] 1788867613.844090 mapread 0x1c0bae thru 0x1d004d (0xf4a0 bytes) 002000[1] 1788867618.614813 fallocate 0x28663c thru 0x28a64b (0x4010 bytes) 002100[0] 1788867623.191424 write 0x81cdce thru 0x827f8b (0xb1be bytes) 002200[1] 1788867627.633042 mapread 0x2d49e4 thru 0x2dbad7 (0x70f4 bytes) 002400[1] 1788867636.246009 write 0x1cb902 thru 0x1da706 (0xee05 bytes) 002500[0] 1788867640.485993 trunc from 0x4c7ff2 to 0x4d3576 (0xb585 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 7640 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn truncating to largest ever: 0x720dbc fallocating to largest ever: 0x8adbbc fallocating to largest ever: 0x9e2d5a 000200[1] 1788867650.140283 punch from 0x6709b2 to 0x673db9 (0x3408 bytes) truncating to largest ever: 0x9e3fe4 000500[0] 1788867662.989580 trunc from 0x4067ae to 0x3d96f3 (0x2d0ba bytes) truncating to largest ever: 0x9ee478 000600[1] 1788867668.335403 mapwrite 0x2e1000 thru 0x2ef8fe (0xe8ff bytes) 000700[0] 1788867673.092685 trunc from 0x05acc0 to 0x0624f4 (0x7835 bytes) 000900[1] 1788867680.983426 punch from 0x1f3f2a to 0x1f99a7 (0x5a7e bytes) 001000[1] 1788867684.978718 fallocate 0x63cf17 thru 0x6458df (0x89c9 bytes) 001100[0] 1788867689.136066 mapwrite 0x42d000 thru 0x43c7cd (0xf7ce bytes) 001300[1] 1788867697.987099 read 0x3f0000 thru 0x3f39c2 (0x39c3 bytes) fallocating to largest ever: 0xa00000 001400[1] 1788867703.074704 mapwrite 0x644000 thru 0x646a11 (0x2a12 bytes) 001500[0] 1788867706.857144 read 0x096000 thru 0x0977e3 (0x17e4 bytes) 001600[1] 1788867710.906492 trunc from 0x659fe7 to 0x65fc2e (0x5c48 bytes) 001700[0] 1788867716.258377 mapwrite 0x521000 thru 0x529470 (0x8471 bytes) 001900[0] 1788867727.512284 write 0x950000 thru 0x9577f9 (0x77fa bytes) 002000[0] 1788867731.373006 write 0x2d1000 thru 0x2e02ba (0xf2bb bytes) 002100[0] 1788867735.448073 read 0x588000 thru 0x58a98e (0x298f bytes) 002200[1] 1788867739.268908 mapread 0x05d000 thru 0x064c75 (0x7c76 bytes) 002300[0] 1788867742.592914 write 0x32c000 thru 0x32c149 (0x14a bytes) 002400[0] 1788867747.424686 mapwrite 0x07b000 thru 0x084e63 (0x9e64 bytes) All operations completed A-OK! PASS 16a (246s) == sanityn test 16b: 2500 iterations of dual-mount fsx at small size ========================================================== 07:42:37 (1788867757) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.225134 s, 37.3 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.209039 s, 40.1 MB/s Chance of close/open is 1 in 50 Seed set to 7761 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn skipping zero size read truncating to largest ever: 0x891a5e fallocating to largest ever: 0x8ece73 fallocating to largest ever: 0x92dd3a zero_range to largest ever: 0x9b7a1d 000200[1] 1788867771.394303 write 0x0cc7d2 thru 0x0ce792 (0x1fc1 bytes) 000400[1] 1788867780.257410 write 0x012704 thru 0x013654 (0xf51 bytes) truncating to largest ever: 0x9ff4e8 000500[1] 1788867784.633451 fallocate 0x4721b0 thru 0x47283e (0x68f bytes) 000600[1] 1788867788.764399 punch from 0x05d7bd to 0x05f222 (0x1a66 bytes) 000700[1] 1788867792.912238 read 0x06453b thru 0x065194 (0xc5a bytes) 000800[1] 1788867798.093737 mapread 0x142389 thru 0x144043 (0x1cbb bytes) 000900[1] 1788867801.686693 fallocate 0x5c5c39 thru 0x5c5ea9 (0x271 bytes) 001100[1] 1788867808.799226 mapwrite 0x5eeb5a thru 0x5f0002 (0x14a9 bytes) 001200[1] 1788867813.501069 mapwrite 0x3b5224 thru 0x3b6bff (0x19dc bytes) 001300[1] 1788867817.731901 mapread 0x7e3d6b thru 0x7e5d4a (0x1fe0 bytes) 001400[0] 1788867821.432073 write 0x1a2895 thru 0x1a3532 (0xc9e bytes) 001500[0] 1788867825.855745 write 0x76bfaa thru 0x76c339 (0x390 bytes) 001600[1] 1788867829.725188 trunc from 0x90c331 to 0x90c71a (0x3ea bytes) 001700[0] 1788867833.565208 trunc from 0x08119b to 0x0824a3 (0x1309 bytes) 001800[0] 1788867837.597811 trunc from 0x55f6b7 to 0x560648 (0xf92 bytes) 002100[0] 1788867851.095185 mapread 0x1ac639 thru 0x1ad40e (0xdd6 bytes) 002300[0] 1788867858.443308 trunc from 0x142352 to 0x1427db (0x48a bytes) 002400[0] 1788867862.562378 fallocate 0x528a82 thru 0x529e76 (0x13f5 bytes) All operations completed A-OK! PASS 16b (114s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 07:44:31 (1788867871) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.279268 s, 30.0 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.176696 s, 47.5 MB/s Waiting for MDT destroys to complete Chance of close/open is 1 in 50 Seed set to 7893 fd 0: /mnt/lustre/f16c.sanityn fd 1: /mnt/lustre2/f16c.sanityn skipping zero length punch hole truncating to largest ever: 0x688612 fallocating to largest ever: 0x867494 fallocating to largest ever: 0x997d29 000100[0] 1788867898.969715 trunc from 0x4ae51b to 0x01f9b2 (0x48eb68 bytes) fallocating to largest ever: 0x998be9 truncating to largest ever: 0x9d141b 000300[1] 1788867909.124844 mapread 0x0f399b thru 0x0f6095 (0x26fb bytes) truncating to largest ever: 0x9f259f 000400[1] 1788867913.966838 trunc from 0x0c297f to 0x0d1ac8 (0xf14a bytes) 000500[0] 1788867917.845537 mapwrite 0x3ca0ed thru 0x3cbe45 (0x1d59 bytes) 000800[1] 1788867931.509564 read 0x60eb40 thru 0x614782 (0x5c43 bytes) 000900[1] 1788867936.977575 mapwrite 0x6a742a thru 0x6a8764 (0x133b bytes) 001000[1] 1788867941.927264 write 0x3cb096 thru 0x3d77ac (0xc717 bytes) 001300[0] 1788867958.250057 trunc from 0x9934a0 to 0x7e17ac (0x1b1cf3 bytes) truncating to largest ever: 0x9fa353 001500[1] 1788867968.346863 read 0x3cfefd thru 0x3def91 (0xf095 bytes) 001800[1] 1788867982.903262 mapread 0x004775 thru 0x0102d8 (0xbb64 bytes) 001900[1] 1788867987.214074 trunc from 0x56f863 to 0x577e90 (0x862e bytes) 002000[1] 1788867991.276897 read 0x7c40e7 thru 0x7c99a5 (0x58bf bytes) 002100[1] 1788867995.453526 fallocate 0x5adce7 thru 0x5b72ca (0x95e4 bytes) 002200[1] 1788867999.760199 trunc from 0x924467 to 0x931ed5 (0xda6f bytes) 002300[1] 1788868005.195001 mapwrite 0x79c8b2 thru 0x7a322d (0x697c bytes) 002400[1] 1788868010.844462 mapread 0x3f9e63 thru 0x402458 (0x85f6 bytes) 002500[1] 1788868015.324190 fallocate 0x1d8ba3 thru 0x1d9524 (0x982 bytes) All operations completed A-OK! PASS 16c (151s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 07:47:02 (1788868022) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.224817 s, 37.3 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.208882 s, 40.2 MB/s ldlm.namespaces.MGC192.168.204.157@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9019c802c800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9019d202e800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff9019c802c800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff9019d202e800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9019c802c800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9019d202e800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9019c802c800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9019d202e800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.08368 s, 14.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.92995 s, 35.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.8141 s, 37.3 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 6.21646 s, 16.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.48726 s, 23.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.89444 s, 26.9 MB/s PASS 16d (38s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 07:47:40 (1788868060) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.310746 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039937 s, 26.3 MB/s PASS 16e (7s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 07:47:47 (1788868067) TIMEOUT PASS 16f (28s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 07:48:15 (1788868095) TIMEOUT PASS 16g (29s) == sanityn test 16h: mmap read after truncate file ======= 07:48:44 (1788868124) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d16h.sanityn ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16h (7s) == sanityn test 16i: read after truncate file ============ 07:48:51 (1788868131) striped dir -i0 -c2 -H all_char /mnt/lustre/d16i.sanityn ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (6s) == sanityn test 16j: race dio with buffered i/o ========== 07:48:57 (1788868137) 1+0 records in 1+0 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.688408 s, 38.1 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.11088 s, 23.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.35384 s, 19.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.859723 s, 30.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.24071 s, 21.1 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.02422 s, 25.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.54374 s, 17.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.55758 s, 16.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.85431 s, 14.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.99677 s, 13.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.99586 s, 13.1 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.30138 s, 20.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.36944 s, 19.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.05332 s, 12.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.09098 s, 12.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.48375 s, 17.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.66471 s, 15.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.36239 s, 11.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.41873 s, 10.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (30s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 07:49:27 (1788868167) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fallocating to largest ever: 0x3428364 fallocating to largest ever: 0x3428364 skipping zero size read skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Tue Sep 8 07:50:08 EDT 2026 + fsx 2 done: rc=0 Tue Sep 8 07:50:08 EDT 2026 + fsx 3 done: rc=0 Tue Sep 8 07:50:08 EDT 2026 + fsx 4 done: rc=0 Tue Sep 8 07:50:08 EDT 2026 + fsx 5 done: rc=0 Tue Sep 8 07:50:08 EDT 2026 PASS 16k (53s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 07:50:20 (1788868220) fail_loc=0x8000030a PASS 17 (11s) == sanityn test 18: mmap sanity check =========================================================================================== 07:50:32 (1788868232) mmap test1: basic mmap operation (PASS, 0.19662s) mmap test2: MAP_PRIVATE not write back (PASS, 0.13466s) mmap test3: concurrent mmap ops on two nodes (PASS, 17.947s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 106.88s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.16683s) mmap test6: check mmap write/read content on two nodes (PASS, 0.25605s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 1.7857s) mmap test11: multi-thread shared mmap (PASS, 1.2045s) mmap test10: mtime not change for readonly mmap access (PASS, 1.1129s) PASS 18 (138s) == sanityn test 19: test concurrent uncached read races ========================================================================= 07:52:49 (1788868369) 32+0 records in 32+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.565866 s, 29.6 MB/s loop 5 loop 10 loop 15 loop 20 PASS 19 (30s) == sanityn test 20: test extra readahead page left in cache ============================================================== 07:53:19 (1788868399) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d20.sanityn PASS 20 (8s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 07:53:27 (1788868407) striped dir -i1 -c2 -H crush2 /mnt/lustre/d21.sanityn rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (7s) == sanityn test 23: others should see updated atime while another read============================================================== 07:53:34 (1788868414) now is 1788868417 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.8234 new atime is 1788868478 PASS 23 (71s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 07:54:45 (1788868485) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1780 1269524 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 7296 3599724 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 31640 3575380 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 38936 7175104 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1414116 1780 1269524 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 3833116 7296 3599724 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3833116 31640 3575380 1% /mnt/lustre2[OST:1] filesystem_summary: 7666232 38936 7175104 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 348 999.7K 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1000.0K 280 999.7K 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 256.0K 403 255.6K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 256.0K 403 255.6K 1% /mnt/lustre[OST:1] filesystem_summary: 511.8K 628 511.2K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 348 999.7K 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1000.0K 280 999.7K 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 256.0K 403 255.6K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 256.0K 403 255.6K 1% /mnt/lustre2[OST:1] filesystem_summary: 511.8K 628 511.2K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 1.3G 2.0M 1.2G 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1.3G 1.7M 1.2G 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3.7G 7.1M 3.4G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.7G 30.9M 3.4G 1% /mnt/lustre[OST:1] filesystem_summary: 7.3G 38.0M 6.8G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 348 1023652 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1024000 280 1023720 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 262144 403 261741 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 262144 403 261741 1% /mnt/lustre2[OST:1] filesystem_summary: 524110 628 523482 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1780 1269524 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 7296 3599724 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 31640 3575380 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 38936 7175104 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 348 999.7K 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1000.0K 280 999.7K 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 256.0K 403 255.6K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 256.0K 403 255.6K 1% /mnt/lustre2[OST:1] filesystem_summary: 511.8K 628 511.2K 1% /mnt/lustre2 Reader error: 'No devices found' at 0 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 348 1023652 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 280 1023720 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 403 261741 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 403 261741 1% /mnt/lustre[OST:1] filesystem_summary: 524110 628 523482 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 348 1023652 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1024000 280 1023720 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 262144 403 261741 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 262144 403 261741 1% /mnt/lustre2[OST:1] filesystem_summary: 524110 628 523482 1% /mnt/lustre2 Reader error: 'No devices found' at 0 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1780 1269524 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 7296 3599724 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 31640 3575380 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 38936 7175104 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1414116 1780 1269524 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 3833116 7296 3599724 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3833116 31640 3575380 1% /mnt/lustre2[OST:1] filesystem_summary: 7666232 38936 7175104 1% /mnt/lustre2 PASS 24a (8s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 07:54:54 (1788868494) PASS 24b (7s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 07:55:00 (1788868500) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (7s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 07:55:07 (1788868507) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] Can't lstat /mnt/lustre2/d25b.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] Can't lstat /mnt/lustre2/d25b.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] PASS 25b (7s) == sanityn test 26a: allow mtime to get older ============ 07:55:14 (1788868514) utime: good mknod times 1788868515 <= 1788868516 <= 1788868516 for /mnt/lustre/f26a utime: good mknod times 1788868515 <= 1788868516 <= 1788868516 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (7s) == sanityn test 26b: sync mtime between ost and mds ====== 07:55:21 (1788868521) PASS 26b (8s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 07:55:29 (1788868529) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8234 File: /mnt/lustre/f26c.sanityn Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205289279610 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2026-09-08 07:55:31.000000000 -0400 Birth: 2026-09-08 07:55:31.000000000 -0400 File: /mnt/lustre2/f26c.sanityn Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205289279610 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2026-09-08 07:55:31.000000000 -0400 Birth: 2026-09-08 07:55:31.000000000 -0400 PASS 26c (8s) SKIP: sanityn test_27 skipping excluded test 27 == sanityn test 30: recreate file race =================== 07:55:38 (1788868538) striped dir -i0 -c2 -H crush2 /mnt/lustre/d30.sanityn 0 PASS 30 (8s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 07:55:46 (1788868546) striped dir -i1 -c2 -H all_char /mnt/lustre/d31a.sanityn fail_loc=0x314 PASS 31a (7s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 07:55:54 (1788868554) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg457-server mds-ost sync done. Waiting for MDT destroys to complete striped dir -i1 -c2 -H crush /mnt/lustre/d31b.sanityn fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.204.157@tcp:/lustre 7666232 38944 7175096 1% /mnt/lustre2 PASS 31b (16s) == sanityn test 31r: open-rename(replace) race =========== 07:56:11 (1788868571) -rw-r--r-- 1 root root 0 Sep 8 07:56 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (9s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 07:56:20 (1788868580) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1205: 47742 Terminated tail -f $tfile PASS 31s (8s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 07:56:28 (1788868588) PASS 31t (8s) == sanityn test 32b: lockless i/o ======================== 07:56:37 (1788868597) SKIP: sanityn test_32b max_nolock_bytes is removed >= 2.17.53 SKIP 32b (4s) == sanityn test 32c: contention detection ================ 07:56:41 (1788868601) ldlm.namespaces.filter-lustre-OST0000_UUID.contended_locks=2 ldlm.namespaces.filter-lustre-OST0001_UUID.contended_locks=2 ldlm.namespaces.filter-lustre-OST0000_UUID.contention_events=0 ldlm.namespaces.filter-lustre-OST0001_UUID.contention_events=0 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.74504 s, 30.0 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.34236 s, 39.1 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.13689 s, 24.5 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.55895 s, 20.5 MB/s contention_seconds 4, contention_events 24 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 3.29906 s, 15.9 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 3.73567 s, 14.0 MB/s ldlm.namespaces.filter-lustre-OST0000_UUID.contention_events=0 ldlm.namespaces.filter-lustre-OST0001_UUID.contention_events=0 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.03782 s, 25.7 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.0384 s, 25.7 MB/s PASS 32c (40s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 07:57:22 (1788868642) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (5s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 07:57:27 (1788868647) Stopping /mnt/lustre-mds1 (opts:) on oleg457-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg457-server: oleg457-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg457-client: oleg457-server: ssh exited with exit code 1 Started lustre-MDT0000 create file on 2nd stripe under striped directory /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 2 /mnt/lustre/d33c.sanityn/striped touch /mnt/lustre2/d33c.sanityn/striped/subfile SoLC count 2 Below operations shouldn't trigger Solc: create file on 2nd stripe after setattr chmod 777 /mnt/lustre/d33c.sanityn/striped; touch /mnt/lustre2/d33c.sanityn/striped/subfile create remote dir and local dir /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33c.sanityn/remote create local dir after remote dir creation transaction commit /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33c.sanityn/remote.3; do_facet mds2 /home/green/git/lustre-release/lustre/utils/lctl set_param -n osd*.*MDT0001.force_sync 1; mkdir /mnt/lustre/d33c.sanityn/local.3 Solc count 0 PASS 33c (56s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 07:58:23 (1788868703) remote directory create /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre2/d33d.sanityn/subdir CoS count 2 cross-MDT rename mkdir /mnt/lustre/d33d.sanityn; /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn/d1; /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33d.sanityn/d2; touch /mnt/lustre/d33d.sanityn/d1/src mv /mnt/lustre2/d33d.sanityn/d1/src /mnt/lustre2/d33d.sanityn/d2/tgt CoS count 1 migrate /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn /home/green/git/lustre-release/lustre/utils/lfs migrate -m 1 /mnt/lustre2/d33d.sanityn CoS count 2 PASS 33d (61s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 07:59:24 (1788868764)