-----============= acceptance-small: sanityn ============----- Tue Aug 25 17:13:25 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg104-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 40a skipping tests SLOW=no: 33a === sanityn: start setup 17:13:45 (1787692425) === Starting client oleg104-client.virtnet: -o user_xattr,flock 192.168.201.104@tcp:/lustre /mnt/lustre2 Mount client oleg104-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.104@tcp:/lustre /mnt/lustre2 Started clients oleg104-client.virtnet: 192.168.201.104@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg104-client.virtnet: executing check_config_client /mnt/lustre oleg104-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg104-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff93a482d02800.idle_timeout=debug osc.lustre-OST0000-osc-ffff93a488567800.idle_timeout=debug osc.lustre-OST0001-osc-ffff93a482d02800.idle_timeout=debug osc.lustre-OST0001-osc-ffff93a488567800.idle_timeout=debug disable quota as required oleg104-server: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanityn: finish setup 17:14:28 (1787692468) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0429723 s, 24.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8215] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 17:14:30 (1787692470) PASS 0 (9s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 17:14:39 (1787692479) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (8s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 17:14:47 (1787692487) -rw-r--r-- 1 root root 0 Aug 25 17:14 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (7s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 17:14:54 (1787692494) -rw-r--r-- 1 root root 0 Aug 25 17:14 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (7s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 17:15:01 (1787692501) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (6s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 17:15:07 (1787692507) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (8s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 17:15:15 (1787692515) total 0 -rwxrwxrwx 1 root root 0 Aug 25 17:14 f2a -rwxrwxrwx 1 root root 0 Aug 25 17:14 f2b total 0 -rwxrwxrwx 1 root root 0 Aug 25 17:14 f2a -rwxrwxrwx 1 root root 0 Aug 25 17:14 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.0255571 s, 20.0 kB/s PASS 2e (7s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 17:15:23 (1787692523) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (7s) == sanityn test 2g: check blocks update on sync write ==== 17:15:30 (1787692530) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.28072 s, 7.5 MB/s /mnt/lustre/f2g.sanityn has 4096 blocks /mnt/lustre2/f2g.sanityn has 4096 blocks PASS 2g (8s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 17:15:38 (1787692538) PASS 3 (9s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 17:15:47 (1787692547) PASS 4 (8s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 17:15:55 (1787692555) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (7s) == sanityn test 6: remove of open file on other node ============================================================================ 17:16:02 (1787692562) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (7s) == sanityn test 7: remove of open directory on other node ======================================================================= 17:16:09 (1787692569) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (8s) == sanityn test 8: remove of open special file on other node ==================================================================== 17:16:17 (1787692577) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (8s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 17:16:25 (1787692585) PASS 9a (7s) == sanityn test 9b: append to striped sparse file ======== 17:16:32 (1787692592) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0645579 s, 16.2 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0544002 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (7s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 17:16:39 (1787692599) 1+0 records in 1+0 records out 1 byte copied, 0.00774735 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0273336 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0205078 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0104304 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0257647 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0131301 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0167847 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0235011 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0213101 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0108395 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0148441 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0283932 s, 0.0 kB/s PASS 10a (8s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 17:16:47 (1787692607) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0187895 s, 163 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0372767 s, 110 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.00044282 s, 6.9 MB/s PASS 10b (6s) == sanityn test 11: execution of file opened for write should return error ============================================================== 17:16:53 (1787692613) striped dir -i1 -c2 -H crush /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 298: /mnt/lustre2/d11/f: Text file busy PASS 11 (8s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 17:17:01 (1787692621) warning: '-runtime' deprecated, use '-t runtime' instead - link 319 (time 1787692633.79 total 10.02 last 31.84) - link 651 (time 1787692643.82 total 20.04 last 33.13) - link 920 (time 1787692653.85 total 30.07 last 26.82) - link 1214 (time 1787692663.88 total 40.11 last 29.30) - link 1526 (time 1787692673.89 total 50.12 last 31.16) - link 1834 (time 1787692683.91 total 60.13 last 30.76) - link 2152 (time 1787692693.93 total 70.16 last 31.71) - link 2436 (time 1787692703.96 total 80.18 last 28.33) - link 2811 (time 1787692713.99 total 90.21 last 37.38) total: 3143 link in 100.01 seconds: 31.43 ops/second using seed 1968053377 running for 100 seconds - stat 6944 (time 1787692635 ; total 11 ; last 11) - stat 10000 (time 1787692638 ; total 14 ; last 3) - stat 16568 (time 1787692649 ; total 25 ; last 11) - stat 20000 (time 1787692653 ; total 29 ; last 4) - stat 26232 (time 1787692664 ; total 40 ; last 11) - stat 30000 (time 1787692669 ; total 45 ; last 5) - stat 35861 (time 1787692680 ; total 56 ; last 11) - stat 39717 (time 1787692691 ; total 67 ; last 11) - stat 40000 (time 1787692691 ; total 67 ; last 0) - stat 43204 (time 1787692702 ; total 78 ; last 11) - stat 47579 (time 1787692713 ; total 89 ; last 11) - stat 50000 (time 1787692719 ; total 95 ; last 6) total: 51261 stats in 100 seconds: 512.609985 stats/second - unlinked 0 (time 1787692674 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile3143) error: No such file or directory total: 3142 unlinks in 78 seconds: 40.282051 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22704) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22707) - No such process PASS 12 (137s) == sanityn test 13: test directory page revocation ======= 17:19:18 (1787692758) striped dir -i1 -c2 -H all_char /mnt/lustre/d13 f13 f13 PASS 13 (8s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 17:19:26 (1787692766) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 333: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5089: 23914 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (7s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 17:19:34 (1787692774) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 5089: 24507 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (8s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 17:19:41 (1787692781) striped dir -i0 -c2 -H crush /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 348: 25097 Terminated $DIR1/$tdir/sleep 60 PASS 14b (8s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 17:19:49 (1787692789) striped dir -i0 -c2 -H crush /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 360: 25691 Terminated $DIR1/$tdir/sleep 60 PASS 14c (8s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 17:19:57 (1787692797) striped dir -i0 -c2 -H all_char /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 371: 26287 Terminated $DIR1/$tdir/sleep 60 PASS 14d (9s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 17:20:07 (1787692807) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky Waiting for MDT destroys to complete 0 STRIPECOUNT=2 ORIGFREE=7207412 MAXFREE=2097152000 0 lustre-OST0000 avl=6624 grnt=6603 diff=21 limit=46331 FULL lustre-OST0001 avl=0 grnt=4887 diff=-4887 limit=46331 FULL ERROR: dd blocks 7191682 != file size 7191704 LOG LOG2 file /tmp/oos2.log:dd: error writing '/mnt/lustre/oosfile': No space left on device /tmp/oos2.log:3620094+0 records in /tmp/oos2.log:3620093+0 records out /tmp/oos2.log:3706975232 bytes (3.7 GB, 3.5 GiB) copied, 987.625 s, 3.8 MB/s /tmp/oos2.log2:dd: error writing '/mnt/lustre2/oosfile2': No space left on device /tmp/oos2.log2:3571590+0 records in /tmp/oos2.log2:3571589+0 records out /tmp/oos2.log2:3657307136 bytes (3.7 GB, 3.4 GiB) copied, 986.887 s, 3.7 MB/s Waiting for MDT destroys to complete Waiting for MDT destroys to complete PASS 15 (1054s) == sanityn test 16a: 2500 iterations of dual-mount fsx === 17:37:41 (1787693861) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.338701 s, 24.8 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.32296 s, 26.0 MB/s Chance of close/open is 1 in 50 Seed set to 3867 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fallocating to largest ever: 0x8acd51 skipping zero length zero range skipping zero size read skipping zero size read skipping zero length punch hole truncating to largest ever: 0x972f94 000100[0] 1787693874.103740 trunc from 0x605ec8 to 0x72ac22 (0x124d5b bytes) 000200[1] 1787693879.887736 mapread 0x3c6b7b thru 0x3d2cb7 (0xc13d bytes) fallocating to largest ever: 0x9f9f90 000400[1] 1787693890.863981 mapread 0x678402 thru 0x67f354 (0x6f53 bytes) 000500[1] 1787693896.282608 mapread 0x893629 thru 0x89e2d5 (0xacad bytes) 000600[1] 1787693901.257749 trunc from 0x19a746 to 0x4a65a1 (0x30be5c bytes) 000700[0] 1787693906.429929 mapwrite 0x23a3dd thru 0x23f05f (0x4c83 bytes) 000800[0] 1787693911.625991 mapread 0x2e4d94 thru 0x2f3307 (0xe574 bytes) 000900[0] 1787693916.687825 trunc from 0x2463e1 to 0x24c25e (0x5e7e bytes) 001100[0] 1787693926.131459 write 0x2bfc8b thru 0x2cc0c1 (0xc437 bytes) 001200[0] 1787693931.582053 mapread 0x03a019 thru 0x04576f (0xb757 bytes) 001300[0] 1787693937.800427 fallocate 0x02281f thru 0x023543 (0xd25 bytes) 001400[0] 1787693941.740941 read 0x01fbd1 thru 0x02f7ec (0xfc1c bytes) 001500[1] 1787693945.668020 read 0x0019bc thru 0x00f088 (0xd6cd bytes) 001600[1] 1787693950.572980 mapwrite 0x70c139 thru 0x71ae3d (0xed05 bytes) 001700[1] 1787693955.390954 write 0x3f6eee thru 0x3faa08 (0x3b1b bytes) 001900[0] 1787693965.991824 fallocate 0x8b285a thru 0x8bbeb4 (0x965b bytes) 002000[0] 1787693970.281695 write 0x8f6c05 thru 0x904b06 (0xdf02 bytes) 002100[1] 1787693975.714368 write 0x3eb29d thru 0x3ef6e1 (0x4445 bytes) 002200[1] 1787693981.109658 trunc from 0x4c3417 to 0x4d1c0b (0xe7f5 bytes) 002400[1] 1787693989.785008 write 0x352f9d thru 0x361ef2 (0xef56 bytes) fallocating to largest ever: 0x9faf40 002500[0] 1787693994.067180 trunc from 0x9c8f9c to 0x482891 (0x54670a bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 3994 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn skipping zero size read truncating to largest ever: 0x463c84 fallocating to largest ever: 0x79af72 truncating to largest ever: 0x89a4fb truncating to largest ever: 0x9f5ceb 000200[1] 1787694002.379918 trunc from 0x6efb61 to 0x6f7897 (0x7d37 bytes) 000300[0] 1787694006.670461 punch from 0x2836bd to 0x2885f0 (0x4f34 bytes) 000400[0] 1787694011.057203 read 0x990000 thru 0x996aba (0x6abb bytes) 000500[1] 1787694015.329411 punch from 0x008a85 to 0x00ecd8 (0x6254 bytes) 000600[0] 1787694019.263207 mapread 0x1c3000 thru 0x1c5ea7 (0x2ea8 bytes) 000700[0] 1787694023.586959 trunc from 0x8bafa5 to 0x299bcd (0x6213d7 bytes) 000900[0] 1787694032.114243 fallocate 0x1b172c thru 0x1b2e6b (0x1740 bytes) 001000[1] 1787694035.797548 fallocate 0x17f279 thru 0x18829c (0x9024 bytes) 001100[1] 1787694039.728427 punch from 0x10692e to 0x107c15 (0x12e8 bytes) 001200[0] 1787694043.379885 mapwrite 0x8ca000 thru 0x8d5b11 (0xbb12 bytes) 001300[1] 1787694047.523416 trunc from 0x3c40fe to 0x9dd85d (0x619760 bytes) 001500[1] 1787694053.502984 trunc from 0x01cdf6 to 0x02717a (0xa385 bytes) 001600[0] 1787694057.845862 trunc from 0x05de41 to 0x9a32ad (0x94546d bytes) fallocating to largest ever: 0xa00000 001800[0] 1787694066.070714 mapwrite 0x7ae000 thru 0x7b7c6e (0x9c6f bytes) 001900[1] 1787694070.305586 trunc from 0x9f8536 to 0x11a928 (0x8ddc0d bytes) 002000[0] 1787694073.687820 trunc from 0x828e75 to 0x82f96b (0x6af7 bytes) 002100[1] 1787694077.955832 trunc from 0x0eebc1 to 0x926d80 (0x8381c0 bytes) 002200[0] 1787694080.844490 punch from 0x1176a0 to 0x11e60d (0x6f6e bytes) 002300[1] 1787694083.248667 write_OD 0x4d9000 thru 0x4ddfff (0x5000 bytes) 002400[1] 1787694086.007471 write 0x7bd000 thru 0x7c93b4 (0xc3b5 bytes) 002500[0] 1787694089.990795 read 0x087000 thru 0x087a28 (0xa29 bytes) All operations completed A-OK! PASS 16a (235s) == sanityn test 16b: 2500 iterations of dual-mount fsx at small size ========================================================== 17:41:36 (1787694096) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.245501 s, 34.2 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.217656 s, 38.5 MB/s Chance of close/open is 1 in 50 Seed set to 4100 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn skipping zero size read truncating to largest ever: 0x3d3c1e fallocating to largest ever: 0x68ec81 fallocating to largest ever: 0x7aa4f5 truncating to largest ever: 0x950227 truncating to largest ever: 0x9ceae4 000100[0] 1787694106.345002 fallocate 0x786448 thru 0x7867c2 (0x37b bytes) truncating to largest ever: 0x9e2465 000200[1] 1787694113.556544 read 0x185097 thru 0x185fdd (0xf47 bytes) 000300[1] 1787694119.619993 mapread 0x9478cc thru 0x9491ab (0x18e0 bytes) 000400[1] 1787694124.219534 read 0x3c6ed2 thru 0x3c8e3e (0x1f6d bytes) 000700[0] 1787694139.487010 fallocate 0x836691 thru 0x836a39 (0x3a9 bytes) 000800[1] 1787694144.746792 read 0x42f27b thru 0x430616 (0x139c bytes) 000900[1] 1787694150.741350 trunc from 0x31c2d8 to 0x31cd11 (0xa3a bytes) 001000[1] 1787694154.441548 punch from 0x866744 to 0x86674e (0xb bytes) 001100[0] 1787694160.479952 mapwrite 0x5678e3 thru 0x5692f1 (0x1a0f bytes) 001200[1] 1787694164.011084 trunc from 0x84bcdc to 0x83124e (0x1aa8d bytes) 001500[0] 1787694178.469953 mapwrite 0x46b4d7 thru 0x46d24d (0x1d77 bytes) 001600[1] 1787694183.249968 trunc from 0x85d774 to 0x5e8dc5 (0x2749ae bytes) 001800[1] 1787694192.678807 mapwrite 0x404912 thru 0x404fdf (0x6ce bytes) 001900[0] 1787694196.383849 punch from 0x14002d to 0x140ddd (0xdb1 bytes) 002000[1] 1787694199.300560 punch from 0x0126c5 to 0x013f78 (0x18b4 bytes) 002200[1] 1787694206.882760 write 0x082845 thru 0x08444b (0x1c07 bytes) 002300[0] 1787694210.970099 write 0x7a148a thru 0x7a2c27 (0x179e bytes) fallocating to largest ever: 0x9ea7d9 002400[1] 1787694215.298388 read 0x45e7aa thru 0x45f086 (0x8dd bytes) 002500[0] 1787694219.278058 trunc from 0x0d7993 to 0x0d8705 (0xd73 bytes) All operations completed A-OK! PASS 16b (129s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 17:43:45 (1787694225) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.280064 s, 30.0 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.292155 s, 28.7 MB/s Waiting for MDT destroys to complete Chance of close/open is 1 in 50 Seed set to 4250 fd 0: /mnt/lustre/f16c.sanityn fd 1: /mnt/lustre2/f16c.sanityn skipping zero size read skipping zero length zero range skipping zero length punch hole truncating to largest ever: 0x28e058 truncating to largest ever: 0x8fb7ca truncating to largest ever: 0x9123bb 000100[1] 1787694255.973725 read 0x247c4b thru 0x24ffe6 (0x839c bytes) fallocating to largest ever: 0x94fcbb zero_range to largest ever: 0x961829 000200[0] 1787694260.526340 read 0x249bc3 thru 0x253aab (0x9ee9 bytes) 000300[0] 1787694269.959429 write 0x45325f thru 0x457f96 (0x4d38 bytes) truncating to largest ever: 0x98d8b0 000400[1] 1787694276.658137 write 0x626b61 thru 0x632501 (0xb9a1 bytes) truncating to largest ever: 0x998736 truncating to largest ever: 0x9cd490 fallocating to largest ever: 0x9e5048 000600[0] 1787694290.556921 read 0x1b04b1 thru 0x1b21a7 (0x1cf7 bytes) 000700[1] 1787694297.073028 read 0x253cbb thru 0x25a0ff (0x6445 bytes) fallocating to largest ever: 0x9f54d6 000800[1] 1787694301.446399 write 0x7c92ba thru 0x7d602b (0xcd72 bytes) 000900[1] 1787694305.461925 mapwrite 0x973b36 thru 0x982398 (0xe863 bytes) 001100[0] 1787694316.386831 write 0x14172d thru 0x142aa8 (0x137c bytes) 001200[1] 1787694322.414959 mapread 0x11227a thru 0x114b52 (0x28d9 bytes) 001400[1] 1787694335.284827 fallocate 0x1a778f thru 0x1aa43b (0x2cad bytes) 001500[0] 1787694340.038211 mapwrite 0x312b90 thru 0x31b308 (0x8779 bytes) 001600[1] 1787694345.161829 read 0x0c7362 thru 0x0c73b3 (0x52 bytes) 001700[0] 1787694349.342390 punch from 0x4c3c95 to 0x4c8226 (0x4592 bytes) 002000[0] 1787694365.639870 punch from 0x82e5b7 to 0x835347 (0x6d91 bytes) 002100[1] 1787694370.713372 punch from 0x0ff350 to 0x10e548 (0xf1f9 bytes) 002200[1] 1787694377.171786 mapread 0x1fad17 thru 0x1fd82e (0x2b18 bytes) 002300[0] 1787694383.562831 trunc from 0x9dec0b to 0x885335 (0x1598d5 bytes) 002500[1] 1787694394.427369 trunc from 0x143564 to 0x14b430 (0x7ecd bytes) All operations completed A-OK! PASS 16c (178s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 17:46:43 (1787694403) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.186957 s, 44.9 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.158462 s, 52.9 MB/s ldlm.namespaces.MGC192.168.201.104@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff93a482d02800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff93a488567800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff93a482d02800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff93a488567800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff93a482d02800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff93a488567800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff93a482d02800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff93a488567800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.66524 s, 13.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.98709 s, 35.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.60913 s, 29.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.03367 s, 13.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.10276 s, 25.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.6912 s, 28.4 MB/s PASS 16d (44s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 17:47:27 (1787694447) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.391959 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0446834 s, 23.5 MB/s PASS 16e (8s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 17:47:35 (1787694455) TIMEOUT PASS 16f (29s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 17:48:04 (1787694484) TIMEOUT PASS 16g (28s) == sanityn test 16h: mmap read after truncate file ======= 17:48:33 (1787694513) striped dir -i0 -c2 -H crush /mnt/lustre/d16h.sanityn ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16h (9s) == sanityn test 16i: read after truncate file ============ 17:48:42 (1787694522) striped dir -i0 -c2 -H crush2 /mnt/lustre/d16i.sanityn ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (9s) == sanityn test 16j: race dio with buffered i/o ========== 17:48:51 (1787694531) 1+0 records in 1+0 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.21998 s, 21.5 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.85881 s, 14.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.03057 s, 12.9 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.14976 s, 22.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.67714 s, 15.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.11998 s, 23.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.74519 s, 15.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.48962 s, 10.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.56732 s, 10.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 3.83927 s, 6.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 4.05882 s, 6.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.49455 s, 17.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.54213 s, 17.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.25097 s, 11.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.26019 s, 11.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.61808 s, 16.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 1.73714 s, 15.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.42928 s, 10.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 2.51336 s, 10.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (37s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 17:49:28 (1787694568) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 All operations completed A-OK! Tue Aug 25 17:50:13 EDT 2026 + fsx 2 done: rc=0 Tue Aug 25 17:50:13 EDT 2026 All operations completed A-OK! All operations completed A-OK! + fsx 3 done: rc=0 Tue Aug 25 17:50:14 EDT 2026 + fsx 4 done: rc=0 Tue Aug 25 17:50:14 EDT 2026 + fsx 5 done: rc=0 Tue Aug 25 17:50:14 EDT 2026 PASS 16k (54s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 17:50:22 (1787694622) fail_loc=0x8000030a PASS 17 (10s) == sanityn test 18: mmap sanity check =========================================================================================== 17:50:32 (1787694632) mmap test1: basic mmap operation (PASS, 0.17433s) mmap test2: MAP_PRIVATE not write back (PASS, 0.060387s) mmap test3: concurrent mmap ops on two nodes (PASS, 9.7324s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.6629s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.34209s) mmap test6: check mmap write/read content on two nodes (PASS, 0.39431s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 1.4028s) mmap test11: multi-thread shared mmap (PASS, 2.2206s) mmap test10: mtime not change for readonly mmap access (PASS, 1.1682s) PASS 18 (31s) == sanityn test 19: test concurrent uncached read races ========================================================================= 17:51:04 (1787694664) 32+0 records in 32+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.624085 s, 26.9 MB/s loop 5 loop 10 loop 15 loop 20 PASS 19 (55s) == sanityn test 20: test extra readahead page left in cache ============================================================== 17:51:59 (1787694719) striped dir -i0 -c2 -H all_char /mnt/lustre/d20.sanityn PASS 20 (9s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 17:52:07 (1787694727) striped dir -i1 -c2 -H all_char /mnt/lustre/d21.sanityn rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (6s) == sanityn test 23: others should see updated atime while another read============================================================== 17:52:13 (1787694733) now is 1787694736 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 new atime is 1787694797 PASS 23 (70s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 17:53:23 (1787694803) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 31876 3575144 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 6880 3600140 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 38756 7175284 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1414116 1784 1269520 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 3833116 31876 3575144 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3833116 6880 3600140 1% /mnt/lustre2[OST:1] filesystem_summary: 7666232 38756 7175284 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 350 999.7K 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1000.0K 278 999.7K 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 256.0K 405 255.6K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 256.0K 369 255.6K 1% /mnt/lustre[OST:1] filesystem_summary: 511.9K 628 511.2K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 351 999.7K 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1000.0K 278 999.7K 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 256.0K 405 255.6K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 256.0K 369 255.6K 1% /mnt/lustre2[OST:1] filesystem_summary: 511.9K 629 511.2K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 1.3G 2.0M 1.2G 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1.3G 1.7M 1.2G 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3.7G 31.1M 3.4G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.7G 6.7M 3.4G 1% /mnt/lustre[OST:1] filesystem_summary: 7.3G 37.8M 6.8G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 351 1023649 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1024000 278 1023722 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 262144 405 261739 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 262144 369 261775 1% /mnt/lustre2[OST:1] filesystem_summary: 524143 629 523514 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 31876 3575144 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 6880 3600140 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 38756 7175284 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 351 999.7K 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1000.0K 278 999.7K 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 256.0K 405 255.6K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 256.0K 369 255.6K 1% /mnt/lustre2[OST:1] filesystem_summary: 511.9K 629 511.2K 1% /mnt/lustre2 Reader error: 'No devices found' at 0 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 350 1023650 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 278 1023722 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 405 261739 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 369 261775 1% /mnt/lustre[OST:1] filesystem_summary: 524142 628 523514 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 351 1023649 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1024000 278 1023722 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 262144 405 261739 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 262144 369 261775 1% /mnt/lustre2[OST:1] filesystem_summary: 524143 629 523514 1% /mnt/lustre2 Reader error: 'No devices found' at 0 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 31876 3575144 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 6880 3600140 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 38756 7175284 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2016 1269288 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1414116 1784 1269520 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 3833116 31876 3575144 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3833116 6880 3600140 1% /mnt/lustre2[OST:1] filesystem_summary: 7666232 38756 7175284 1% /mnt/lustre2 PASS 24a (7s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 17:53:30 (1787694810) PASS 24b (7s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 17:53:37 (1787694817) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (9s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 17:53:46 (1787694826) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] Can't lstat /mnt/lustre2/d25b.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] Can't lstat /mnt/lustre2/d25b.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] PASS 25b (9s) == sanityn test 26a: allow mtime to get older ============ 17:53:56 (1787694836) utime: good mknod times 1787694837 <= 1787694838 <= 1787694838 for /mnt/lustre/f26a utime: good mknod times 1787694837 <= 1787694838 <= 1787694838 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (9s) == sanityn test 26b: sync mtime between ost and mds ====== 17:54:04 (1787694844) PASS 26b (9s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 17:54:13 (1787694853) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 File: /mnt/lustre/f26c.sanityn Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205289279613 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2026-08-25 17:54:15.000000000 -0400 Birth: 2026-08-25 17:54:16.000000000 -0400 File: /mnt/lustre2/f26c.sanityn Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205289279613 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2026-08-25 17:54:15.000000000 -0400 Birth: 2026-08-25 17:54:16.000000000 -0400 PASS 26c (8s) SKIP: sanityn test_27 skipping excluded test 27 == sanityn test 30: recreate file race =================== 17:54:23 (1787694863) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d30.sanityn 0 PASS 30 (12s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 17:54:35 (1787694875) striped dir -i1 -c2 -H all_char /mnt/lustre/d31a.sanityn fail_loc=0x314 PASS 31a (8s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 17:54:43 (1787694883) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg104-server mds-ost sync done. Waiting for MDT destroys to complete striped dir -i1 -c2 -H crush /mnt/lustre/d31b.sanityn fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.201.104@tcp:/lustre 7666232 39888 7174152 1% /mnt/lustre2 PASS 31b (23s) == sanityn test 31r: open-rename(replace) race =========== 17:55:06 (1787694906) -rw-r--r-- 1 root root 0 Aug 25 17:55 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (11s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 17:55:17 (1787694917) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1205: 47706 Terminated tail -f $tfile PASS 31s (8s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 17:55:25 (1787694925) PASS 31t (11s) == sanityn test 32b: lockless i/o ======================== 17:55:36 (1787694936) SKIP: sanityn test_32b max_nolock_bytes is removed >= 2.17.53 SKIP 32b (3s) == sanityn test 32c: contention detection ================ 17:55:40 (1787694940) ldlm.namespaces.filter-lustre-OST0000_UUID.contended_locks=2 ldlm.namespaces.filter-lustre-OST0001_UUID.contended_locks=2 ldlm.namespaces.filter-lustre-OST0000_UUID.contention_events=0 ldlm.namespaces.filter-lustre-OST0001_UUID.contention_events=0 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.81444 s, 28.9 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.89761 s, 27.6 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.92671 s, 27.2 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.2281 s, 23.5 MB/s contention_seconds 4, contention_events 21 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.76681 s, 29.7 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.10001 s, 25.0 MB/s ldlm.namespaces.filter-lustre-OST0000_UUID.contention_events=0 ldlm.namespaces.filter-lustre-OST0001_UUID.contention_events=0 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.18304 s, 44.3 MB/s 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.20381 s, 43.6 MB/s PASS 32c (29s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 17:56:11 (1787694971) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (4s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 17:56:15 (1787694975) Stopping /mnt/lustre-mds1 (opts:) on oleg104-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg104-server: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg104-client: oleg104-server: ssh exited with exit code 1 Started lustre-MDT0000 create file on 2nd stripe under striped directory /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 2 /mnt/lustre/d33c.sanityn/striped touch /mnt/lustre2/d33c.sanityn/striped/subfile SoLC count 2 Below operations shouldn't trigger Solc: create file on 2nd stripe after setattr chmod 777 /mnt/lustre/d33c.sanityn/striped; touch /mnt/lustre2/d33c.sanityn/striped/subfile create remote dir and local dir /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33c.sanityn/remote create local dir after remote dir creation transaction commit /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33c.sanityn/remote.3; do_facet mds2 /home/green/git/lustre-release/lustre/utils/lctl set_param -n osd*.*MDT0001.force_sync 1; mkdir /mnt/lustre/d33c.sanityn/local.3 Solc count 0 PASS 33c (59s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 17:57:15 (1787695035) remote directory create /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre2/d33d.sanityn/subdir CoS count 2 cross-MDT rename mkdir /mnt/lustre/d33d.sanityn; /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn/d1; /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33d.sanityn/d2; touch /mnt/lustre/d33d.sanityn/d1/src mv /mnt/lustre2/d33d.sanityn/d1/src /mnt/lustre2/d33d.sanityn/d2/tgt CoS count 1 migrate /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn /home/green/git/lustre-release/lustre/utils/lfs migrate -m 1 /mnt/lustre2/d33d.sanityn CoS count 2 PASS 33d (63s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 17:58:18 (1787695098) plain dir creation mkdir /mnt/lustre2/d33e.sanityn/plain open file and write echo abc > /mnt/lustre2/d33e.sanityn/f33e.sanityn append write echo dfg >> /mnt/lustre2/d33e.sanityn/f33e.sanityn setattr touch /mnt/lustre2/d33e.sanityn/f33e.sanityn file unlink rm /mnt/lustre2/d33e.sanityn/f33e.sanityn plain dir unlink rmdir /mnt/lustre2/d33e.sanityn/plain striped directory creation /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 2 /mnt/lustre2/d33e.sanityn/striped set default LMV to create striped subdir /home/green/git/lustre-release/lustre/utils/lfs setdirstripe -D -c 2 /mnt/lustre/d33e.sanityn striped subdir creation createmany -d /mnt/lustre/d33e.sanityn/subdir 100 total: 100 mkdir in 2.07 seconds: 48.33 ops/second sub file creation and write createmany -o /mnt/lustre/d33e.sanityn/subfile 100; echo abc > /mnt/lustre/d33e.sanityn/subfile1 total: 100 open/close in 1.57 seconds: 63.82 ops/second sub file append write echo dfg >> /mnt/lustre2/d33e.sanityn/subfile2 subdir setatttr touch /mnt/lustre2/d33e.sanityn/subdir1 subdir unlink unlinkmany -d /mnt/lustre/d33e.sanityn/subdir 100 - unlinked 0 (time 1787695107 ; total 1 ; last 1) total: 100 unlinks in 6 seconds: 16.666666 unlinks/second sub file unlink unlinkmany /mnt/lustre2/d33e.sanityn/subfile 100 - unlinked 0 (time 1787695113 ; total 0 ; last 0) total: 100 unlinks in 2 seconds: 50.000000 unlinks/second sub file creation follows striped dir chmod chmod 777 /mnt/lustre/d33e.sanityn/striped; touch /mnt/lustre/d33e.sanityn/striped/subfile striped directory unlink rm -rf /mnt/lustre2/d33e.sanityn/striped directory unlink rm -rf /mnt/lustre2/d33e.sanityn CoS count 0 PASS 33e (29s) == sanityn test 34: no lock timeout under IO ============= 17:58:47 (1787695127) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg104-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff93a482d02800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff93a482d02800.ost_server_uuid in IDLE state after 0 sec oleg104-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff93a482d02800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff93a482d02800.ost_server_uuid in FULL state after 0 sec oleg104-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff93a482d02800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff93a482d02800.ost_server_uuid in IDLE state after 0 sec oleg104-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff93a482d02800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff93a482d02800.ost_server_uuid in FULL state after 0 sec oleg104-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff93a482d02800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff93a482d02800.ost_server_uuid in IDLE state after 0 sec oleg104-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff93a482d02800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff93a482d02800.ost_server_uuid in FULL state after 0 sec PASS 34 (151s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 18:01:18 (1787695278) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d35.sanityn fail_loc=0x80000317 Race attempt 0 Wait for 59746 59777 for 60 sec... - open/close 741 (time 1787695295.54 total 10.01 last 74.06) - open/close 1438 (time 1787695305.54 total 20.01 last 69.69) - open/close 2294 (time 1787695315.54 total 30.01 last 85.60) - open/close 2960 (time 1787695325.56 total 40.03 last 66.46) - open/close 3642 (time 1787695335.60 total 50.07 last 67.91) total: 4000 open/close in 55.61 seconds: 71.93 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.201.104@tcp:/lustre 7.4G 40M 6.9G 1% /mnt/lustre 192.168.201.104@tcp:/lustre 7.4G 40M 6.9G 1% /mnt/lustre2 PASS 35 (73s) == sanityn test 36: handle ESTALE/open-unlink correctly == 18:02:31 (1787695351) striped dir -i0 -c2 -H all_char /mnt/lustre/d36.sanityn Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg104-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.87785 s, 27.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(0) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.33477 s, 39.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(1) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.9694 s, 26.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(2) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.73582 s, 30.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(3) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.19801 s, 23.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(4) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.75633 s, 29.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(5) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.40563 s, 37.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(6) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.94848 s, 26.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(7) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.9691 s, 26.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(8) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.91988 s, 27.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(9) *** before(7174096) after_dd(7122896) after(7174096) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.59667 s, 20.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8215 Waiting for MDT destroys to complete *** cycle(10) *** before(7174096) after_dd(7122896) after(7174096) PASS 36 (308s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 18:07:39 (1787695659) striped dir -i1 -c2 -H crush2 /mnt/lustre/d37.sanityn multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.8215