-----============= acceptance-small: sanityn ============----- Wed Aug 13 10:39:56 EDT 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg349-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 40a skipping tests SLOW=no: 33a === sanityn: start setup 10:40:04 (1755096004) === Starting client oleg349-client.virtnet: -o user_xattr,flock 192.168.203.149@tcp:/lustre /mnt/lustre2 Started clients oleg349-client.virtnet: 192.168.203.149@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg349-client.virtnet: executing check_config_client /mnt/lustre oleg349-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg349-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff972203e77800.idle_timeout=debug osc.lustre-OST0000-osc-ffff972204234800.idle_timeout=debug osc.lustre-OST0001-osc-ffff972203e77800.idle_timeout=debug osc.lustre-OST0001-osc-ffff972204234800.idle_timeout=debug disable quota as required oleg349-server: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanityn: finish setup 10:40:19 (1755096019) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148082 s, 70.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8225] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 10:40:19 (1755096019) PASS 0 (3s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 10:40:23 (1755096023) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 10:40:25 (1755096025) -rw-r--r-- 1 root root 0 Aug 13 10:40 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (3s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 10:40:28 (1755096028) -rw-r--r-- 1 root root 0 Aug 13 10:40 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (3s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 10:40:31 (1755096031) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 10:40:34 (1755096034) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (3s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 10:40:36 (1755096036) total 0 -rwxrwxrwx 1 root root 0 Aug 13 10:40 f2a -rwxrwxrwx 1 root root 0 Aug 13 10:40 f2b total 0 -rwxrwxrwx 1 root root 0 Aug 13 10:40 f2a -rwxrwxrwx 1 root root 0 Aug 13 10:40 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.00426497 s, 120 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 10:40:39 (1755096039) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 10:40:41 (1755096041) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0837418 s, 25.0 MB/s /mnt/lustre/f2g.sanityn has 4096 blocks /mnt/lustre2/f2g.sanityn has 4096 blocks PASS 2g (3s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 10:40:44 (1755096044) PASS 3 (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 10:40:46 (1755096046) PASS 4 (4s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 10:40:50 (1755096050) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 10:40:52 (1755096052) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (3s) == sanityn test 7: remove of open directory on other node ======================================================================= 10:40:55 (1755096055) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 10:40:57 (1755096057) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 10:41:00 (1755096060) PASS 9a (3s) == sanityn test 9b: append to striped sparse file ======== 10:41:02 (1755096062) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200723 s, 52.2 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0119684 s, 0.3 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 10:41:04 (1755096064) 1+0 records in 1+0 records out 1 byte copied, 0.00162207 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00261282 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00294499 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0039294 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00313486 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00277995 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0026249 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00356438 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00407667 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0039424 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00519072 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00401614 s, 0.2 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 10:41:06 (1755096066) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.00312395 s, 983 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0099193 s, 413 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.00015811 s, 19.4 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 10:41:08 (1755096068) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 300: /mnt/lustre2/d11/f: Text file busy PASS 11 (3s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 10:41:11 (1755096071) warning: '-runtime' deprecated, use '-t runtime' instead - link 1930 (time 1755096081.77 total 10.00 last 192.97) - link 3974 (time 1755096091.78 total 20.00 last 204.35) - link 5737 (time 1755096101.78 total 30.01 last 176.27) - link 7361 (time 1755096111.78 total 40.01 last 162.30) - link 9122 (time 1755096121.78 total 50.01 last 176.09) - link 10000 (time 1755096126.20 total 54.43 last 198.92) - link 11870 (time 1755096136.20 total 64.43 last 186.95) - link 13655 (time 1755096146.20 total 74.43 last 178.44) - link 15500 (time 1755096156.21 total 84.43 last 184.47) - link 17299 (time 1755096166.21 total 94.44 last 179.86) total: 18197 link in 100.00 seconds: 181.97 ops/second using seed 484040086 running for 100 seconds - stat 10000 (time 1755096077 ; total 5 ; last 5) - stat 20000 (time 1755096082 ; total 10 ; last 5) - stat 30000 (time 1755096087 ; total 15 ; last 5) - stat 40000 (time 1755096092 ; total 20 ; last 5) - stat 50000 (time 1755096097 ; total 25 ; last 5) - stat 60000 (time 1755096101 ; total 29 ; last 4) - stat 70000 (time 1755096106 ; total 34 ; last 5) - stat 80000 (time 1755096111 ; total 39 ; last 5) - stat 90000 (time 1755096117 ; total 45 ; last 6) - stat 100000 (time 1755096122 ; total 50 ; last 5) - stat 108496 (time 1755096133 ; total 61 ; last 11) - stat 110000 (time 1755096135 ; total 63 ; last 2) - stat 117701 (time 1755096146 ; total 74 ; last 11) - stat 120000 (time 1755096149 ; total 77 ; last 3) - stat 127669 (time 1755096160 ; total 88 ; last 11) - stat 130000 (time 1755096163 ; total 91 ; last 3) total: 136215 stats in 100 seconds: 1362.150024 stats/second - unlinked 0 (time 1755096122 ; total 0 ; last 0) - unlinked 10000 (time 1755096184 ; total 62 ; last 62) unlink(/mnt/lustre2/lockdir/lockfile18197) error: No such file or directory total: 18196 unlinks in 89 seconds: 204.449432 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22671) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22673) - No such process PASS 12 (142s) == sanityn test 13: test directory page revocation ======= 10:43:33 (1755096213) striped dir -i1 -c2 -H all_char /mnt/lustre/d13 f13 f13 PASS 13 (2s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 10:43:35 (1755096215) striped dir -i0 -c2 -H all_char /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4953: 23882 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (3s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 10:43:38 (1755096218) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4953: 24473 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 10:43:40 (1755096220) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 350: 25062 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 10:43:42 (1755096222) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 362: 25655 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 10:43:44 (1755096224) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 373: 26251 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 10:43:47 (1755096227) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky Waiting for MDT destroys to complete 0 STRIPECOUNT=2 ORIGFREE=7207300 MAXFREE=2097152000 0 lustre-OST0000 avl=796 grnt=3563 diff=-2767 limit=46331 FULL lustre-OST0001 avl=572 grnt=619 diff=-47 limit=46331 FULL ERROR: dd blocks 7197554 != file size 7197576 LOG LOG2 file /tmp/oos2.log:dd: error writing '/mnt/lustre/oosfile': No space left on device /tmp/oos2.log:3595854+0 records in /tmp/oos2.log:3595853+0 records out /tmp/oos2.log:3682153472 bytes (3.7 GB, 3.4 GiB) copied, 434.735 s, 8.5 MB/s /tmp/oos2.log2:dd: error writing '/mnt/lustre2/oosfile2': No space left on device /tmp/oos2.log2:3601702+0 records in /tmp/oos2.log2:3601701+0 records out /tmp/oos2.log2:3688141824 bytes (3.7 GB, 3.4 GiB) copied, 434.743 s, 8.5 MB/s Waiting for MDT destroys to complete Waiting for MDT destroys to complete PASS 15 (464s) == sanityn test 16a: 2500 iterations of dual-mount fsx === 10:51:31 (1755096691) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.118722 s, 70.7 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.121119 s, 69.3 MB/s Chance of close/open is 1 in 50 Seed set to 6692 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn skipping zero size read skipping zero size read truncating to largest ever: 0x1eb675 truncating to largest ever: 0x285e80 truncating to largest ever: 0x97a26f zero_range to largest ever: 0x97e4d8 000100[0] 1755096693.596863 mapwrite 0x8f8ca3 thru 0x8fdd92 (0x50f0 bytes) fallocating to largest ever: 0x9d41e1 truncating to largest ever: 0x9eb5c9 000200[0] 1755096694.473914 mapread 0x458b3d thru 0x460479 (0x793d bytes) 000300[0] 1755096695.225317 mapwrite 0x4c3ef3 thru 0x4c8424 (0x4532 bytes) fallocating to largest ever: 0x9f8a92 000400[1] 1755096696.200508 punch from 0x721abf to 0x721cef (0x231 bytes) 000500[0] 1755096696.984622 punch from 0x31cc75 to 0x31fe96 (0x3222 bytes) 000600[1] 1755096697.914681 read 0x2f9043 thru 0x30237c (0x933a bytes) fallocating to largest ever: 0x9fa27f 000700[0] 1755096698.748168 mapwrite 0x6e4c69 thru 0x6f46df (0xfa77 bytes) fallocating to largest ever: 0x9fcd5c 000900[1] 1755096700.540734 punch from 0x3224c7 to 0x32c918 (0xa452 bytes) 001100[0] 1755096702.159892 write 0x6a296e thru 0x6acb5d (0xa1f0 bytes) 001300[0] 1755096703.838289 trunc from 0x51a96a to 0x060368 (0x4ba601 bytes) 001400[1] 1755096704.864575 punch from 0x4fbfa7 to 0x503465 (0x74bf bytes) 001500[1] 1755096705.681396 trunc from 0x49e0a8 to 0x4a886b (0xa7c4 bytes) 001700[1] 1755096707.521801 trunc from 0x5aee7f to 0x4aac7a (0x104204 bytes) 001800[0] 1755096708.484227 fallocate 0x616d3b thru 0x61eec3 (0x8189 bytes) 001900[1] 1755096709.534702 punch from 0x600d06 to 0x60b1ea (0xa4e5 bytes) 002000[0] 1755096710.594727 mapread 0x2056a7 thru 0x208b36 (0x3490 bytes) 002100[1] 1755096711.632108 trunc from 0x7c88fe to 0x7e723e (0x1e941 bytes) 002200[0] 1755096712.654697 punch from 0x1cee66 to 0x1da8c3 (0xba5e bytes) 002300[1] 1755096713.521399 read 0x0c30a4 thru 0x0ce6a1 (0xb5fe bytes) 002400[0] 1755096714.394201 read 0x455f8f thru 0x46459e (0xe610 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 6715 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn zero_range to largest ever: 0x427d1c truncating to largest ever: 0x566c9f truncating to largest ever: 0x66bf1d fallocating to largest ever: 0x812c8f fallocating to largest ever: 0x9ffc77 000100[0] 1755096716.534483 read 0x676000 thru 0x68374b (0xd74c bytes) 000300[1] 1755096717.888366 fallocate 0x9085f7 thru 0x9157c2 (0xd1cc bytes) 000400[1] 1755096718.515900 mapread 0x53a000 thru 0x542201 (0x8202 bytes) 000500[1] 1755096719.201747 read_OD 0x14b000 thru 0x14ffff (0x5000 bytes) 000700[0] 1755096720.836231 trunc from 0x15a847 to 0x68f4ba (0x534c74 bytes) 000800[0] 1755096721.495507 mapwrite 0x1d8000 thru 0x1e368c (0xb68d bytes) 000900[0] 1755096722.077740 write 0x5cf000 thru 0x5dcf08 (0xdf09 bytes) 001000[1] 1755096722.905638 trunc from 0x5ed6c7 to 0x5f5012 (0x794c bytes) 001100[1] 1755096723.535306 mapwrite 0x940000 thru 0x94430f (0x4310 bytes) 001200[1] 1755096724.228265 punch from 0x7749ac to 0x7805f4 (0xbc49 bytes) 001300[1] 1755096724.898296 mapwrite 0x633000 thru 0x635d2a (0x2d2b bytes) 001400[0] 1755096725.471737 fallocate 0x96dd45 thru 0x96f799 (0x1a55 bytes) 001500[1] 1755096726.057478 mapread 0x48e000 thru 0x4994b6 (0xb4b7 bytes) 001600[0] 1755096726.669736 trunc from 0x7e50a0 to 0x4870dc (0x35dfc3 bytes) 001700[0] 1755096727.298267 punch from 0x282ef4 to 0x2837b2 (0x8bf bytes) 001800[0] 1755096727.833005 write 0x273000 thru 0x279444 (0x6445 bytes) 001900[0] 1755096728.558128 mapwrite 0x026000 thru 0x030694 (0xa695 bytes) 002000[0] 1755096729.167226 punch from 0x5061f5 to 0x512190 (0xbf9c bytes) 002100[0] 1755096729.823494 mapread 0x204000 thru 0x20d7e8 (0x97e9 bytes) 002200[0] 1755096730.440464 mapwrite 0x826000 thru 0x835cb6 (0xfcb7 bytes) 002300[0] 1755096731.158544 write 0x764000 thru 0x768457 (0x4458 bytes) 002400[1] 1755096731.837358 trunc from 0x71bd24 to 0x5124b8 (0x20986b bytes) All operations completed A-OK! PASS 16a (43s) == sanityn test 16b: 2500 iterations of dual-mount fsx at small size ========================================================== 10:52:14 (1755096734) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.123721 s, 67.8 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.106741 s, 78.6 MB/s Chance of close/open is 1 in 50 Seed set to 6735 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn skipping zero size read zero_range to largest ever: 0x33696d truncating to largest ever: 0x422827 fallocating to largest ever: 0x4a0931 truncating to largest ever: 0x979079 fallocating to largest ever: 0x986c17 000200[1] 1755096736.958645 punch from 0x170101 to 0x170326 (0x226 bytes) fallocating to largest ever: 0x9ea637 000300[0] 1755096737.542206 fallocate 0x4bf3be thru 0x4bfa1d (0x660 bytes) 000400[1] 1755096738.164757 mapread 0x499791 thru 0x49b168 (0x19d8 bytes) 000500[0] 1755096738.968142 write 0x8c4bac thru 0x8c5023 (0x478 bytes) 000600[1] 1755096739.637384 fallocate 0x996855 thru 0x9986e5 (0x1e91 bytes) 000700[1] 1755096740.300827 fallocate 0x5b1b1e thru 0x5b2473 (0x956 bytes) 000900[1] 1755096741.734236 trunc from 0x5dbad5 to 0x3a79bf (0x234115 bytes) 001000[1] 1755096742.347280 write 0x455482 thru 0x456d4c (0x18cb bytes) 001100[1] 1755096742.984409 fallocate 0x25b494 thru 0x25b53d (0xaa bytes) 001200[1] 1755096743.663860 write 0x1a4cb2 thru 0x1a5b8f (0xede bytes) 001300[0] 1755096744.369490 punch from 0x777b9d to 0x778387 (0x7eb bytes) truncating to largest ever: 0x9f90fc 001400[1] 1755096744.915733 mapread 0x2f5051 thru 0x2f53b7 (0x367 bytes) 001500[1] 1755096745.587938 trunc from 0x85f8d4 to 0x8601ce (0x8fb bytes) 001700[1] 1755096746.832053 trunc from 0x079cb1 to 0x8100b0 (0x796400 bytes) 001900[0] 1755096748.121844 trunc from 0x0c8dcf to 0x0cad1a (0x1f4c bytes) 002000[1] 1755096748.859578 punch from 0x25b8e2 to 0x25d892 (0x1fb1 bytes) 002100[0] 1755096749.554115 fallocate 0x55a988 thru 0x55c21f (0x1898 bytes) 002200[0] 1755096750.231962 fallocate 0x347936 thru 0x3493ba (0x1a85 bytes) 002400[0] 1755096751.617888 fallocate 0x98eb40 thru 0x98fd3f (0x1200 bytes) 002500[0] 1755096752.294180 fallocate 0x38d2e8 thru 0x38e84a (0x1563 bytes) All operations completed A-OK! PASS 16b (19s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 10:52:33 (1755096753) keep default fallocate mode: 0 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.109548 s, 76.6 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0956357 s, 87.7 MB/s Waiting for MDT destroys to complete Chance of close/open is 1 in 50 Seed set to 6766 fd 0: /mnt/lustre/f16c.sanityn fd 1: /mnt/lustre2/f16c.sanityn skipping zero length punch hole fallocating to largest ever: 0x44002e truncating to largest ever: 0x871774 truncating to largest ever: 0x8979a0 truncating to largest ever: 0x8f21df truncating to largest ever: 0x9361d5 000100[0] 1755096767.838333 mapread 0x7635ac thru 0x7710ed (0xdb42 bytes) truncating to largest ever: 0x95ec19 truncating to largest ever: 0x9f1b0d 000200[1] 1755096768.594837 punch from 0x8abf11 to 0x8b8764 (0xc854 bytes) 000300[1] 1755096769.253883 fallocate 0x01acb9 thru 0x0279d0 (0xcd18 bytes) 000400[1] 1755096769.880925 write 0x1c42ee thru 0x1cbc3a (0x794d bytes) 000500[0] 1755096770.657972 fallocate 0x8cc5c2 thru 0x8d1a66 (0x54a5 bytes) 000600[0] 1755096771.371261 trunc from 0x9d2821 to 0x41f287 (0x5b3599 bytes) 000700[0] 1755096772.109472 punch from 0x58d4d0 to 0x590f83 (0x3ab4 bytes) 000800[1] 1755096772.750591 punch from 0x19445a to 0x194ab1 (0x658 bytes) 000900[0] 1755096773.368274 fallocate 0x358895 thru 0x3588bb (0x27 bytes) 001100[1] 1755096774.884525 write 0x5c0657 thru 0x5c4724 (0x40ce bytes) 001300[0] 1755096776.392872 write 0x1e6625 thru 0x1f478a (0xe166 bytes) 001400[0] 1755096777.263039 trunc from 0x8a6b22 to 0x535535 (0x3715ec bytes) fallocating to largest ever: 0x9fcf0b 001500[1] 1755096777.968009 trunc from 0x5e8252 to 0x291bd4 (0x35667d bytes) 001700[0] 1755096779.558078 fallocate 0x583739 thru 0x58706c (0x3934 bytes) 001800[0] 1755096780.453042 mapread 0x5c480f thru 0x5caee6 (0x66d8 bytes) 001900[0] 1755096781.230657 write 0x2840b9 thru 0x28845e (0x43a6 bytes) 002000[0] 1755096782.022954 punch from 0x0eac67 to 0x0f674f (0xbae9 bytes) 002500[1] 1755096785.909475 punch from 0x039c97 to 0x046e93 (0xd1fd bytes) All operations completed A-OK! PASS 16c (35s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 10:53:08 (1755096788) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.103464 s, 81.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.11074 s, 75.8 MB/s ldlm.namespaces.MGC192.168.203.149@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff972203e77800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff972204234800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff972203e77800.lru_size=clear ldlm.namespaces.lustre-MDT0001-mdc-ffff972204234800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff972203e77800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff972204234800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff972203e77800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff972204234800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 1.90148 s, 55.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 0.651688 s, 161 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 0.8595 s, 122 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 1.52344 s, 68.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 0.877512 s, 119 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 1.13519 s, 92.4 MB/s PASS 16d (10s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 10:53:18 (1755096798) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.126026 s, 83.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950885 s, 110 MB/s PASS 16e (3s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 10:53:21 (1755096801) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 10:53:43 (1755096823) TIMEOUT PASS 16g (22s) == sanityn test 16h: mmap read after truncate file ======= 10:54:05 (1755096845) striped dir -i0 -c2 -H crush /mnt/lustre/d16h.sanityn ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16h (2s) == sanityn test 16i: read after truncate file ============ 10:54:07 (1755096847) striped dir -i0 -c2 -H crush /mnt/lustre/d16i.sanityn ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (3s) == sanityn test 16j: race dio with buffered i/o ========== 10:54:10 (1755096850) 1+0 records in 1+0 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.428893 s, 61.1 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.331422 s, 79.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.357037 s, 73.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.250555 s, 105 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.26971 s, 97.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.252417 s, 104 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.333766 s, 78.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.342166 s, 76.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.378769 s, 69.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.744686 s, 35.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.758454 s, 34.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.352801 s, 74.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.392584 s, 66.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.716246 s, 36.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.730028 s, 35.9 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.382163 s, 68.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.410176 s, 63.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.689549 s, 38.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB, 25 MiB) copied, 0.703085 s, 37.3 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (8s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 10:54:18 (1755096858) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db fallocating to largest ever: 0x3428364 skipping zero size read fallocating to largest ever: 0x3428364 skipping zero size read truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3ddbbf6 fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee fallocating to largest ever: 0x3fa9cee truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 truncating to largest ever: 0x3fb80f5 All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Wed Aug 13 10:54:25 EDT 2025 + fsx 2 done: rc=0 Wed Aug 13 10:54:25 EDT 2025 All operations completed A-OK! + fsx 3 done: rc=0 Wed Aug 13 10:54:25 EDT 2025 All operations completed A-OK! All operations completed A-OK! + fsx 4 done: rc=0 Wed Aug 13 10:54:25 EDT 2025 + fsx 5 done: rc=0 Wed Aug 13 10:54:25 EDT 2025 PASS 16k (10s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 10:54:28 (1755096868) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 10:54:32 (1755096872) mmap test1: basic mmap operation (PASS, 0.027464s) mmap test2: MAP_PRIVATE not write back (PASS, 0.016712s) mmap test3: concurrent mmap ops on two nodes (PASS, 2.4302s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.0911s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.030975s) mmap test6: check mmap write/read content on two nodes (PASS, 0.04136s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.41668s) mmap test11: multi-thread shared mmap (PASS, 0.39749s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0166s) PASS 18 (12s) == sanityn test 19: test concurrent uncached read races ========================================================================= 10:54:44 (1755096884) 32+0 records in 32+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.154956 s, 108 MB/s loop 5 loop 10 loop 15 loop 20 PASS 19 (10s) == sanityn test 20: test extra readahead page left in cache ============================================================== 10:54:54 (1755096894) striped dir -i0 -c2 -H crush /mnt/lustre/d20.sanityn PASS 20 (2s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 10:54:56 (1755096896) striped dir -i1 -c2 -H all_char /mnt/lustre/d21.sanityn rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 10:54:58 (1755096898) now is 1755096898 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 new atime is 1755096959 PASS 23 (63s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 10:56:01 (1755096961) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2056 1285632 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1852 1285836 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 31588 3575432 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 7920 3599100 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 39508 7174532 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2056 1285632 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1414116 1852 1285836 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 3833116 31588 3575432 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3833116 7920 3599100 1% /mnt/lustre2[OST:1] filesystem_summary: 7666232 39508 7174532 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 352 999.7K 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1000.0K 277 999.7K 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 256.0K 404 255.6K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 256.0K 401 255.6K 1% /mnt/lustre[OST:1] filesystem_summary: 511.8K 629 511.2K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 352 999.7K 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1000.0K 277 999.7K 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 256.0K 404 255.6K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 256.0K 401 255.6K 1% /mnt/lustre2[OST:1] filesystem_summary: 511.8K 629 511.2K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 1.3G 2.0M 1.2G 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1.3G 1.8M 1.2G 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3.7G 30.8M 3.4G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.7G 7.7M 3.4G 1% /mnt/lustre[OST:1] filesystem_summary: 7.3G 38.6M 6.8G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 352 1023648 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1024000 277 1023723 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 262144 404 261740 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 262144 401 261743 1% /mnt/lustre2[OST:1] filesystem_summary: 524112 629 523483 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2056 1285632 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1852 1285836 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 31588 3575432 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 7920 3599100 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 39508 7174532 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 352 999.7K 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1000.0K 277 999.7K 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 256.0K 404 255.6K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 256.0K 401 255.6K 1% /mnt/lustre2[OST:1] filesystem_summary: 511.8K 629 511.2K 1% /mnt/lustre2 Reader error: 'No devices found' at 0 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 352 1023648 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 277 1023723 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 404 261740 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 401 261743 1% /mnt/lustre[OST:1] filesystem_summary: 524112 629 523483 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 352 1023648 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1024000 277 1023723 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 262144 404 261740 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 262144 401 261743 1% /mnt/lustre2[OST:1] filesystem_summary: 524112 629 523483 1% /mnt/lustre2 Reader error: 'No devices found' at 0 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2056 1285632 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1852 1285836 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 31588 3575432 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 7920 3599100 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 39508 7174532 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2056 1285632 1% /mnt/lustre2[MDT:0] lustre-MDT0001_UUID 1414116 1852 1285836 1% /mnt/lustre2[MDT:1] lustre-OST0000_UUID 3833116 31588 3575432 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3833116 7920 3599100 1% /mnt/lustre2[OST:1] filesystem_summary: 7666232 39508 7174532 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 10:56:04 (1755096964) PASS 24b (2s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 10:56:06 (1755096966) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (2s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 10:56:08 (1755096968) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] Can't lstat /mnt/lustre2/d25b.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] Can't lstat /mnt/lustre2/d25b.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25b.sanityn/f1] PASS 25b (2s) == sanityn test 26a: allow mtime to get older ============ 10:56:10 (1755096970) utime: good mknod times 1755096969 <= 1755096970 <= 1755096970 for /mnt/lustre/f26a utime: good mknod times 1755096969 <= 1755096970 <= 1755096970 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 10:56:13 (1755096973) PASS 26b (4s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 10:56:17 (1755096977) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 File: /mnt/lustre/f26c.sanityn Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205289279613 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-08-13 10:56:17.000000000 -0400 Birth: 2025-08-13 10:56:18.000000000 -0400 File: /mnt/lustre2/f26c.sanityn Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205289279613 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-08-13 10:56:17.000000000 -0400 Birth: 2025-08-13 10:56:18.000000000 -0400 PASS 26c (3s) SKIP: sanityn test_27 skipping excluded test 27 == sanityn test 30: recreate file race =================== 10:56:20 (1755096980) striped dir -i0 -c2 -H crush2 /mnt/lustre/d30.sanityn 0 PASS 30 (4s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 10:56:24 (1755096984) striped dir -i1 -c2 -H crush /mnt/lustre/d31a.sanityn fail_loc=0x314 PASS 31a (3s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 10:56:27 (1755096987) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg349-server mds-ost sync done. Waiting for MDT destroys to complete striped dir -i1 -c2 -H crush /mnt/lustre/d31b.sanityn fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.203.149@tcp:/lustre 7666232 39508 7173356 1% /mnt/lustre2 PASS 31b (10s) == sanityn test 31r: open-rename(replace) race =========== 10:56:37 (1755096997) -rw-r--r-- 1 root root 0 Aug 13 10:56 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (6s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 10:56:43 (1755097003) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1207: 47647 Terminated tail -f $tfile PASS 31s (2s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 10:56:45 (1755097005) PASS 31t (3s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 10:56:49 (1755097009) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 10:56:50 (1755097010) Stopping /mnt/lustre-mds1 (opts:) on oleg349-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg349-server: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Started lustre-MDT0000 create file on 2nd stripe under striped directory /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 2 /mnt/lustre/d33c.sanityn/striped touch /mnt/lustre2/d33c.sanityn/striped/subfile SoLC count 2 Below operations shouldn't trigger Solc: create file on 2nd stripe after setattr chmod 777 /mnt/lustre/d33c.sanityn/striped; touch /mnt/lustre2/d33c.sanityn/striped/subfile create remote dir and local dir /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33c.sanityn/remote create local dir after remote dir creation transaction commit /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33c.sanityn/remote.3; do_facet mds2 /home/green/git/lustre-release/lustre/utils/lctl set_param -n osd*.*MDT0001.force_sync 1; mkdir /mnt/lustre/d33c.sanityn/local.3 Solc count 0 PASS 33c (18s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 10:57:08 (1755097028) remote directory create /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre2/d33d.sanityn/subdir CoS count 2 cross-MDT rename mkdir /mnt/lustre/d33d.sanityn; /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn/d1; /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 1 /mnt/lustre/d33d.sanityn/d2; touch /mnt/lustre/d33d.sanityn/d1/src mv /mnt/lustre2/d33d.sanityn/d1/src /mnt/lustre2/d33d.sanityn/d2/tgt CoS count 3 migrate /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 /mnt/lustre/d33d.sanityn /home/green/git/lustre-release/lustre/utils/lfs migrate -m 1 /mnt/lustre2/d33d.sanityn CoS count 2 PASS 33d (15s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 10:57:23 (1755097043) plain dir creation mkdir /mnt/lustre2/d33e.sanityn/plain open file and write echo abc > /mnt/lustre2/d33e.sanityn/f33e.sanityn append write echo dfg >> /mnt/lustre2/d33e.sanityn/f33e.sanityn setattr touch /mnt/lustre2/d33e.sanityn/f33e.sanityn file unlink rm /mnt/lustre2/d33e.sanityn/f33e.sanityn plain dir unlink rmdir /mnt/lustre2/d33e.sanityn/plain striped directory creation /home/green/git/lustre-release/lustre/utils/lfs mkdir -i 0 -c 2 /mnt/lustre2/d33e.sanityn/striped set default LMV to create striped subdir /home/green/git/lustre-release/lustre/utils/lfs setdirstripe -D -c 2 /mnt/lustre/d33e.sanityn striped subdir creation createmany -d /mnt/lustre/d33e.sanityn/subdir 100 total: 100 mkdir in 0.32 seconds: 313.35 ops/second sub file creation and write createmany -o /mnt/lustre/d33e.sanityn/subfile 100; echo abc > /mnt/lustre/d33e.sanityn/subfile1 total: 100 open/close in 0.26 seconds: 377.93 ops/second sub file append write echo dfg >> /mnt/lustre2/d33e.sanityn/subfile2 subdir setatttr touch /mnt/lustre2/d33e.sanityn/subdir1 subdir unlink unlinkmany -d /mnt/lustre/d33e.sanityn/subdir 100 - unlinked 0 (time 1755097044 ; total 0 ; last 0) total: 100 unlinks in 2 seconds: 50.000000 unlinks/second sub file unlink unlinkmany /mnt/lustre2/d33e.sanityn/subfile 100 - unlinked 0 (time 1755097046 ; total 0 ; last 0) total: 100 unlinks in 0 seconds: inf unlinks/second sub file creation follows striped dir chmod chmod 777 /mnt/lustre/d33e.sanityn/striped; touch /mnt/lustre/d33e.sanityn/striped/subfile striped directory unlink rm -rf /mnt/lustre2/d33e.sanityn/striped directory unlink rm -rf /mnt/lustre2/d33e.sanityn CoS count 0 PASS 33e (5s) == sanityn test 34: no lock timeout under IO ============= 10:57:28 (1755097048) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg349-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff972203e77800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff972203e77800.ost_server_uuid in FULL state after 0 sec oleg349-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff972203e77800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff972203e77800.ost_server_uuid in IDLE state after 0 sec oleg349-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff972203e77800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff972203e77800.ost_server_uuid in FULL state after 0 sec oleg349-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff972203e77800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff972203e77800.ost_server_uuid in IDLE state after 0 sec oleg349-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff972203e77800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff972203e77800.ost_server_uuid in IDLE state after 0 sec oleg349-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff972203e77800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff972203e77800.ost_server_uuid in IDLE state after 0 sec PASS 34 (87s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 10:58:55 (1755097135) striped dir -i1 -c2 -H crush2 /mnt/lustre/d35.sanityn fail_loc=0x80000317 Race attempt 0 Wait for 57623 57753 for 60 sec... total: 4000 open/close in 7.80 seconds: 513.13 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.203.149@tcp:/lustre 7.4G 39M 6.9G 1% /mnt/lustre 192.168.203.149@tcp:/lustre 7.4G 39M 6.9G 1% /mnt/lustre2 PASS 35 (65s) == sanityn test 36: handle ESTALE/open-unlink correctly == 11:00:00 (1755097200) striped dir -i0 -c2 -H all_char /mnt/lustre/d36.sanityn Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0000-osc-MDT0001.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0001.old_sync_processed wait 40 secs maximumly for oleg349-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.366274 s, 143 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(0) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.502006 s, 104 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(1) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.484603 s, 108 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(2) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.461845 s, 114 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(3) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.40911 s, 128 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(4) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.451949 s, 116 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(5) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.458682 s, 114 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(6) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.453761 s, 116 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(7) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.492519 s, 106 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(8) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.429899 s, 122 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(9) *** before(7174472) after_dd(7123272) after(7174472) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.463569 s, 113 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 Waiting for MDT destroys to complete *** cycle(10) *** before(7174472) after_dd(7123272) after(7174472) PASS 36 (176s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 11:02:56 (1755097376) striped dir -i1 -c2 -H crush /mnt/lustre/d37.sanityn multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.8225 - create 8901 (time 1755097387.58 total 10.00 last 890.06) total: 10000 create in 11.24 seconds: 889.38 ops/second PASS 37 (14s) == sanityn test 39a: file mtime does not change after rename ========================================================== 11:03:11 (1755097391) repeat after cancel_lru_locks PASS 39a (2s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 11:03:13 (1755097393) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 11:03:16 (1755097396) repeat after cancel_lru_locks PASS 39c (4s) == sanityn test 39d: sync write should update mtime ====== 11:03:20 (1755097400) fail_loc=0x411 fail_loc=0 PASS 39d (2s) SKIP: sanityn test_40a skipping ALWAYS excluded test 40a == sanityn test 40b: pdirops: open|create and others ======================================================================== 11:03:23 (1755097403) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (9s) == sanityn test 40c: pdirops: link and others ======================================================================== 11:03:32 (1755097412) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=7 No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (8s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 11:03:40 (1755097420) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=1 No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (9s) == sanityn test 40e: pdirops: rename and others ======================================================================== 11:03:49 (1755097429) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (8s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 11:03:57 (1755097437) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=9 mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (5s) == sanityn test 41b: pdirops: create vs create ======================================================================== 11:04:02 (1755097442) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 open: File exists Conflict PASS 41b (6s) == sanityn test 41c: pdirops: create vs link ======================================================================== 11:04:08 (1755097448) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (6s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 11:04:14 (1755097454) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 Conflict PASS 41d (5s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 11:04:19 (1755097459) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=2 Conflict PASS 41e (5s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 11:04:24 (1755097464) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=5 Conflict PASS 41f (5s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 11:04:29 (1755097469) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=5 Conflict PASS 41g (6s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 11:04:35 (1755097475) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=2 Conflict PASS 41h (5s) == sanityn test 41i: reint_open: create vs create ======== 11:04:40 (1755097480) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (724s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 11:16:44 (1755098204) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (6s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 11:16:50 (1755098210) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=4 open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 11:16:55 (1755098215) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=2 ldlm.namespaces.mdt-lustre-MDT0001_UUID.lock_count=1 link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (6s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 11:17:01 (1755098221) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 Conflict PASS 42d (5s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 11:17:06 (1755098226) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=2 mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (6s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 11:17:12 (1755098232) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=7 Conflict PASS 42f (5s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 11:17:17 (1755098237) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=4 Conflict PASS 42g (5s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 11:17:22 (1755098242) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 Conflict PASS 42h (6s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 11:17:28 (1755098248) PASS 43a (23s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 11:17:51 (1755098271) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=4 ldlm.namespaces.mdt-lustre-MDT0001_UUID.lock_count=60 Conflict PASS 43b (5s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 11:17:56 (1755098276) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=2 Conflict PASS 43c (5s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 11:18:01 (1755098281) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=2 rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (6s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 11:18:07 (1755098287) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=1 Conflict PASS 43e (5s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 11:18:12 (1755098292) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=1 mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (6s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 11:18:18 (1755098298) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=1 stat: cannot statx '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (5s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 11:18:23 (1755098303) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=4 Conflict PASS 43h (6s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 11:18:29 (1755098309) ldlm.namespaces.mdt-lustre-MDT0000_UUID.lock_count=3 Conflict PASS 43i (5s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 11:18:34 (1755098314) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (47s) == sanityn test 43k: unlink vs create ==================== 11:19:21 (1755098361) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **