-----============= acceptance-small: sanity-dom ============----- Mon Dec 9 23:33:50 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg330-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-dom.*ex: No such file or directory excepting tests: === sanity-dom: start setup 23:33:59 (1733805239) === Starting client oleg330-client.virtnet: -o user_xattr,flock 192.168.203.130@tcp:/lustre /mnt/lustre2 Started clients oleg330-client.virtnet: 192.168.203.130@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg330-client.virtnet: executing check_config_client /mnt/lustre oleg330-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg330-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012ab25800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012ea7d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012ab25800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012ea7d800.idle_timeout=debug disable quota as required oleg330-server: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 23:34:13 (1733805253) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7029] 192.168.203.130@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 == sanity-dom test 1: write a file on one mount, truncate on the other, write again ========================================================== 23:34:14 (1733805254) 1+0 records in 1+0 records out 7168 bytes (7.2 kB) copied, 0.0029106 s, 2.5 MB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00545003 s, 564 kB/s /mnt/lustre2/f1.sanity-dom has type file OK /mnt/lustre2/f1.sanity-dom has size 6144 OK PASS 1 (3s) == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 23:34:17 (1733805257) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358775 s, 29.2 MB/s 1+0 records in 1+0 records out 234852 bytes (235 kB) copied, 0.00212856 s, 110 MB/s 0+1 records in 0+1 records out 234852 bytes (235 kB) copied, 0.0284135 s, 8.3 MB/s /mnt/lustre/f2.sanity-dom_left has type file OK /mnt/lustre/f2.sanity-dom_left has size 234852 OK PASS 2 (4s) == sanity-dom test 3: Truncate over DoM size on different nodes ========================================================== 23:34:21 (1733805261) 1+0 records in 1+0 records out 1048476 bytes (1.0 MB) copied, 0.0221071 s, 47.4 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0352598 s, 116 kB/s /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049276 OK /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049076 OK /mnt/lustre/f3.sanity-dom has type file OK /mnt/lustre/f3.sanity-dom has size 1049076 OK PASS 3 (3s) == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 23:34:24 (1733805264) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0635395 s, 33.0 MB/s fail_loc=0x80000808 PASS 4 (5s) == sanity-dom test 5: DoM truncate deadlock ============== 23:34:29 (1733805269) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00777703 s, 527 kB/s multiop /mnt/lustre/f5.sanity-dom vO_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7029 multiop /mnt/lustre/f5.sanity-dom vO_Tc TMPPIPE=/tmp/multiop_open_wait_pipe.7029 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f5.sanity-dom user.job="dd.0" fail_loc=0x80001415 fail_val=5 PASS 5 (5s) == sanity-dom test 6: Race two writes, check file size === 23:34:34 (1733805274) /mnt/lustre2/f6.sanity-dom has size 500 OK PASS 6 (4s) == sanity-dom test 7: Stale pages after read-on-open ===== 23:34:38 (1733805278) 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00612597 s, 163 kB/s 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00341283 s, 293 kB/s PASS 7 (3s) == sanity-dom test fsx: Dual-mount fsx with DoM files ==== 23:34:41 (1733805281) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 5281 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[1] 1733805282.227165 write 0x1f0d1c thru 0x1ff0de (0xe3c3 bytes) 1733805282.235142 write done 000002[0] 1733805282.248381 mapwrite 0x074c26 thru 0x07e46a (0x9845 bytes) 1733805282.253751 mmap done 1733805282.429155 msync done 1733805282.435090 munmap done 000004[0] 1733805282.484451 write 0x0f383c thru 0x100985 (0xd14a bytes) 1733805282.525948 write done 000011[0] 1733805282.607309 write 0x0ea56d thru 0x0f3143 (0x8bd7 bytes) 1733805282.614959 write done 000013[0] 1733805282.638264 mapwrite 0x1f677b thru 0x1fffff (0x9885 bytes) 1733805282.648319 truncate done 1733805282.648738 mmap done 1733805282.713262 msync done 1733805282.714266 munmap done truncating to largest ever: 0xa2140 000014[1] 1733805282.728699 trunc from 0x200000 to 0x0a213f (0x15dec0 bytes) 1733805282.757360 truncate done 000016[1] 1733805282.792539 mapwrite 0x1ed305 thru 0x1fa62a (0xd326 bytes) 1733805282.801549 truncate done 1733805282.802341 mmap done 1733805282.887192 msync done 1733805282.887500 munmap done 000017[0] 1733805282.889918 read 0x1d89f7 thru 0x1e5e35 (0xd43f bytes) 1733805282.911727 read done truncating to largest ever: 0x140fe3 000018[0] 1733805282.914779 trunc from 0x1fa62b to 0x140fe2 (0xb9648 bytes) 1733805282.936970 truncate done 000021[0] 1733805282.981813 mapread 0x033053 thru 0x03eaf8 (0xbaa6 bytes) 1733805282.982411 mmap done 1733805283.018809 memcpy done 1733805283.019286 munmap done 000024[0] 1733805283.063698 write 0x08681f thru 0x0931a7 (0xc989 bytes) 1733805283.072499 write done truncating to largest ever: 0x182941 000026[1] 1733805283.087686 trunc from 0x140fe3 to 0x182940 (0x4195e bytes) 1733805283.119677 truncate done 000030[1] 1733805283.154946 mapread 0x148872 thru 0x154412 (0xbba1 bytes) 1733805283.155113 mmap done 1733805283.166181 memcpy done 1733805283.166359 munmap done 000032[0] 1733805283.180161 read 0x04dff8 thru 0x04fcf1 (0x1cfa bytes) 1733805283.206432 read done 000035[1] 1733805283.234075 read 0x103fcb thru 0x10df42 (0x9f78 bytes) 1733805283.242265 read done 000036[1] 1733805283.244744 read 0x14d148 thru 0x153f26 (0x6ddf bytes) 1733805283.244843 read done 000039 1733805283.245610 [0]close/open 1733805283.247467 close done 1733805283.254194 open done 000040[1] 1733805283.254568 mapread 0x099687 thru 0x09fb63 (0x64dd bytes) 1733805283.254747 mmap done 1733805283.278322 memcpy done 1733805283.280940 munmap done 000043[1] 1733805283.292532 mapread 0x028042 thru 0x02e001 (0x5fc0 bytes) 1733805283.293001 mmap done 1733805283.293068 memcpy done 1733805283.293125 munmap done 000044[0] 1733805283.293389 write 0x074cfb thru 0x075baa (0xeb0 bytes) 1733805283.312513 write done 000047[0] 1733805283.335182 trunc from 0x182941 to 0x028b7a (0x159dc6 bytes) 1733805283.356367 truncate done 000049[1] 1733805283.359830 mapread 0x0196c6 thru 0x0210d1 (0x7a0c bytes) 1733805283.365909 mmap done 1733805283.403214 memcpy done 1733805283.403398 munmap done 000051[0] 1733805283.423087 trunc from 0x028b7b to 0x0dc5ea (0xb3a70 bytes) 1733805283.441695 truncate done 000052[1] 1733805283.456480 write 0x125f5b thru 0x12c0d7 (0x617d bytes) 1733805283.464541 write done 000054[0] 1733805283.485452 read 0x011311 thru 0x01a48c (0x917c bytes) 1733805283.490412 read done 000055[1] 1733805283.498279 trunc from 0x12c0d8 to 0x12e362 (0x228b bytes) 1733805283.510718 truncate done 000057[0] 1733805283.532839 read 0x05e70f thru 0x0646a7 (0x5f99 bytes) 1733805283.564276 read done 000059[0] 1733805283.577104 trunc from 0x12e363 to 0x049ea0 (0xe44c2 bytes) 1733805283.613960 truncate done 000066[1] 1733805283.668310 trunc from 0x049ea1 to 0x00b0cd (0x3edd3 bytes) 1733805283.690611 truncate done 000068[0] 1733805283.708119 read 0x009333 thru 0x00b0cd (0x1d9b bytes) 1733805283.719686 read done 000070[1] 1733805283.734837 mapwrite 0x01566b thru 0x02069e (0xb034 bytes) 1733805283.760694 truncate done 1733805283.760869 mmap done 1733805283.854699 msync done 1733805283.854793 munmap done 000072[0] 1733805283.869998 read 0x012be5 thru 0x017527 (0x4943 bytes) 1733805283.890138 read done 000074[0] 1733805283.899843 write 0x09814d thru 0x09d6af (0x5563 bytes) 1733805283.912859 write done 000075[1] 1733805283.922357 mapread 0x07f78b thru 0x086f95 (0x780b bytes) 1733805283.928606 mmap done 1733805283.965114 memcpy done 1733805283.965371 munmap done 000079[0] 1733805283.990105 mapread 0x05aa02 thru 0x05ab2e (0x12d bytes) 1733805283.994675 mmap done 1733805284.006347 memcpy done 1733805284.006947 munmap done 000086[0] 1733805284.027897 mapwrite 0x12aed0 thru 0x12ce73 (0x1fa4 bytes) 1733805284.063446 truncate done 1733805284.063648 mmap done 1733805284.151446 msync done 1733805284.151853 munmap done 000089[1] 1733805284.193727 read 0x0b1040 thru 0x0b3f72 (0x2f33 bytes) 1733805284.238903 read done 000090[1] 1733805284.247621 mapread 0x0a095b thru 0x0af58f (0xec35 bytes) 1733805284.251882 mmap done 1733805284.389678 memcpy done 1733805284.390542 munmap done 000093[1] 1733805284.412648 read 0x09f705 thru 0x0ac7bb (0xd0b7 bytes) 1733805284.424513 read done 000094[1] 1733805284.433523 write 0x1baed3 thru 0x1c06da (0x5808 bytes) 1733805284.443271 write done 000099[1] 1733805284.445300 mapwrite 0x1dd821 thru 0x1ea7d0 (0xcfb0 bytes) 1733805284.473676 truncate done 1733805284.473954 mmap done 1733805284.540312 msync done 1733805284.540476 munmap done 000100[1] 1733805284.543307 mapwrite 0x07cf34 thru 0x07ecde (0x1dab bytes) 1733805284.543704 mmap done 1733805284.583348 msync done 1733805284.583438 munmap done 000101[1] 1733805284.583801 write 0x08b1ab thru 0x093ebd (0x8d13 bytes) 1733805284.591942 write done 000102[0] 1733805284.608816 read 0x111736 thru 0x1156bf (0x3f8a bytes) 1733805284.645594 read done 000103[0] 1733805284.662325 trunc from 0x1ea7d1 to 0x0d2a57 (0x117d79 bytes) 1733805284.693174 truncate done 000105[0] 1733805284.720530 read 0x01c2ba thru 0x02ac38 (0xe97f bytes) 1733805284.738547 read done 000106[0] 1733805284.742686 trunc from 0x0d2a58 to 0x0cf46c (0x35eb bytes) 1733805284.756765 truncate done 000113[0] 1733805284.864447 read 0x0c25dd thru 0x0cd585 (0xafa9 bytes) 1733805284.864637 read done 000116[0] 1733805284.878615 trunc from 0x0cf46d to 0x1139b3 (0x44547 bytes) 1733805284.886210 truncate done 000117[0] 1733805284.890919 mapread 0x01951f thru 0x0215df (0x80c1 bytes) 1733805284.892532 mmap done 1733805284.892673 memcpy done 1733805284.892798 munmap done 000121[0] 1733805284.928407 write 0x1003f5 thru 0x10db18 (0xd724 bytes) 1733805284.935214 write done 000123[0] 1733805284.935905 trunc from 0x1139b4 to 0x160f81 (0x4d5ce bytes) 1733805284.954172 truncate done 000124[1] 1733805284.970215 mapwrite 0x1816f1 thru 0x184517 (0x2e27 bytes) 1733805284.990405 truncate done 1733805284.990708 mmap done 1733805285.066093 msync done 1733805285.066470 munmap done 000126[1] 1733805285.078985 write 0x0f66a4 thru 0x105327 (0xec84 bytes) 1733805285.085848 write done 000130[1] 1733805285.112406 mapwrite 0x1ebabe thru 0x1f44e0 (0x8a23 bytes) 1733805285.119906 truncate done 1733805285.120080 mmap done 1733805285.173096 msync done 1733805285.173157 munmap done 000131[0] 1733805285.175896 trunc from 0x1f44e1 to 0x17540c (0x7f0d4 bytes) 1733805285.212988 truncate done 000132[1] 1733805285.216082 read 0x129009 thru 0x137988 (0xe980 bytes) 1733805285.277087 read done 000133[1] 1733805285.280296 write 0x03c615 thru 0x042ecd (0x68b9 bytes) 1733805285.315054 write done 000134[0] 1733805285.327929 mapread 0x0c9328 thru 0x0d0478 (0x7151 bytes) 1733805285.333509 mmap done 1733805285.373891 memcpy done 1733805285.374148 munmap done 000137[1] 1733805285.380952 mapread 0x0363af thru 0x044f01 (0xeb53 bytes) 1733805285.381125 mmap done 1733805285.422013 memcpy done 1733805285.422324 munmap done 000139[1] 1733805285.423095 mapread 0x0e4e3c thru 0x0ed875 (0x8a3a bytes) 1733805285.423431 mmap done 1733805285.456429 memcpy done 1733805285.458380 munmap done 000140[0] 1733805285.459609 trunc from 0x17540d to 0x06ba1b (0x1099f1 bytes) 1733805285.483954 truncate done 000141[1] 1733805285.486186 mapwrite 0x1496bd thru 0x15866d (0xefb1 bytes) 1733805285.517351 truncate done 1733805285.517548 mmap done 1733805285.638408 msync done 1733805285.638676 munmap done 000142[1] 1733805285.652028 mapwrite 0x0c79de thru 0x0cdc23 (0x6246 bytes) 1733805285.652283 mmap done 1733805285.711334 msync done 1733805285.711404 munmap done 000145[1] 1733805285.723838 mapread 0x0cc34e thru 0x0d2d60 (0x6a13 bytes) 1733805285.724017 mmap done 1733805285.746910 memcpy done 1733805285.747016 munmap done 000146[0] 1733805285.767750 mapwrite 0x10824c thru 0x1106db (0x8490 bytes) 1733805285.776130 mmap done 1733805285.857252 msync done 1733805285.857766 munmap done 000149[1] 1733805285.887833 mapread 0x089feb thru 0x095753 (0xb769 bytes) 1733805285.892024 mmap done 1733805285.928327 memcpy done 1733805285.928564 munmap done 000150[1] 1733805285.937933 write 0x09c9ef thru 0x0a977f (0xcd91 bytes) 1733805285.944211 write done 000152[1] 1733805285.965921 mapwrite 0x18770b thru 0x18f2f0 (0x7be6 bytes) 1733805285.986632 truncate done 1733805285.986821 mmap done 1733805286.035463 msync done 1733805286.035542 munmap done 000154[0] 1733805286.052957 mapread 0x0a3db8 thru 0x0b2b71 (0xedba bytes) 1733805286.058843 mmap done 1733805286.141407 memcpy done 1733805286.142909 munmap done 000155[0] 1733805286.153424 mapwrite 0x0883a8 thru 0x0976ed (0xf346 bytes) 1733805286.159945 mmap done 1733805286.251544 msync done 1733805286.251632 munmap done 000157[0] 1733805286.280556 mapread 0x04c6f2 thru 0x04ffbb (0x38ca bytes) 1733805286.288817 mmap done 1733805286.302289 memcpy done 1733805286.302342 munmap done 000162[1] 1733805286.355531 read 0x06d287 thru 0x07d189 (0xff03 bytes) 1733805286.394430 read done 000164[0] 1733805286.405029 write 0x1f9c28 thru 0x1ff096 (0x546f bytes) 1733805286.417791 write done 000167[1] 1733805286.469065 trunc from 0x1ff097 to 0x0460f3 (0x1b8fa3 bytes) 1733805286.492000 truncate done 000168[0] 1733805286.502843 mapread 0x0017e5 thru 0x00de3b (0xc657 bytes) 1733805286.507491 mmap done 1733805286.567653 memcpy done 1733805286.567810 munmap done 000170[0] 1733805286.585117 mapwrite 0x0d26e0 thru 0x0d4f2a (0x284b bytes) 1733805286.603080 truncate done 1733805286.603243 mmap done 1733805286.647937 msync done 1733805286.648133 munmap done 000174[1] 1733805286.679153 write 0x10c460 thru 0x10d0a1 (0xc42 bytes) 1733805286.687839 write done 000175[1] 1733805286.697798 write 0x0cf6fd thru 0x0d3cd7 (0x45db bytes) 1733805286.709046 write done 000179[1] 1733805286.742515 mapwrite 0x1fc278 thru 0x1fd830 (0x15b9 bytes) 1733805286.753902 truncate done 1733805286.754085 mmap done 1733805286.812238 msync done 1733805286.812383 munmap done 000180[0] 1733805286.829439 write 0x1557a8 thru 0x162f5d (0xd7b6 bytes) 1733805286.853909 write done 000186[1] 1733805286.935374 read 0x009663 thru 0x010755 (0x70f3 bytes) 1733805286.951896 read done 000187[0] 1733805286.960935 mapread 0x187c7a thru 0x18f743 (0x7aca bytes) 1733805286.965692 mmap done 1733805286.965797 memcpy done 1733805286.966128 munmap done 000188[1] 1733805286.975316 write 0x0b7a55 thru 0x0c53ee (0xd99a bytes) 1733805286.976396 write done 000190[1] 1733805287.000943 write 0x1b2d4f thru 0x1bea3f (0xbcf1 bytes) 1733805287.040218 write done 000191[1] 1733805287.040529 mapwrite 0x1e5b21 thru 0x1f3cb1 (0xe191 bytes) 1733805287.040817 mmap done 1733805287.083820 msync done 1733805287.084011 munmap done 000192[1] 1733805287.099155 mapread 0x15723a thru 0x1598ab (0x2672 bytes) 1733805287.099756 mmap done 1733805287.099809 memcpy done 1733805287.099830 munmap done truncating to largest ever: 0x18658d 000195[0] 1733805287.108457 trunc from 0x1fd831 to 0x18658c (0x772a4 bytes) 1733805287.133124 truncate done 000196[0] 1733805287.135488 mapread 0x0576b6 thru 0x0593c6 (0x1d11 bytes) 1733805287.135863 mmap done 1733805287.142938 memcpy done 1733805287.143437 munmap done 000202[0] 1733805287.173265 mapwrite 0x0d24a4 thru 0x0d3073 (0xbd0 bytes) 1733805287.173593 mmap done 1733805287.221843 msync done 1733805287.222010 munmap done 000203[0] 1733805287.234162 write 0x02055d thru 0x02e713 (0xe1b7 bytes) 1733805287.241423 write done 000204[1] 1733805287.253462 read 0x1088b5 thru 0x110ec2 (0x860e bytes) 1733805287.293368 read done 000205[0] 1733805287.295691 write 0x1adc5c thru 0x1b9b2d (0xbed2 bytes) 1733805287.301961 write done 000206[0] 1733805287.302348 read 0x0f0ecd thru 0x0fdd48 (0xce7c bytes) 1733805287.334867 read done 000209[1] 1733805287.355939 write 0x1f1f2d thru 0x1f43cf (0x24a3 bytes) 1733805287.375785 write done 000212[0] 1733805287.408865 trunc from 0x1f43d0 to 0x0c6dc9 (0x12d606 bytes) 1733805287.427190 truncate done 000213[0] 1733805287.442193 trunc from 0x0c6dca to 0x0a1462 (0x25967 bytes) 1733805287.448441 truncate done 000214[1] 1733805287.451284 trunc from 0x0a1463 to 0x16ac6a (0xc9808 bytes) 1733805287.485764 truncate done 000216[1] 1733805287.506158 read 0x095ac3 thru 0x099202 (0x3740 bytes) 1733805287.528144 read done 000217[0] 1733805287.528469 mapwrite 0x1890ce thru 0x197a11 (0xe944 bytes) 1733805287.552414 truncate done 1733805287.552647 mmap done 1733805287.660889 msync done 1733805287.661270 munmap done 000218[1] 1733805287.674522 trunc from 0x197a12 to 0x00b6ae (0x18c363 bytes) 1733805287.688426 truncate done 000219[1] 1733805287.691164 mapwrite 0x19fa0e thru 0x1a12c3 (0x18b6 bytes) 1733805287.699243 truncate done 1733805287.699426 mmap done 1733805287.771895 msync done 1733805287.772116 munmap done 000222[1] 1733805287.798807 read 0x18c5a9 thru 0x18cd11 (0x769 bytes) 1733805287.799202 read done 000224[0] 1733805287.813950 write 0x177bc4 thru 0x17b1d5 (0x3612 bytes) 1733805287.830465 write done 000226[1] 1733805287.855958 mapwrite 0x06a3d9 thru 0x06bef1 (0x1b19 bytes) 1733805287.861337 mmap done 1733805287.932158 msync done 1733805287.932335 munmap done 000228[1] 1733805287.948982 mapread 0x0ebacd thru 0x0f090e (0x4e42 bytes) 1733805287.953762 mmap done 1733805288.003042 memcpy done 1733805288.003152 munmap done 000229[0] 1733805288.020562 mapread 0x171a4d thru 0x176065 (0x4619 bytes) 1733805288.030331 mmap done 1733805288.050783 memcpy done 1733805288.050841 munmap done 000233[1] 1733805288.086025 mapread 0x0d6ebb thru 0x0d8ebe (0x2004 bytes) 1733805288.089977 mmap done 1733805288.111101 memcpy done 1733805288.111159 munmap done 000234[1] 1733805288.121722 read 0x087b52 thru 0x08c105 (0x45b4 bytes) 1733805288.140496 read done 000235[0] 1733805288.161489 write 0x1d4d62 thru 0x1d65f4 (0x1893 bytes) 1733805288.162066 write done 000237[0] 1733805288.188604 read 0x174424 thru 0x17c5bd (0x819a bytes) 1733805288.193254 read done 000239[1] 1733805288.214375 mapwrite 0x171d22 thru 0x17c6c6 (0xa9a5 bytes) 1733805288.226144 mmap done 1733805288.295144 msync done 1733805288.295265 munmap done 000240[1] 1733805288.312372 write 0x1b0b3b thru 0x1b32cd (0x2793 bytes) 1733805288.313745 write done 000241[0] 1733805288.337039 mapwrite 0x1f3f46 thru 0x1ff1e9 (0xb2a4 bytes) 1733805288.366728 truncate done 1733805288.367090 mmap done 1733805288.455703 msync done 1733805288.456860 munmap done 000242[0] 1733805288.472633 mapread 0x0512cb thru 0x058d17 (0x7a4d bytes) 1733805288.472844 mmap done 1733805288.472911 memcpy done 1733805288.473009 munmap done 000243[1] 1733805288.476058 read 0x0c2b2e thru 0x0c3faf (0x1482 bytes) 1733805288.504041 read done 000244[0] 1733805288.515195 mapread 0x1123af thru 0x119493 (0x70e5 bytes) 1733805288.518513 mmap done 1733805288.518640 memcpy done 1733805288.518970 munmap done 000246[1] 1733805288.520759 write 0x048e2d thru 0x052665 (0x9839 bytes) 1733805288.536985 write done 000250[0] 1733805288.581553 mapread 0x1bf495 thru 0x1cade6 (0xb952 bytes) 1733805288.586559 mmap done 1733805288.586685 memcpy done 1733805288.587377 munmap done 000252[1] 1733805288.605478 trunc from 0x1ff1ea to 0x0eaeae (0x11433b bytes) 1733805288.619308 truncate done 000253[1] 1733805288.621334 trunc from 0x0eaeaf to 0x0fbf80 (0x110d2 bytes) 1733805288.625687 truncate done 000255[1] 1733805288.642484 trunc from 0x0fbf81 to 0x0ce1de (0x2dda2 bytes) 1733805288.653717 truncate done 000257[0] 1733805288.675514 mapread 0x017437 thru 0x020ee6 (0x9ab0 bytes) 1733805288.686074 mmap done 1733805288.754211 memcpy done 1733805288.754415 munmap done 000258[0] 1733805288.763153 mapread 0x052a01 thru 0x05cef5 (0xa4f5 bytes) 1733805288.770521 mmap done 1733805288.805145 memcpy done 1733805288.805261 munmap done 000259[0] 1733805288.807868 read 0x0b34c1 thru 0x0ba0e3 (0x6c23 bytes) 1733805288.822247 read done 000261[0] 1733805288.832691 mapwrite 0x0c8909 thru 0x0cc938 (0x4030 bytes) 1733805288.838885 mmap done 1733805288.939746 msync done 1733805288.940024 munmap done 000262[1] 1733805288.954837 mapread 0x0a4f8e thru 0x0a6631 (0x16a4 bytes) 1733805288.962886 mmap done 1733805288.980417 memcpy done 1733805288.980472 munmap done 000264[1] 1733805288.999688 write 0x1fc038 thru 0x1fdde6 (0x1daf bytes) 1733805289.000355 write done 000265[0] 1733805289.015281 trunc from 0x1fdde7 to 0x0b16c6 (0x14c720 bytes) 1733805289.042342 truncate done 000266[1] 1733805289.067338 mapwrite 0x10af4f thru 0x10d59e (0x2650 bytes) 1733805289.086559 truncate done 1733805289.086773 mmap done 1733805289.154256 msync done 1733805289.154453 munmap done 000270[0] 1733805289.166847 mapwrite 0x15b92a thru 0x168d07 (0xd3de bytes) 1733805289.186306 truncate done 1733805289.187229 mmap done 1733805289.245322 msync done 1733805289.245414 munmap done 000271[0] 1733805289.248009 mapread 0x0f58f0 thru 0x0fd562 (0x7c73 bytes) 1733805289.248292 mmap done 1733805289.248381 memcpy done 1733805289.248410 munmap done 000272[1] 1733805289.248678 read 0x1590ce thru 0x160001 (0x6f34 bytes) 1733805289.289095 read done 000276[0] 1733805289.331966 mapread 0x15d094 thru 0x168d07 (0xbc74 bytes) 1733805289.332331 mmap done 1733805289.364488 memcpy done 1733805289.364669 munmap done 000278[1] 1733805289.371253 read 0x0c5789 thru 0x0cfb53 (0xa3cb bytes) 1733805289.400254 read done 000283[0] 1733805289.405785 mapwrite 0x108d0d thru 0x1104da (0x77ce bytes) 1733805289.406219 mmap done 1733805289.504048 msync done 1733805289.504207 munmap done 000286[1] 1733805289.524559 read 0x043dee thru 0x052f85 (0xf198 bytes) 1733805289.524718 read done 000288[0] 1733805289.536266 trunc from 0x168d08 to 0x017dcd (0x150f3a bytes) 1733805289.560883 truncate done 000289[0] 1733805289.565112 read 0x00a51d thru 0x0125d1 (0x80b5 bytes) 1733805289.573603 read done 000292[0] 1733805289.601619 write 0x1f41ff thru 0x1f461d (0x41f bytes) 1733805289.602264 write done 000295[1] 1733805289.619437 mapwrite 0x000418 thru 0x000845 (0x42e bytes) 1733805289.627783 mmap done 1733805289.678880 msync done 1733805289.679072 munmap done 000296[1] 1733805289.686862 write 0x0988aa thru 0x09f197 (0x68ee bytes) 1733805289.687502 write done 000297[1] 1733805289.700110 write 0x1d47a9 thru 0x1d81cc (0x3a24 bytes) 1733805289.735667 write done 000300[0] 1733805289.760957 read 0x087b66 thru 0x08aadf (0x2f7a bytes) 1733805289.790453 read done 000303[0] 1733805289.810923 mapwrite 0x026b87 thru 0x029931 (0x2dab bytes) 1733805289.815622 mmap done 1733805289.901864 msync done 1733805289.902146 munmap done 000304[0] 1733805289.916339 trunc from 0x1f461e to 0x0013bb (0x1f3262 bytes) 1733805289.937655 truncate done 000306[1] 1733805289.956988 mapwrite 0x1cc484 thru 0x1cf793 (0x3310 bytes) 1733805289.990115 truncate done 1733805289.990401 mmap done 1733805290.084245 msync done 1733805290.084873 munmap done 000307[0] 1733805290.099395 read 0x014e58 thru 0x022a49 (0xdbf2 bytes) 1733805290.181662 read done 000310[0] 1733805290.211567 mapread 0x18c363 thru 0x18f015 (0x2cb3 bytes) 1733805290.217869 mmap done 1733805290.266881 memcpy done 1733805290.267907 munmap done 000311[1] 1733805290.270174 mapread 0x16d3b4 thru 0x172bfa (0x5847 bytes) 1733805290.270368 mmap done 1733805290.285417 memcpy done 1733805290.285726 munmap done 000314[1] 1733805290.286819 mapwrite 0x163cf7 thru 0x170100 (0xc40a bytes) 1733805290.287076 mmap done 1733805290.385141 msync done 1733805290.387214 munmap done 000315[1] 1733805290.395933 write 0x0c30cf thru 0x0c423c (0x116e bytes) 1733805290.413055 write done 000317[0] 1733805290.424279 mapread 0x0a7e1c thru 0x0b211b (0xa300 bytes) 1733805290.428022 mmap done 1733805290.478410 memcpy done 1733805290.478787 munmap done 000319[1] 1733805290.497402 trunc from 0x1cf794 to 0x0b4532 (0x11b261 bytes) 1733805290.517707 truncate done 000320[0] 1733805290.522175 trunc from 0x0b4533 to 0x17053b (0xbc009 bytes) 1733805290.548953 truncate done 000322[0] 1733805290.575277 mapread 0x132ab1 thru 0x13a6fa (0x7c4a bytes) 1733805290.575474 mmap done 1733805290.603110 memcpy done 1733805290.603241 munmap done 000323[0] 1733805290.618440 mapwrite 0x070c03 thru 0x078019 (0x7417 bytes) 1733805290.618790 mmap done 1733805290.715508 msync done 1733805290.715792 munmap done 000325[1] 1733805290.740238 mapread 0x02bb73 thru 0x03ab0d (0xef9b bytes) 1733805290.747459 mmap done 1733805290.808339 memcpy done 1733805290.809356 munmap done 000327[0] 1733805290.829952 mapread 0x030cea thru 0x03d07d (0xc394 bytes) 1733805290.832551 mmap done 1733805290.886057 memcpy done 1733805290.886365 munmap done 000328[0] 1733805290.895823 read 0x1104b5 thru 0x116556 (0x60a2 bytes) 1733805290.919820 read done 000329[0] 1733805290.920137 read 0x0e6811 thru 0x0f0be6 (0xa3d6 bytes) 1733805290.925903 read done 000332[1] 1733805290.957973 read 0x10427b thru 0x10b94f (0x76d5 bytes) 1733805290.985778 read done 000333[0] 1733805290.992544 write 0x14607b thru 0x1544eb (0xe471 bytes) 1733805291.021344 write done 000334[0] 1733805291.022244 read 0x058d70 thru 0x067bd4 (0xee65 bytes) 1733805291.022354 read done 000336[1] 1733805291.031888 read 0x06c085 thru 0x06c637 (0x5b3 bytes) 1733805291.031984 read done 000337[1] 1733805291.032282 write 0x1ff4df thru 0x1fffff (0xb21 bytes) 1733805291.046194 write done 000338[0] 1733805291.046513 mapwrite 0x015f4e thru 0x02377e (0xd831 bytes) 1733805291.051994 mmap done 1733805291.141280 msync done 1733805291.141941 munmap done 000340[1] 1733805291.162867 write 0x1d2b84 thru 0x1d9477 (0x68f4 bytes) 1733805291.168735 write done 000341[1] 1733805291.179127 mapread 0x17137c thru 0x1811dd (0xfe62 bytes) 1733805291.184255 mmap done 1733805291.232153 memcpy done 1733805291.232214 munmap done 000342[1] 1733805291.244719 read 0x04bc56 thru 0x053d91 (0x813c bytes) 1733805291.280160 read done truncating to largest ever: 0x1e7a7b 000343[1] 1733805291.295603 trunc from 0x200000 to 0x1e7a7a (0x18585 bytes) 1733805291.318358 truncate done 000344[1] 1733805291.336011 trunc from 0x1e7a7b to 0x147b25 (0x9ff55 bytes) 1733805291.349714 truncate done 000349[1] 1733805291.393422 read 0x0535cc thru 0x05d2da (0x9d0f bytes) 1733805291.421676 read done 000350[1] 1733805291.436936 write 0x1d32b6 thru 0x1de8ee (0xb639 bytes) 1733805291.439261 write done 000351[1] 1733805291.440061 mapread 0x11a155 thru 0x1260f9 (0xbfa5 bytes) 1733805291.440194 mmap done 1733805291.441082 memcpy done 1733805291.441792 munmap done 000353[0] 1733805291.442356 read 0x0b2519 thru 0x0b2fe0 (0xac8 bytes) 1733805291.471258 read done 000354[0] 1733805291.481214 mapwrite 0x1f1aae thru 0x1ffe62 (0xe3b5 bytes) 1733805291.520506 truncate done 1733805291.520706 mmap done 1733805291.576200 msync done 1733805291.576385 munmap done 000355[0] 1733805291.599368 mapread 0x1705f4 thru 0x17fa8b (0xf498 bytes) 1733805291.599643 mmap done 1733805291.599746 memcpy done 1733805291.599778 munmap done 000356[1] 1733805291.621626 write 0x16c086 thru 0x176a5d (0xa9d8 bytes) 1733805291.646628 write done 000357[0] 1733805291.657101 mapread 0x17b058 thru 0x18302c (0x7fd5 bytes) 1733805291.662607 mmap done 1733805291.710880 memcpy done 1733805291.711226 munmap done 000361[1] 1733805291.743594 trunc from 0x1ffe63 to 0x16ddc8 (0x9209a bytes) 1733805291.771804 truncate done 000362[0] 1733805291.775250 read 0x030545 thru 0x03c786 (0xc242 bytes) 1733805291.795159 read done 000364[0] 1733805291.815283 trunc from 0x16ddc9 to 0x16e296 (0x4ce bytes) 1733805291.855157 truncate done 000366[1] 1733805291.869199 trunc from 0x16e297 to 0x1664a9 (0x7ded bytes) 1733805291.892266 truncate done 000368[0] 1733805291.920284 write 0x1dfc07 thru 0x1e5196 (0x5590 bytes) 1733805291.927289 write done 000369 1733805291.940992 [0]close/open 1733805291.942804 close done 1733805291.946339 open done 000371[1] 1733805291.971783 trunc from 0x1e5197 to 0x0fcfa2 (0xe81f4 bytes) 1733805291.997038 truncate done 000373[1] 1733805292.015694 write 0x112dd1 thru 0x114cf7 (0x1f27 bytes) 1733805292.016541 write done 000374[0] 1733805292.016843 trunc from 0x114cf8 to 0x0335ad (0xe174a bytes) 1733805292.041348 truncate done 000376[0] 1733805292.043456 mapwrite 0x164856 thru 0x16a8bf (0x606a bytes) 1733805292.050346 truncate done 1733805292.050916 mmap done 1733805292.164097 msync done 1733805292.165245 munmap done 000379[0] 1733805292.220474 trunc from 0x16a8c0 to 0x1a1044 (0x36785 bytes) 1733805292.232365 truncate done 000380[1] 1733805292.251052 mapwrite 0x036531 thru 0x03be0b (0x58db bytes) 1733805292.257412 mmap done 1733805292.394596 msync done 1733805292.394865 munmap done 000381[1] 1733805292.409184 write 0x12ab9b thru 0x13846b (0xd8d1 bytes) 1733805292.425289 write done 000382[1] 1733805292.425643 mapwrite 0x00386b thru 0x00dbb4 (0xa34a bytes) 1733805292.425877 mmap done 1733805292.518408 msync done 1733805292.519709 munmap done 000384[0] 1733805292.537669 read 0x01937f thru 0x024af5 (0xb777 bytes) 1733805292.551095 read done 000385[1] 1733805292.553357 mapread 0x065860 thru 0x06ffc2 (0xa763 bytes) 1733805292.553536 mmap done 1733805292.580249 memcpy done 1733805292.580417 munmap done 000386[0] 1733805292.580812 mapwrite 0x07902c thru 0x0804d8 (0x74ad bytes) 1733805292.584610 mmap done 1733805292.738170 msync done 1733805292.740063 munmap done 000387[0] 1733805292.753472 mapwrite 0x058abb thru 0x0611f9 (0x873f bytes) 1733805292.759864 mmap done 1733805292.818295 msync done 1733805292.818535 munmap done truncating to largest ever: 0x1f04fa 000391[0] 1733805292.856960 trunc from 0x1a1045 to 0x1f04f9 (0x4f4b5 bytes) 1733805292.879720 truncate done 000393[0] 1733805292.883465 mapwrite 0x18b49c thru 0x194454 (0x8fb9 bytes) 1733805292.883714 mmap done 1733805292.949115 msync done 1733805292.949285 munmap done 000394[1] 1733805292.968924 trunc from 0x1f04fa to 0x003b8c (0x1ec96d bytes) 1733805293.001911 truncate done 000395[0] 1733805293.027795 mapwrite 0x17ee6f thru 0x1811d0 (0x2362 bytes) 1733805293.051634 truncate done 1733805293.051832 mmap done 1733805293.136177 msync done 1733805293.136394 munmap done 000396[0] 1733805293.161523 mapread 0x0cc436 thru 0x0cdeee (0x1ab9 bytes) 1733805293.161756 mmap done 1733805293.167652 memcpy done 1733805293.168145 munmap done 000397[0] 1733805293.170403 mapread 0x02eb9b thru 0x03cd20 (0xe186 bytes) 1733805293.171164 mmap done 1733805293.186765 memcpy done 1733805293.187145 munmap done 000400[0] 1733805293.203503 mapread 0x136812 thru 0x139b8b (0x337a bytes) 1733805293.203688 mmap done 1733805293.219037 memcpy done 1733805293.219431 munmap done 000401[1] 1733805293.219990 trunc from 0x1811d1 to 0x1a852b (0x2735b bytes) 1733805293.240045 truncate done 000408[1] 1733805293.281943 mapread 0x0458ab thru 0x05271e (0xce74 bytes) 1733805293.282155 mmap done 1733805293.331542 memcpy done 1733805293.334517 munmap done 000411[1] 1733805293.365678 read 0x02a04c thru 0x030481 (0x6436 bytes) 1733805293.382439 read done 000414[0] 1733805293.394741 write 0x139d10 thru 0x1496db (0xf9cc bytes) 1733805293.416024 write done 000417[0] 1733805293.451748 write 0x0c634c thru 0x0cdca2 (0x7957 bytes) 1733805293.466181 write done 000418[0] 1733805293.482398 read 0x028de5 thru 0x029c5a (0xe76 bytes) 1733805293.517166 read done 000419[1] 1733805293.540644 read 0x0b71a8 thru 0x0b80df (0xf38 bytes) 1733805293.575180 read done 000420[1] 1733805293.577472 mapread 0x070ff8 thru 0x077a10 (0x6a19 bytes) 1733805293.582701 mmap done 1733805293.583020 memcpy done 1733805293.583201 munmap done 000421[1] 1733805293.596241 trunc from 0x1a852c to 0x1c5d18 (0x1d7ed bytes) 1733805293.619401 truncate done 000422[1] 1733805293.621324 mapwrite 0x10d01b thru 0x11b0db (0xe0c1 bytes) 1733805293.621843 mmap done 1733805293.727910 msync done 1733805293.728636 munmap done 000423[0] 1733805293.728994 trunc from 0x1c5d19 to 0x0cb983 (0xfa395 bytes) 1733805293.754143 truncate done 000426[1] 1733805293.758252 mapwrite 0x147549 thru 0x149ad8 (0x2590 bytes) 1733805293.778767 truncate done 1733805293.778967 mmap done 1733805293.854202 msync done 1733805293.854458 munmap done 000427[1] 1733805293.856960 write 0x19e737 thru 0x1ac31f (0xdbe9 bytes) 1733805293.857740 write done 000429[1] 1733805293.889134 mapwrite 0x1c63ad thru 0x1ca9d0 (0x4624 bytes) 1733805293.903035 truncate done 1733805293.903214 mmap done 1733805293.965063 msync done 1733805293.965221 munmap done 000430[0] 1733805293.979274 write 0x18e15d thru 0x193fa2 (0x5e46 bytes) 1733805293.998149 write done 000431[0] 1733805294.009878 read 0x03a67f thru 0x048d0e (0xe690 bytes) 1733805294.050217 read done 000432[1] 1733805294.050649 trunc from 0x1ca9d1 to 0x0427e0 (0x1881f0 bytes) 1733805294.084666 truncate done 000433[1] 1733805294.103904 write 0x085b77 thru 0x092659 (0xcae3 bytes) 1733805294.104630 write done 000436[0] 1733805294.145166 trunc from 0x09265a to 0x1180df (0x85a86 bytes) 1733805294.169365 truncate done 000438[1] 1733805294.196282 mapread 0x108324 thru 0x1177df (0xf4bc bytes) 1733805294.201641 mmap done 1733805294.266672 memcpy done 1733805294.266983 munmap done 000439[1] 1733805294.277949 trunc from 0x1180e0 to 0x1945fd (0x7c51e bytes) 1733805294.297168 truncate done 000445[1] 1733805294.342926 trunc from 0x1945fe to 0x17da1c (0x16be1 bytes) 1733805294.353772 truncate done 000446[0] 1733805294.368450 mapwrite 0x1b78cd thru 0x1b7a5f (0x193 bytes) 1733805294.384363 truncate done 1733805294.384549 mmap done 1733805294.450703 msync done 1733805294.450984 munmap done 000447[1] 1733805294.460128 read 0x01565d thru 0x01b9dd (0x6381 bytes) 1733805294.476880 read done 000448[0] 1733805294.488470 read 0x031352 thru 0x03b513 (0xa1c2 bytes) 1733805294.509915 read done 000450[1] 1733805294.525741 mapread 0x13f4cb thru 0x143432 (0x3f68 bytes) 1733805294.534653 mmap done 1733805294.572949 memcpy done 1733805294.573355 munmap done 000451[1] 1733805294.573783 mapread 0x1a02a3 thru 0x1a61a5 (0x5f03 bytes) 1733805294.573929 mmap done 1733805294.573980 memcpy done 1733805294.573995 munmap done 000454[1] 1733805294.579481 trunc from 0x1b7a60 to 0x14db7e (0x69ee1 bytes) 1733805294.616371 truncate done 000457[0] 1733805294.659044 mapread 0x09b4db thru 0x0a8d4c (0xd872 bytes) 1733805294.664785 mmap done 1733805294.787218 memcpy done 1733805294.787495 munmap done 000461[0] 1733805294.817816 read 0x1351cb thru 0x13b37e (0x61b4 bytes) 1733805294.843688 read done 000462[1] 1733805294.848015 write 0x1d5bb3 thru 0x1d7aea (0x1f38 bytes) 1733805294.861178 write done 000463[0] 1733805294.879458 mapwrite 0x167717 thru 0x16da63 (0x634d bytes) 1733805294.883671 mmap done 1733805294.948417 msync done 1733805294.948487 munmap done 000464[1] 1733805294.959410 read 0x0ca928 thru 0x0cdcb3 (0x338c bytes) 1733805294.990001 read done 000465[1] 1733805295.010128 trunc from 0x1d7aeb to 0x05b523 (0x17c5c7 bytes) 1733805295.043727 truncate done 000467[1] 1733805295.085374 mapread 0x02d06d thru 0x03817f (0xb113 bytes) 1733805295.085619 mmap done 1733805295.166678 memcpy done 1733805295.167601 munmap done 000468[1] 1733805295.168091 read 0x01ba42 thru 0x0203eb (0x49aa bytes) 1733805295.180120 read done 000469[0] 1733805295.180479 mapread 0x0027ac thru 0x00f728 (0xcf7d bytes) 1733805295.191365 mmap done 1733805295.300161 memcpy done 1733805295.300681 munmap done 000470[0] 1733805295.317286 mapread 0x025e26 thru 0x02daa5 (0x7c80 bytes) 1733805295.322599 mmap done 1733805295.371176 memcpy done 1733805295.371916 munmap done 000471[0] 1733805295.387523 mapwrite 0x027cf1 thru 0x0371f4 (0xf504 bytes) 1733805295.393315 mmap done 1733805295.525115 msync done 1733805295.525990 munmap done 000472[0] 1733805295.537458 mapwrite 0x11d496 thru 0x11fd70 (0x28db bytes) 1733805295.567021 truncate done 1733805295.567442 mmap done 1733805295.643511 msync done 1733805295.643871 munmap done 000473[0] 1733805295.661286 mapread 0x0fad4b thru 0x1018c3 (0x6b79 bytes) 1733805295.661502 mmap done 1733805295.690143 memcpy done 1733805295.690453 munmap done 000476[1] 1733805295.718424 write 0x1d8844 thru 0x1da336 (0x1af3 bytes) 1733805295.724671 write done 000477[0] 1733805295.734998 read 0x10394c thru 0x109350 (0x5a05 bytes) 1733805295.771886 read done 000480[0] 1733805295.791055 trunc from 0x1da337 to 0x0d4e01 (0x105535 bytes) 1733805295.806363 truncate done 000481[0] 1733805295.810057 mapwrite 0x1444e0 thru 0x15255c (0xe07d bytes) 1733805295.815394 truncate done 1733805295.815620 mmap done 1733805295.980374 msync done 1733805295.981197 munmap done 000484[0] 1733805296.004881 write 0x165c39 thru 0x1689cb (0x2d93 bytes) 1733805296.005271 write done 000487[1] 1733805296.031472 mapread 0x1304c9 thru 0x1399ed (0x9525 bytes) 1733805296.036362 mmap done 1733805296.075360 memcpy done 1733805296.075808 munmap done 000490[0] 1733805296.087067 trunc from 0x1689cc to 0x15ec6b (0x9d60 bytes) 1733805296.107677 truncate done 000492[1] 1733805296.129216 mapwrite 0x10f195 thru 0x10fc19 (0xa85 bytes) 1733805296.134866 mmap done 1733805296.185810 msync done 1733805296.187030 munmap done 000493[1] 1733805296.203773 read 0x016211 thru 0x025d81 (0xfb71 bytes) 1733805296.246789 read done 000495[0] 1733805296.267986 mapwrite 0x165acf thru 0x168523 (0x2a55 bytes) 1733805296.292908 truncate done 1733805296.293119 mmap done 1733805296.365000 msync done 1733805296.365065 munmap done 000496[1] 1733805296.369931 write 0x1e3b31 thru 0x1e3d81 (0x251 bytes) 1733805296.379530 write done 000498[1] 1733805296.406271 write 0x0c4140 thru 0x0d0ab4 (0xc975 bytes) 1733805296.427075 write done 000501[0] 1733805296.462679 mapwrite 0x139f2a thru 0x1437e4 (0x98bb bytes) 1733805296.477846 mmap done 1733805296.588561 msync done 1733805296.588801 munmap done 000502[0] 1733805296.604702 mapwrite 0x0b4da9 thru 0x0b6d4e (0x1fa6 bytes) 1733805296.620402 mmap done 1733805296.685355 msync done 1733805296.685710 munmap done 000503[1] 1733805296.686076 read 0x0f60d2 thru 0x0fa4c5 (0x43f4 bytes) 1733805296.760158 read done 000504[1] 1733805296.766843 trunc from 0x1e3d82 to 0x05eb61 (0x185220 bytes) 1733805296.810521 truncate done 000505[1] 1733805296.817689 write 0x0699de thru 0x07019a (0x67bd bytes) 1733805296.818181 write done 000506[0] 1733805296.839636 read 0x01d753 thru 0x0246e8 (0x6f96 bytes) 1733805296.874651 read done 000507[0] 1733805296.888391 read 0x0338fa thru 0x0402e6 (0xc9ed bytes) 1733805296.888544 read done 000508[1] 1733805296.899119 trunc from 0x07019b to 0x16ea96 (0xfe8fc bytes) 1733805296.922793 truncate done 000509[0] 1733805296.936193 write 0x1be8a4 thru 0x1c87b8 (0x9f15 bytes) 1733805296.943185 write done 000510[0] 1733805296.957726 trunc from 0x1c87b9 to 0x09e9df (0x129dd9 bytes) 1733805296.991316 truncate done 000511[0] 1733805296.994505 mapread 0x04138d thru 0x049d16 (0x898a bytes) 1733805296.994937 mmap done 1733805297.008551 memcpy done 1733805297.009049 munmap done 000512[1] 1733805297.009371 write 0x1110cb thru 0x111cb7 (0xbed bytes) 1733805297.017181 write done 000516[1] 1733805297.060614 read 0x0cd7b1 thru 0x0d9f7b (0xc7cb bytes) 1733805297.099251 read done 000517[0] 1733805297.099817 mapwrite 0x150039 thru 0x15fa29 (0xf9f1 bytes) 1733805297.135382 truncate done 1733805297.135552 mmap done 1733805297.221163 msync done 1733805297.221466 munmap done 000518[0] 1733805297.244139 mapwrite 0x1cebe1 thru 0x1d7006 (0x8426 bytes) 1733805297.260171 truncate done 1733805297.260354 mmap done 1733805297.330140 msync done 1733805297.330210 munmap done 000519[0] 1733805297.333341 mapread 0x0cc6be thru 0x0dbb88 (0xf4cb bytes) 1733805297.333524 mmap done 1733805297.333651 memcpy done 1733805297.333682 munmap done 000521[0] 1733805297.352116 write 0x062782 thru 0x065e03 (0x3682 bytes) 1733805297.357641 write done 000523[0] 1733805297.379963 write 0x1f2e40 thru 0x1fbccc (0x8e8d bytes) 1733805297.380966 write done 000524[1] 1733805297.381228 mapread 0x0906a1 thru 0x09bc38 (0xb598 bytes) 1733805297.391307 mmap done 1733805297.445123 memcpy done 1733805297.445832 munmap done 000525[0] 1733805297.448001 mapread 0x108124 thru 0x1172a0 (0xf17d bytes) 1733805297.448165 mmap done 1733805297.448264 memcpy done 1733805297.448384 munmap done 000526[1] 1733805297.456447 write 0x03a35a thru 0x047dd0 (0xda77 bytes) 1733805297.467034 write done 000532[1] 1733805297.567132 trunc from 0x1fbccd to 0x0f1abb (0x10a211 bytes) 1733805297.600278 truncate done 000538[1] 1733805297.637766 mapread 0x022934 thru 0x031212 (0xe8df bytes) 1733805297.637939 mmap done 1733805297.689389 memcpy done 1733805297.689524 munmap done 000540[1] 1733805297.702933 write 0x17041b thru 0x17b671 (0xb257 bytes) 1733805297.704088 write done 000541[1] 1733805297.721192 trunc from 0x17b672 to 0x0290ce (0x1525a3 bytes) 1733805297.733241 truncate done 000544[0] 1733805297.772138 trunc from 0x0290cf to 0x156853 (0x12d785 bytes) 1733805297.801836 truncate done 000546[1] 1733805297.854400 trunc from 0x156854 to 0x19cf8d (0x4673a bytes) 1733805297.892535 truncate done 000552[0] 1733805297.910873 mapwrite 0x0149bf thru 0x018d34 (0x4376 bytes) 1733805297.916245 mmap done 1733805297.991101 msync done 1733805297.993195 munmap done 000555[0] 1733805298.029986 read 0x13b56b thru 0x146243 (0xacd9 bytes) 1733805298.065453 read done 000556[0] 1733805298.079037 write 0x0395eb thru 0x039afd (0x513 bytes) 1733805298.079557 write done 000557[1] 1733805298.089111 read 0x119a33 thru 0x123506 (0x9ad4 bytes) 1733805298.119251 read done 000562[0] 1733805298.146266 write 0x099f48 thru 0x0a1947 (0x7a00 bytes) 1733805298.146780 write done 000563[0] 1733805298.155708 mapwrite 0x1f62e5 thru 0x1f6373 (0x8f bytes) 1733805298.179155 truncate done 1733805298.179350 mmap done 1733805298.236684 msync done 1733805298.236928 munmap done 000564[1] 1733805298.251615 read 0x18c7d3 thru 0x197436 (0xac64 bytes) 1733805298.302809 read done 000565[1] 1733805298.309128 write 0x16272f thru 0x1718c1 (0xf193 bytes) 1733805298.323283 write done 000568[0] 1733805298.351708 mapread 0x0a50eb thru 0x0ab12a (0x6040 bytes) 1733805298.356375 mmap done 1733805298.356475 memcpy done 1733805298.356499 munmap done 000576[1] 1733805298.418933 trunc from 0x1f6374 to 0x0974a7 (0x15eecc bytes) 1733805298.441653 truncate done 000577[1] 1733805298.444751 read 0x062a54 thru 0x068e74 (0x6421 bytes) 1733805298.458193 read done 000578[1] 1733805298.458776 mapread 0x0208c0 thru 0x02d152 (0xc893 bytes) 1733805298.458910 mmap done 1733805298.458981 memcpy done 1733805298.459156 munmap done 000579[0] 1733805298.459924 mapwrite 0x063f49 thru 0x069404 (0x54bc bytes) 1733805298.466772 mmap done 1733805298.532033 msync done 1733805298.532095 munmap done 000581[1] 1733805298.551074 read 0x080497 thru 0x0833ba (0x2f24 bytes) 1733805298.573860 read done 000583[0] 1733805298.587324 mapwrite 0x1d2eff thru 0x1d7800 (0x4902 bytes) 1733805298.615685 truncate done 1733805298.615865 mmap done 1733805298.675709 msync done 1733805298.677333 munmap done 000584[0] 1733805298.690499 mapread 0x13b573 thru 0x13c177 (0xc05 bytes) 1733805298.690734 mmap done 1733805298.696060 memcpy done 1733805298.696245 munmap done 000589[1] 1733805298.735209 write 0x00d0f7 thru 0x01487a (0x7784 bytes) 1733805298.754295 write done 000591[1] 1733805298.791450 trunc from 0x1d7801 to 0x11f063 (0xb879d bytes) 1733805298.823653 truncate done 000593[1] 1733805298.843840 mapread 0x00de6f thru 0x01949a (0xb62c bytes) 1733805298.844061 mmap done 1733805298.864750 memcpy done 1733805298.865033 munmap done 000596[0] 1733805298.906386 write 0x066a71 thru 0x074add (0xe06d bytes) 1733805298.944537 write done 000600[1] 1733805298.986714 write 0x1682ce thru 0x16b111 (0x2e44 bytes) 1733805298.987134 write done 000601[1] 1733805298.995138 trunc from 0x16b112 to 0x176af1 (0xb9e0 bytes) 1733805299.028038 truncate done 000603[1] 1733805299.057785 mapread 0x0533a9 thru 0x05abc0 (0x7818 bytes) 1733805299.058387 mmap done 1733805299.107894 memcpy done 1733805299.109159 munmap done 000605[1] 1733805299.113011 read 0x0cdb51 thru 0x0db613 (0xdac3 bytes) 1733805299.139682 read done 000607[0] 1733805299.140249 mapread 0x14267b thru 0x15153d (0xeec3 bytes) 1733805299.164253 mmap done 1733805299.261313 memcpy done 1733805299.261535 munmap done 000608[1] 1733805299.264119 trunc from 0x176af2 to 0x0b268d (0xc4464 bytes) 1733805299.282448 truncate done 000610[0] 1733805299.304658 write 0x197218 thru 0x19a415 (0x31fe bytes) 1733805299.315844 write done 000613[1] 1733805299.353257 write 0x1f8561 thru 0x1fbfee (0x3a8e bytes) 1733805299.363986 write done 000617[0] 1733805299.394946 read 0x01a0c0 thru 0x01bbb1 (0x1af2 bytes) 1733805299.436042 read done 000619[0] 1733805299.441902 write 0x00688d thru 0x00a59b (0x3d0f bytes) 1733805299.504873 write done 000620[0] 1733805299.517958 read 0x020376 thru 0x028a60 (0x86eb bytes) 1733805299.534093 read done 000621[0] 1733805299.541987 read 0x182d94 thru 0x18fbd1 (0xce3e bytes) 1733805299.579650 read done 000622[0] 1733805299.588905 mapwrite 0x1bb8d3 thru 0x1c648d (0xabbb bytes) 1733805299.589201 mmap done 1733805299.706240 msync done 1733805299.708648 munmap done 000623[1] 1733805299.727790 trunc from 0x1fbfef to 0x04050c (0x1bbae2 bytes) 1733805299.791093 truncate done 000624[1] 1733805299.793229 write 0x1ea88f thru 0x1f80f5 (0xd867 bytes) 1733805299.794270 write done 000625[1] 1733805299.794536 read 0x16aa4e thru 0x178db9 (0xe36c bytes) 1733805299.809292 read done 000627[1] 1733805299.828500 mapread 0x0336b9 thru 0x037ee9 (0x4831 bytes) 1733805299.828688 mmap done 1733805299.828747 memcpy done 1733805299.829036 munmap done 000628[0] 1733805299.830476 write 0x160304 thru 0x16c938 (0xc635 bytes) 1733805299.853733 write done 000631[0] 1733805299.890142 mapwrite 0x0d74d1 thru 0x0dd77d (0x62ad bytes) 1733805299.896649 mmap done 1733805299.985024 msync done 1733805299.985171 munmap done 000632[1] 1733805299.997123 write 0x049976 thru 0x058af6 (0xf181 bytes) 1733805300.013400 write done 000634[0] 1733805300.037093 mapread 0x1b8a18 thru 0x1c712b (0xe714 bytes) 1733805300.039937 mmap done 1733805300.095760 memcpy done 1733805300.097139 munmap done 000635[1] 1733805300.115211 mapread 0x10cc2d thru 0x11c509 (0xf8dd bytes) 1733805300.119108 mmap done 1733805300.186696 memcpy done 1733805300.187002 munmap done 000636[0] 1733805300.187759 read 0x1c8029 thru 0x1c8c50 (0xc28 bytes) 1733805300.201008 read done 000637[0] 1733805300.201361 read 0x1475ff thru 0x152cc2 (0xb6c4 bytes) 1733805300.232142 read done 000639[0] 1733805300.241818 write 0x0207c6 thru 0x027cb6 (0x74f1 bytes) 1733805300.286553 write done 000640[1] 1733805300.293453 trunc from 0x1f80f6 to 0x037b55 (0x1c05a0 bytes) 1733805300.343255 truncate done 000641[0] 1733805300.375179 mapwrite 0x120d24 thru 0x12b4c5 (0xa7a2 bytes) 1733805300.408215 truncate done 1733805300.408412 mmap done 1733805300.547439 msync done 1733805300.547656 munmap done 000643[1] 1733805300.550047 write 0x1beb62 thru 0x1c4d5a (0x61f9 bytes) 1733805300.558724 write done 000645[1] 1733805300.581221 trunc from 0x1c4d5b to 0x0cbed5 (0xf8e85 bytes) 1733805300.599889 truncate done 000647[0] 1733805300.603361 mapwrite 0x06b219 thru 0x077b5e (0xc946 bytes) 1733805300.608644 mmap done 1733805300.703678 msync done 1733805300.703927 munmap done 000649[1] 1733805300.724874 read 0x042ddd thru 0x044b20 (0x1d44 bytes) 1733805300.747103 read done 000650[1] 1733805300.747461 read 0x04d4ff thru 0x0577e4 (0xa2e6 bytes) 1733805300.747549 read done 000657[0] 1733805300.803806 mapwrite 0x1ecd78 thru 0x1f84f7 (0xb780 bytes) 1733805300.842975 truncate done 1733805300.843156 mmap done 1733805301.001474 msync done 1733805301.001662 munmap done 000662[0] 1733805301.055338 mapread 0x01a9f8 thru 0x0290d2 (0xe6db bytes) 1733805301.058524 mmap done 1733805301.147378 memcpy done 1733805301.147658 munmap done 000663[0] 1733805301.148004 mapwrite 0x1a9538 thru 0x1b834a (0xee13 bytes) 1733805301.148273 mmap done 1733805301.282810 msync done 1733805301.282980 munmap done 000666[1] 1733805301.314216 mapwrite 0x1f397d thru 0x1fbd2b (0x83af bytes) 1733805301.339479 truncate done 1733805301.339668 mmap done 1733805301.452868 msync done 1733805301.453058 munmap done 000669[1] 1733805301.490391 trunc from 0x1fbd2c to 0x15548a (0xa68a1 bytes) 1733805301.503399 truncate done 000671[1] 1733805301.529165 trunc from 0x15548b to 0x0f365c (0x61e2e bytes) 1733805301.546233 truncate done 000673[1] 1733805301.583979 write 0x1030ab thru 0x10a7f6 (0x774c bytes) 1733805301.584544 write done 000675[0] 1733805301.618328 mapread 0x089b77 thru 0x091365 (0x77ef bytes) 1733805301.627811 mmap done 1733805301.692453 memcpy done 1733805301.693600 munmap done 000676[0] 1733805301.698955 trunc from 0x10a7f7 to 0x07ced2 (0x8d924 bytes) 1733805301.733839 truncate done 000677[1] 1733805301.750949 write 0x14bc7a thru 0x14fa49 (0x3dd0 bytes) 1733805301.758657 write done 000678[0] 1733805301.773636 read 0x0ae2cc thru 0x0b9e1c (0xbb51 bytes) 1733805301.842468 read done 000680[0] 1733805301.858519 mapread 0x037cc2 thru 0x03d2e3 (0x5622 bytes) 1733805301.865062 mmap done 1733805301.865161 memcpy done 1733805301.865182 munmap done 000681[1] 1733805301.878220 mapwrite 0x19ddd0 thru 0x19e1a1 (0x3d2 bytes) 1733805301.917255 truncate done 1733805301.917457 mmap done 1733805302.031804 msync done 1733805302.032147 munmap done 000683[1] 1733805302.063222 trunc from 0x19e1a2 to 0x0b08b1 (0xed8f0 bytes) 1733805302.076856 truncate done 000685[0] 1733805302.107634 trunc from 0x0b08b2 to 0x0430cb (0x6d7e6 bytes) 1733805302.131490 truncate done 000689[0] 1733805302.180864 write 0x1e2ed7 thru 0x1f2d7e (0xfea8 bytes) 1733805302.181939 write done 000690[1] 1733805302.182197 trunc from 0x1f2d7f to 0x186e20 (0x6bf5e bytes) 1733805302.214170 truncate done 000697[0] 1733805302.261027 write 0x1c43d7 thru 0x1d0c12 (0xc83c bytes) 1733805302.266235 write done 000699[1] 1733805302.283742 read 0x0333ad thru 0x03b6ee (0x8342 bytes) 1733805302.303074 read done 000702[1] 1733805302.376498 mapread 0x18ba8b thru 0x190edd (0x5453 bytes) 1733805302.389342 mmap done 1733805302.433213 memcpy done 1733805302.433485 munmap done 000703[0] 1733805302.433844 mapwrite 0x162241 thru 0x172005 (0xfdc5 bytes) 1733805302.440625 mmap done 1733805302.573790 msync done 1733805302.576293 munmap done 000704[1] 1733805302.584536 mapwrite 0x1f6723 thru 0x1fffff (0x98dd bytes) 1733805302.603130 truncate done 1733805302.603300 mmap done 1733805302.653249 msync done 1733805302.653627 munmap done 000705[0] 1733805302.656308 trunc from 0x200000 to 0x18ae09 (0x751f6 bytes) 1733805302.681660 truncate done 000709[0] 1733805302.734637 read 0x02397e thru 0x028f6f (0x55f2 bytes) 1733805302.758817 read done 000713[0] 1733805302.793228 trunc from 0x18ae0a to 0x0f0a50 (0x9a3b9 bytes) 1733805302.804920 truncate done 000714[0] 1733805302.809105 write 0x12c711 thru 0x13b2e3 (0xebd3 bytes) 1733805302.809924 write done 000715[1] 1733805302.828782 trunc from 0x13b2e4 to 0x13337b (0x7f68 bytes) 1733805302.859325 truncate done 000718[1] 1733805302.897332 read 0x0c5ebc thru 0x0c6445 (0x58a bytes) 1733805302.916025 read done 000720[1] 1733805302.939758 trunc from 0x13337c to 0x01737f (0x11bffc bytes) 1733805302.967160 truncate done 000721[1] 1733805302.982006 read 0x0076ff thru 0x00f29f (0x7ba1 bytes) 1733805302.982141 read done 000723[1] 1733805302.984771 write 0x05da4e thru 0x06b40e (0xd9c1 bytes) 1733805302.985543 write done 000725[1] 1733805303.000960 mapwrite 0x10af07 thru 0x1154b7 (0xa5b1 bytes) 1733805303.012140 truncate done 1733805303.012313 mmap done 1733805303.096346 msync done 1733805303.096690 munmap done 000727[0] 1733805303.119431 read 0x045830 thru 0x046ce8 (0x14b9 bytes) 1733805303.148713 read done 000729[1] 1733805303.163195 mapwrite 0x074401 thru 0x082d77 (0xe977 bytes) 1733805303.163538 mmap done 1733805303.256687 msync done 1733805303.257030 munmap done 000731[1] 1733805303.257653 mapwrite 0x0a31a8 thru 0x0a7229 (0x4082 bytes) 1733805303.257825 mmap done 1733805303.311601 msync done 1733805303.312722 munmap done 000732[1] 1733805303.313229 read 0x0fa637 thru 0x1098bb (0xf285 bytes) 1733805303.334017 read done 000733[1] 1733805303.334777 mapread 0x09897b thru 0x098f17 (0x59d bytes) 1733805303.334909 mmap done 1733805303.334931 memcpy done 1733805303.335689 munmap done 000734[0] 1733805303.351655 mapwrite 0x0c7aec thru 0x0c9db1 (0x22c6 bytes) 1733805303.358024 mmap done 1733805303.450733 msync done 1733805303.450897 munmap done 000737[1] 1733805303.480964 read 0x07ce02 thru 0x08226f (0x546e bytes) 1733805303.509455 read done 000740[0] 1733805303.555926 write 0x0b361c thru 0x0bc73b (0x9120 bytes) 1733805303.572196 write done 000743[1] 1733805303.601206 trunc from 0x1154b8 to 0x10758d (0xdf2a bytes) 1733805303.624102 truncate done 000748[1] 1733805303.645640 trunc from 0x10758e to 0x115ebd (0xe930 bytes) 1733805303.657563 truncate done 000753[0] 1733805303.693108 read 0x04448a thru 0x04a227 (0x5d9e bytes) 1733805303.733116 read done 000754[0] 1733805303.747213 mapread 0x01f85b thru 0x0240d7 (0x487d bytes) 1733805303.750646 mmap done 1733805303.750768 memcpy done 1733805303.750831 munmap done 000759[0] 1733805303.793627 mapread 0x10a97b thru 0x1128b2 (0x7f38 bytes) 1733805303.800886 mmap done 1733805303.824304 memcpy done 1733805303.824658 munmap done 000760[0] 1733805303.824945 mapwrite 0x0b9eb7 thru 0x0bfe94 (0x5fde bytes) 1733805303.825129 mmap done 1733805303.901662 msync done 1733805303.901724 munmap done 000761[0] 1733805303.917309 mapread 0x0bdc0c thru 0x0c3c1b (0x6010 bytes) 1733805303.917531 mmap done 1733805303.930927 memcpy done 1733805303.930982 munmap done 000762[1] 1733805303.940610 read 0x0c8e97 thru 0x0cce8d (0x3ff7 bytes) 1733805303.970660 read done 000764[0] 1733805303.973783 mapwrite 0x1d6179 thru 0x1df36e (0x91f6 bytes) 1733805304.005255 truncate done 1733805304.005423 mmap done 1733805304.070373 msync done 1733805304.070627 munmap done 000767[0] 1733805304.117390 mapwrite 0x011659 thru 0x01732e (0x5cd6 bytes) 1733805304.118200 mmap done 1733805304.177535 msync done 1733805304.177596 munmap done 000768[1] 1733805304.180550 write 0x002520 thru 0x00f73c (0xd21d bytes) 1733805304.194302 write done 000769[0] 1733805304.207012 mapread 0x01b90c thru 0x01eb21 (0x3216 bytes) 1733805304.210373 mmap done 1733805304.233522 memcpy done 1733805304.233653 munmap done 000772[1] 1733805304.266753 mapread 0x025650 thru 0x0348ac (0xf25d bytes) 1733805304.271143 mmap done 1733805304.315546 memcpy done 1733805304.315795 munmap done 000774[1] 1733805304.316519 mapwrite 0x0e722a thru 0x0f1ab8 (0xa88f bytes) 1733805304.321461 mmap done 1733805304.499213 msync done 1733805304.499410 munmap done 000775[1] 1733805304.507745 mapread 0x0ffc38 thru 0x10cd17 (0xd0e0 bytes) 1733805304.511973 mmap done 1733805304.571703 memcpy done 1733805304.571920 munmap done 000777[1] 1733805304.572567 mapwrite 0x107e3b thru 0x10b5fd (0x37c3 bytes) 1733805304.572764 mmap done 1733805304.648704 msync done 1733805304.648753 munmap done 000779[1] 1733805304.672945 write 0x1cda52 thru 0x1d8055 (0xa604 bytes) 1733805304.680519 write done 000780[1] 1733805304.692928 trunc from 0x1df36f to 0x07e39a (0x160fd4 bytes) 1733805304.702681 truncate done 000782[1] 1733805304.719531 mapread 0x026f8b thru 0x029f1f (0x2f95 bytes) 1733805304.720174 mmap done 1733805304.732418 memcpy done 1733805304.732780 munmap done 000793[0] 1733805304.792558 trunc from 0x07e39b to 0x070e46 (0xd554 bytes) 1733805304.825325 truncate done 000794[0] 1733805304.829285 write 0x0f3257 thru 0x0faea3 (0x7c4d bytes) 1733805304.830406 write done 000796[0] 1733805304.830934 mapread 0x0751ae thru 0x084779 (0xf5cc bytes) 1733805304.831077 mmap done 1733805304.870680 memcpy done 1733805304.871033 munmap done 000797[1] 1733805304.871379 write 0x1c60b6 thru 0x1d0fae (0xaef9 bytes) 1733805304.878407 write done 000801[0] 1733805304.920682 mapwrite 0x1bf388 thru 0x1c975c (0xa3d5 bytes) 1733805304.926687 mmap done 1733805305.067863 msync done 1733805305.068386 munmap done 000805[0] 1733805305.081050 mapread 0x0014cc thru 0x00382e (0x2363 bytes) 1733805305.081919 mmap done 1733805305.090215 memcpy done 1733805305.090790 munmap done 000811[1] 1733805305.137221 mapwrite 0x151c71 thru 0x15858d (0x691d bytes) 1733805305.142833 mmap done 1733805305.246680 msync done 1733805305.246839 munmap done 000815[1] 1733805305.286636 read 0x06b1f3 thru 0x06d27c (0x208a bytes) 1733805305.333771 read done 000816[1] 1733805305.351056 mapread 0x07267e thru 0x07b873 (0x91f6 bytes) 1733805305.351270 mmap done 1733805305.351346 memcpy done 1733805305.351948 munmap done 000817[1] 1733805305.361779 write 0x0044d0 thru 0x0084ad (0x3fde bytes) 1733805305.375494 write done 000818[0] 1733805305.376246 trunc from 0x1d0faf to 0x10b74d (0xc5861 bytes) 1733805305.405456 truncate done 000819[1] 1733805305.421083 mapwrite 0x005863 thru 0x010248 (0xa9e6 bytes) 1733805305.427854 mmap done 1733805305.529338 msync done 1733805305.529428 munmap done 000820[1] 1733805305.545955 mapread 0x0aad44 thru 0x0b0916 (0x5bd3 bytes) 1733805305.557976 mmap done 1733805305.599891 memcpy done 1733805305.600041 munmap done 000821[1] 1733805305.614066 write 0x1d596d thru 0x1e594f (0xffe3 bytes) 1733805305.624456 write done 000826[1] 1733805305.677443 read 0x092591 thru 0x0a23c4 (0xfe34 bytes) 1733805305.699890 read done 000827[0] 1733805305.700226 trunc from 0x1e5950 to 0x12a6ba (0xbb295 bytes) 1733805305.737507 truncate done 000837[1] 1733805305.790975 write 0x04dec7 thru 0x05aa35 (0xcb6f bytes) 1733805305.803792 write done 000838[1] 1733805305.814003 read 0x087bdc thru 0x096144 (0xe569 bytes) 1733805305.831480 read done 000840[0] 1733805305.855163 trunc from 0x12a6bb to 0x192840 (0x68186 bytes) 1733805305.882263 truncate done 000841[0] 1733805305.900690 mapread 0x099ff1 thru 0x0a786e (0xd87e bytes) 1733805305.900908 mmap done 1733805305.954170 memcpy done 1733805305.954462 munmap done 000842[1] 1733805305.967031 mapread 0x15833c thru 0x15ce4c (0x4b11 bytes) 1733805305.973914 mmap done 1733805306.000780 memcpy done 1733805306.001926 munmap done 000844[1] 1733805306.027301 mapread 0x103d2a thru 0x10b152 (0x7429 bytes) 1733805306.032808 mmap done 1733805306.068199 memcpy done 1733805306.068345 munmap done 000845[1] 1733805306.074407 trunc from 0x192841 to 0x07b063 (0x1177dd bytes) 1733805306.102074 truncate done 000847[0] 1733805306.127923 write 0x0d69ee thru 0x0dfb39 (0x914c bytes) 1733805306.135068 write done 000855[1] 1733805306.206541 trunc from 0x0dfb3a to 0x0c3b72 (0x1bfc7 bytes) 1733805306.228241 truncate done 000858[1] 1733805306.255430 read 0x0b3b4c thru 0x0b8bda (0x508f bytes) 1733805306.273007 read done 000859[1] 1733805306.292054 mapread 0x0b7e9c thru 0x0bbb7d (0x3ce2 bytes) 1733805306.292261 mmap done 1733805306.292705 memcpy done 1733805306.293236 munmap done 000860[0] 1733805306.293569 trunc from 0x0c3b73 to 0x143cc1 (0x8014f bytes) 1733805306.322616 truncate done 000862[0] 1733805306.342145 read 0x05fef3 thru 0x066bbb (0x6cc9 bytes) 1733805306.358911 read done 000863[1] 1733805306.359275 trunc from 0x143cc2 to 0x054769 (0xef558 bytes) 1733805306.384154 truncate done 000864[0] 1733805306.388198 write 0x0dfdc7 thru 0x0ee98a (0xebc4 bytes) 1733805306.405093 write done 000869[1] 1733805306.478836 mapwrite 0x112a8b thru 0x1203d8 (0xd94e bytes) 1733805306.504419 truncate done 1733805306.504727 mmap done 1733805306.610920 msync done 1733805306.611354 munmap done 000872[0] 1733805306.615931 write 0x07dd42 thru 0x07eae4 (0xda3 bytes) 1733805306.627950 write done 000873[0] 1733805306.638951 read 0x046fe0 thru 0x055e94 (0xeeb5 bytes) 1733805306.660361 read done 000876[1] 1733805306.707199 mapwrite 0x01f70a thru 0x027dfb (0x86f2 bytes) 1733805306.715328 mmap done 1733805306.808184 msync done 1733805306.809394 munmap done 000878[1] 1733805306.809979 trunc from 0x1203d9 to 0x0202fb (0x1000dd bytes) 1733805306.823394 truncate done 000879[0] 1733805306.828727 trunc from 0x0202fc to 0x171d9c (0x151aa1 bytes) 1733805306.858355 truncate done 000880 1733805306.877182 [1]close/open 1733805306.880377 close done 1733805306.888858 open done 000881[0] 1733805306.894617 mapread 0x0c39fd thru 0x0c4197 (0x79b bytes) 1733805306.896069 mmap done 1733805306.912965 memcpy done 1733805306.913311 munmap done 000884[0] 1733805306.939539 trunc from 0x171d9d to 0x1d8fad (0x67211 bytes) 1733805306.951133 truncate done 000885[0] 1733805306.967718 write 0x115955 thru 0x116e4c (0x14f8 bytes) 1733805306.968326 write done 000888[1] 1733805306.991131 read 0x0dc2b8 thru 0x0e4b70 (0x88b9 bytes) 1733805307.031233 read done 000890[1] 1733805307.035219 read 0x0e766d thru 0x0f152a (0x9ebe bytes) 1733805307.085031 read done 000896[0] 1733805307.127619 mapwrite 0x1ed906 thru 0x1f39f4 (0x60ef bytes) 1733805307.147091 truncate done 1733805307.147274 mmap done 1733805307.249398 msync done 1733805307.249705 munmap done 000898[0] 1733805307.264699 mapwrite 0x084af5 thru 0x086221 (0x172d bytes) 1733805307.264876 mmap done 1733805307.312958 msync done 1733805307.313112 munmap done 000899[1] 1733805307.313590 read 0x0907f5 thru 0x094b0e (0x431a bytes) 1733805307.359520 read done 000901[1] 1733805307.387241 mapread 0x19be66 thru 0x1a72e2 (0xb47d bytes) 1733805307.400513 mmap done 1733805307.449165 memcpy done 1733805307.449312 munmap done 000903[0] 1733805307.459556 mapread 0x1ca82a thru 0x1d2558 (0x7d2f bytes) 1733805307.459769 mmap done 1733805307.491325 memcpy done 1733805307.491620 munmap done 000904[0] 1733805307.491927 mapread 0x14a6e0 thru 0x15a11d (0xfa3e bytes) 1733805307.492072 mmap done 1733805307.590912 memcpy done 1733805307.591106 munmap done 000905[0] 1733805307.591465 write 0x05df84 thru 0x0699bb (0xba38 bytes) 1733805307.617543 write done 000906[1] 1733805307.617908 mapread 0x16df1e thru 0x16f90f (0x19f2 bytes) 1733805307.626011 mmap done 1733805307.626068 memcpy done 1733805307.626088 munmap done 000910[1] 1733805307.648990 mapwrite 0x019a95 thru 0x01c6b8 (0x2c24 bytes) 1733805307.652720 mmap done 1733805307.757317 msync done 1733805307.758718 munmap done 000912[0] 1733805307.759254 trunc from 0x1f39f5 to 0x11bcdf (0xd7d15 bytes) 1733805307.798766 truncate done 000913[0] 1733805307.801654 trunc from 0x11bce0 to 0x1aa271 (0x8e592 bytes) 1733805307.807235 truncate done 000919[1] 1733805307.848068 read 0x106b10 thru 0x10cb5f (0x6050 bytes) 1733805307.895416 read done 000921[0] 1733805307.917963 write 0x195fec thru 0x1a2cff (0xcd14 bytes) 1733805307.944179 write done 000923[0] 1733805307.962167 mapwrite 0x0065f5 thru 0x00ee07 (0x8813 bytes) 1733805307.963419 mmap done 1733805308.036156 msync done 1733805308.036384 munmap done 000926[1] 1733805308.055723 mapread 0x0f4e2a thru 0x10043a (0xb611 bytes) 1733805308.067090 mmap done 1733805308.226743 memcpy done 1733805308.227347 munmap done 000930[1] 1733805308.232131 write 0x1d70e1 thru 0x1d719a (0xba bytes) 1733805308.241905 write done 000932[1] 1733805308.272919 trunc from 0x1d719b to 0x08be08 (0x14b392 bytes) 1733805308.300862 truncate done 000933[1] 1733805308.305429 write 0x0ed192 thru 0x0f2364 (0x51d3 bytes) 1733805308.307093 write done 000934[0] 1733805308.333565 mapread 0x0eb5a4 thru 0x0ed619 (0x2076 bytes) 1733805308.350195 mmap done 1733805308.375927 memcpy done 1733805308.376115 munmap done 000936[0] 1733805308.379105 write 0x1180a0 thru 0x127016 (0xef77 bytes) 1733805308.386258 write done 000940[0] 1733805308.409962 mapwrite 0x06b70d thru 0x071e84 (0x6778 bytes) 1733805308.410981 mmap done 1733805308.513851 msync done 1733805308.514043 munmap done 000943[0] 1733805308.554757 read 0x0d4aeb thru 0x0d72d4 (0x27ea bytes) 1733805308.576703 read done 000944[1] 1733805308.589854 trunc from 0x127017 to 0x13b63b (0x14625 bytes) 1733805308.636035 truncate done 000945[0] 1733805308.664359 write 0x1b24a7 thru 0x1bfc4c (0xd7a6 bytes) 1733805308.676102 write done 000948[0] 1733805308.740405 trunc from 0x1bfc4d to 0x11230e (0xad93e bytes) 1733805308.778412 truncate done 000949[1] 1733805308.794240 mapwrite 0x1db7b2 thru 0x1dba25 (0x274 bytes) 1733805308.816367 truncate done 1733805308.816559 mmap done 1733805308.869249 msync done 1733805308.869410 munmap done 000953[0] 1733805308.889138 mapwrite 0x0e1d62 thru 0x0e671f (0x49be bytes) 1733805308.899059 mmap done 1733805308.961539 msync done 1733805308.961753 munmap done 000954[0] 1733805308.970996 write 0x0cbc75 thru 0x0cf533 (0x38bf bytes) 1733805308.977568 write done 000958[0] 1733805309.020706 mapread 0x04dd50 thru 0x050c88 (0x2f39 bytes) 1733805309.025649 mmap done 1733805309.041444 memcpy done 1733805309.042596 munmap done 000959[0] 1733805309.053403 mapwrite 0x01e640 thru 0x02cc04 (0xe5c5 bytes) 1733805309.060863 mmap done 1733805309.140239 msync done 1733805309.140610 munmap done truncating to largest ever: 0x1fe484 000960[0] 1733805309.150704 trunc from 0x1dba26 to 0x1fe483 (0x22a5e bytes) 1733805309.163896 truncate done 000963[0] 1733805309.166942 mapwrite 0x162f57 thru 0x1656cb (0x2775 bytes) 1733805309.167133 mmap done 1733805309.231683 msync done 1733805309.232111 munmap done 000964[1] 1733805309.232448 trunc from 0x1fe484 to 0x0b9266 (0x14521d bytes) 1733805309.269800 truncate done 000966[0] 1733805309.289282 read 0x013232 thru 0x022f59 (0xfd28 bytes) 1733805309.310449 read done 000968[1] 1733805309.321185 read 0x07c648 thru 0x088a5d (0xc416 bytes) 1733805309.336244 read done 000969[1] 1733805309.336630 read 0x0134e2 thru 0x023266 (0xfd85 bytes) 1733805309.336735 read done 000971[0] 1733805309.337196 mapread 0x0429d1 thru 0x04a664 (0x7c94 bytes) 1733805309.349189 mmap done 1733805309.349301 memcpy done 1733805309.349625 munmap done 000972[1] 1733805309.361956 write 0x1439c6 thru 0x150d17 (0xd352 bytes) 1733805309.362797 write done 000974[0] 1733805309.379295 read 0x0e78a0 thru 0x0f5f9f (0xe700 bytes) 1733805309.396748 read done 000976[0] 1733805309.397485 read 0x053ca6 thru 0x059354 (0x56af bytes) 1733805309.398127 read done 000979[0] 1733805309.416872 read 0x08df2c thru 0x093144 (0x5219 bytes) 1733805309.416977 read done 000980[0] 1733805309.426380 write 0x09f5a7 thru 0x0ac7ff (0xd259 bytes) 1733805309.452002 write done 000981[1] 1733805309.463106 mapwrite 0x1cdebb thru 0x1d947c (0xb5c2 bytes) 1733805309.490357 truncate done 1733805309.490533 mmap done 1733805309.595887 msync done 1733805309.596133 munmap done 000985[0] 1733805309.645947 mapread 0x060136 thru 0x066c9a (0x6b65 bytes) 1733805309.651459 mmap done 1733805309.680351 memcpy done 1733805309.680509 munmap done 000987[0] 1733805309.696941 mapwrite 0x13520f thru 0x13dccc (0x8abe bytes) 1733805309.701892 mmap done 1733805309.779960 msync done 1733805309.780537 munmap done 000989[1] 1733805309.781207 mapwrite 0x074e64 thru 0x084c43 (0xfde0 bytes) 1733805309.786487 mmap done 1733805309.873362 msync done 1733805309.873665 munmap done 000997[1] 1733805309.945252 mapread 0x111959 thru 0x118fb2 (0x765a bytes) 1733805309.949117 mmap done 1733805309.974706 memcpy done 1733805309.974952 munmap done 001000[1] 1733805309.990221 write 0x0406c1 thru 0x04f3ee (0xed2e bytes) 1733805309.995968 write done All operations completed A-OK! PASS fsx (31s) == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 23:35:12 (1733805312) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 oleg330-server: /home/green/git/lustre-release/lustre/tests/except/sanity.0f.ex oleg330-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see client > v2_15_63-134-gdacc4b6d38 for LU-15963, go 312 - need mds1 <= 2.14.55-100-g8a84c7f9c7 for LU-14927, skip 0f - need mds1 < v2_14_55-100-g8a84c7f9c7 for LU-14927, skip 0f excepting tests: 42a 42c 42b 118c 118d 407 119i 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 23:35:24 (1733805324) === Stopping clients: oleg330-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg330-client.virtnet /mnt/lustre2 opts: oleg330-client.virtnet: executing check_config_client /mnt/lustre oleg330-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg330-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012ab25800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012ab25800.idle_timeout=debug disable quota as required oleg330-server: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 23:35:40 (1733805340) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f14845] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 23:35:42 (1733805342) utime: good mknod times 1733805342 <= 1733805343 <= 1733805343 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (3s) == sanity test 36b: OST utime check (open, utime) ======== 23:35:46 (1733805346) utime: good utime mtimes 100000, atime 200000 PASS 36b (4s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 23:35:49 (1733805349) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1733805349 <= 1733805350 <= 1733805350 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (3s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 23:35:52 (1733805352) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (3s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 23:35:55 (1733805355) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (3s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 23:35:58 (1733805358) fail_loc=0x80000214 Mon Dec 9 23:35:59 EST 2024 1733805359 Mon Dec 9 23:36:00 EST 2024 1733805360 PASS 36f (4s) == sanity test 36g: FMD cache expiry =============================================================================== 23:36:02 (1733805362) FMD max age: 30s FMD before: 6 FMD after: 0 PASS 36g (46s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 23:36:48 (1733805408) fail_loc=0x80000227 Mon Dec 9 23:36:49 EST 2024 1733805409 Mon Dec 9 23:36:50 EST 2024 1733805410 PASS 36h (4s) == sanity test 36i: change mtime on striped directory ==== 23:36:52 (1733805412) SKIP: sanity test_36i needs >= 2 MDTs SKIP 36i (1s) == sanity test 39a: mtime changed on create ============== 23:36:53 (1733805413) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (5s) == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 23:36:58 (1733805418) repeat after cancel_lru_locks PASS 39b (4s) == sanity test 39c: mtime change on rename ===================================================================================== 23:37:02 (1733805422) repeat after cancel_lru_locks PASS 39c (4s) == sanity test 39d: create, utime, stat ======================================================================================== 23:37:06 (1733805426) repeat after cancel_lru_locks PASS 39d (3s) == sanity test 39e: create, stat, utime, stat ================================================================================== 23:37:09 (1733805429) repeat after cancel_lru_locks PASS 39e (3s) == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 23:37:12 (1733805432) repeat after cancel_lru_locks PASS 39f (4s) == sanity test 39g: write, chmod, stat ========================================================================================= 23:37:16 (1733805436) repeat after cancel_lru_locks PASS 39g (5s) == sanity test 39h: write, utime within one second, stat ======================================================================= 23:37:21 (1733805441) repeat after cancel_lru_locks PASS 39h (3s) == sanity test 39i: write, rename, stat ======================================================================================== 23:37:24 (1733805444) repeat after cancel_lru_locks PASS 39i (4s) == sanity test 39j: write, rename, close, stat ================================================================================= 23:37:28 (1733805448) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14845 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (9s) == sanity test 39k: write, utime, close, stat ================================================================================== 23:37:37 (1733805457) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14845 repeat after cancel_lru_locks PASS 39k (4s) == sanity test 39l: directory atime update ===================================================================================== 23:37:41 (1733805461) PASS 39l (10s) == sanity test 39m: test atime and mtime before 1970 ===== 23:37:51 (1733805471) repeat after cancel_lru_locks PASS 39m (5s) == sanity test 39n: check that O_NOATIME is honored ====== 23:37:56 (1733805476) 1+0 records in 1+0 records out PASS 39n (14s) == sanity test 39o: directory cached attributes updated after create ========================================================== 23:38:10 (1733805490) a b PASS 39o (3s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 23:38:13 (1733805493) SKIP: sanity test_39p needs >= 2 MDTs SKIP 39p (2s) == sanity test 39r: lazy atime update on OST ============= 23:38:15 (1733805495) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) == sanity test 39q: close won't zero out atime =========== 23:38:16 (1733805496) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.14845 PASS 39q (3s) == sanity test 39s: relatime is supported ================ 23:38:19 (1733805499) 192.168.203.130@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg330-client.virtnet /mnt/lustre (opts:) Starting client: oleg330-client.virtnet: -o relatime 192.168.203.130@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg330-client.virtnet /mnt/lustre (opts:) Starting client: oleg330-client.virtnet: -o user_xattr,flock 192.168.203.130@tcp:/lustre /mnt/lustre PASS 39s (9s) == sanity test 39u: stat race ============================ 23:38:28 (1733805508) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438301 s, 23.9 MB/s fail_loc=0x80001434 PASS 39u (16s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 23:38:44 (1733805524) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00743339 s, 551 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (2s) == sanity test 41: test small file write + fstat =============================================================================== 23:38:46 (1733805526) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (4s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 23:38:50 (1733805530) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.0377808 s, 2.7 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 7040 2200064 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7530496 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (3s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 23:38:53 (1733805533) total: 1000 open/close in 5.28 seconds: 189.44 ops/second total: 934 open/close in 5.77 seconds: 161.87 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 17.791 s, 27.5 MB/s osc.lustre-OST0000-osc-ffff8800a7344800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800a7344800.cur_grant_bytes=492044288 osc.lustre-OST0000-osc-ffff8800a7344800.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff8800a7344800.cur_grant_bytes=491126784 osc.lustre-OST0000-osc-ffff8800a7344800.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800a7344800.rpc_stats= snapshot_time: 1733805615.491562948 secs.nsecs start_time: 1733805612.243258632 secs.nsecs elapsed_time: 3.248304316 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 DIO RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 33 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 32 96 96 2: 0 0 0 | 1 3 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 33 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 7680 2200960 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 336896 3432448 9% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 340992 7197696 5% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (98s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 23:40:31 (1733805631) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5844: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (3s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 23:40:34 (1733805634) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 9219 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (3s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 23:40:37 (1733805637) truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 9854 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (3s) == sanity test 43c: md5sum of copy into lustre =========== 23:40:40 (1733805640) bash: OK PASS 43c (2s) == sanity test 46: dirtying a previously written page ========================================================================== 23:40:42 (1733805642) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00755907 s, 542 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0014627 s, 2.8 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00106206 s, 3.9 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (3s) == sanity test 56r: check lfs find -size works =========== 23:40:45 (1733805645) PASS 56r (3s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 23:40:49 (1733805649) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff8800a7344800.max_cached_mb= users: 5 max_cached_mb: 1865 used_mb: 49 unused_mb: 1816 unevict_mb: 0 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff8800a7344800.read_ahead_stats= snapshot_time 1733805672.999537938 secs.nsecs start_time 1733805664.901356826 secs.nsecs elapsed_time 8.098181112 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (27s) resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119a: Short directIO read must return actual read amount ========================================================== 23:41:17 (1733805677) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (2s) == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 23:41:20 (1733805680) PASS 131a (2s) == sanity test 131b: test append writev ================== 23:41:22 (1733805682) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (3s) == sanity test 131c: test read/write on file w/o objects ========================================================== 23:41:25 (1733805685) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (2s) == sanity test 131d: test short read ===================== 23:41:28 (1733805688) PASS 131d (2s) == sanity test 131e: test read hitting hole ============== 23:41:30 (1733805690) PASS 131e (3s) == sanity test 150a: truncate/append tests =============== 23:41:33 (1733805693) 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000429966 s, 14.2 MB/s Stopping client oleg330-client.virtnet /mnt/lustre (opts:) Starting client: oleg330-client.virtnet: -o user_xattr,flock 192.168.203.130@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.203.130@tcp:/lustre 7542784 8192 7528448 1% /mnt/lustre sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete PASS 150a (19s) == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 23:41:52 (1733805712) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (1s) == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 23:41:53 (1733805713) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (1s) == sanity test 150c: Verify fallocate Size and Blocks ==== 23:41:55 (1733805715) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (1s) == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 23:41:56 (1733805716) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (1s) == sanity test 150f: Verify fallocate punch functionality ========================================================== 23:41:57 (1733805717) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (1s) == sanity test 150g: Verify fallocate punch on large range ========================================================== 23:41:58 (1733805718) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (1s) == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 23:41:59 (1733805719) oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000770093 s, 7.9 MB/s oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 PASS 155a (5s) == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 23:42:04 (1733805724) oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000319192 s, 19.1 MB/s oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 PASS 155b (4s) == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 23:42:09 (1733805729) oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000895269 s, 6.8 MB/s oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 PASS 155c (5s) == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 23:42:14 (1733805734) oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 oleg330-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg330-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000659126 s, 9.2 MB/s oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 oleg330-server: error: set_param: setting : Invalid argument pdsh@oleg330-client: oleg330-server: ssh exited with exit code 22 PASS 155d (5s) == sanity test 207a: can refresh layout at glimpse ======= 23:42:19 (1733805739) 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.00773808 s, 1.1 MB/s fail_loc=0x170 PASS 207a (3s) == sanity test 207b: can refresh layout at open ========== 23:42:22 (1733805742) 7+0 records in 7+0 records out 28672 bytes (29 kB) copied, 0.00702831 s, 4.1 MB/s fail_loc=0x171 checksum is cf845a781c107ec1346e849c9dd1b7e8 /mnt/lustre/f207b.sanity PASS 207b (2s) == sanity test 241a: bio vs dio ========================== 23:42:24 (1733805744) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00724748 s, 5.7 MB/s -rw-r--r-- 1 root root 40960 Dec 9 23:42 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b3b96800.lock_unused_count=1 PASS 241a (29s) == sanity test 241b: dio vs dio ========================== 23:42:53 (1733805773) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.0100212 s, 4.1 MB/s -rw-r--r-- 1 root root 40960 Dec 9 23:42 /mnt/lustre/f241b.sanity PASS 241b (17s) == sanity test 251a: Handling short read and write correctly ========================================================== 23:43:10 (1733805790) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (3s) == sanity test 251b: short read restore offset correctly ========================================================== 23:43:13 (1733805793) 4+0 records in 4+0 records out 4096 bytes (4.1 kB) copied, 0.00331163 s, 1.2 MB/s fail_loc=0x1431 fail_val=5 PASS 251b (8s) == sanity test complete, duration 490 sec ================ 23:43:23 (1733805803) === sanity: start cleanup 23:43:24 (1733805804) === Starting client oleg330-client.virtnet: -o user_xattr,flock 192.168.203.130@tcp:/lustre /mnt/lustre2 Started clients oleg330-client.virtnet: 192.168.203.130@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Stopping clients: oleg330-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg330-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 23:43:27 (1733805807) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (497s) == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 23:43:29 (1733805809) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 oleg330-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 23:43:36 (1733805816) === Starting client oleg330-client.virtnet: -o user_xattr,flock 192.168.203.130@tcp:/lustre /mnt/lustre2 Started clients oleg330-client.virtnet: 192.168.203.130@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg330-client.virtnet: executing check_config_client /mnt/lustre oleg330-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg330-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3b96800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012b740800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3b96800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012b740800.idle_timeout=debug disable quota as required oleg330-server: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 23:43:48 (1733805828) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135157 s, 77.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f4995] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 23:43:49 (1733805829) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 23:43:51 (1733805831) -rw-r--r-- 1 root root 0 Dec 9 23:43 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 23:43:53 (1733805833) -rw-r--r-- 1 root root 0 Dec 9 23:43 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (3s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 23:43:56 (1733805836) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 23:43:58 (1733805838) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 23:44:00 (1733805840) total 739 -rwxrwxrwx 1 root root 0 Dec 9 23:43 f2a -rwxrwxrwx 1 root root 0 Dec 9 23:43 f2b -rw-r--r-- 1 root root 1938557 Dec 9 23:35 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Dec 9 23:34 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71394 Dec 9 23:35 ffsx.sanity-dom.fsxlog total 739 -rwxrwxrwx 1 root root 0 Dec 9 23:43 f2a -rwxrwxrwx 1 root root 0 Dec 9 23:43 f2b -rw-r--r-- 1 root root 1938557 Dec 9 23:35 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Dec 9 23:34 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71394 Dec 9 23:35 ffsx.sanity-dom.fsxlog running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.0077666 s, 65.9 kB/s PASS 2e (3s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 23:44:03 (1733805843) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 23:44:04 (1733805844) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.157992 s, 13.3 MB/s /mnt/lustre/f2g.sanityn has 4113 blocks /mnt/lustre2/f2g.sanityn has 4113 blocks PASS 2g (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 23:44:06 (1733805846) PASS 4 (4s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 23:44:10 (1733805850) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 23:44:12 (1733805852) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (3s) == sanityn test 7: remove of open directory on other node ======================================================================= 23:44:15 (1733805855) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 23:44:17 (1733805857) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 23:44:19 (1733805859) PASS 9a (3s) == sanityn test 9b: append to striped sparse file ======== 23:44:22 (1733805862) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172731 s, 60.7 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0167388 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 23:44:24 (1733805864) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00214748 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00429394 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00420815 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00426178 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00311454 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00317832 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00438645 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00286703 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00267672 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00406153 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00293543 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00313181 s, 0.3 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 23:44:26 (1733805866) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00398394 s, 771 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.010425 s, 393 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00028183 s, 10.9 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 23:44:28 (1733805868) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.4995 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (1s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 23:44:30 (1733805870) warning: '-runtime' deprecated, use '-t runtime' instead - link 1617 (time 1733805880.55 total 10.01 last 161.59) - link 3476 (time 1733805890.55 total 20.01 last 185.85) - link 5444 (time 1733805900.56 total 30.01 last 196.76) - link 7559 (time 1733805910.56 total 40.01 last 211.42) - link 9225 (time 1733805920.56 total 50.02 last 166.56) - link 10000 (time 1733805926.69 total 56.15 last 126.41) - link 11066 (time 1733805936.70 total 66.16 last 106.51) - link 12381 (time 1733805946.71 total 76.16 last 131.42) - link 13570 (time 1733805956.71 total 86.17 last 118.83) - link 14830 (time 1733805966.72 total 96.18 last 125.91) total: 15222 link in 100.01 seconds: 152.21 ops/second using seed 3507210239 running for 100 seconds - stat 1845 (time 1733805882 ; total 11 ; last 11) - stat 9328 (time 1733805893 ; total 22 ; last 11) - stat 10000 (time 1733805894 ; total 23 ; last 1) - stat 17744 (time 1733805905 ; total 34 ; last 11) - stat 20000 (time 1733805908 ; total 37 ; last 3) - stat 27250 (time 1733805919 ; total 48 ; last 11) - stat 30000 (time 1733805926 ; total 55 ; last 7) - stat 32444 (time 1733805937 ; total 66 ; last 11) - stat 35241 (time 1733805948 ; total 77 ; last 11) - stat 38080 (time 1733805959 ; total 88 ; last 11) - stat 40000 (time 1733805967 ; total 96 ; last 8) total: 41504 stats in 100 seconds: 415.040009 stats/second - unlinked 0 (time 1733805921 ; total 0 ; last 0) - unlinked 10000 (time 1733806016 ; total 95 ; last 95) unlink(/mnt/lustre2/lockdir/lockfile15222) error: No such file or directory total: 15221 unlinks in 132 seconds: 115.310608 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (18670) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (18673) - No such process PASS 12 (185s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 23:47:35 (1733806055) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.4995 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 19461 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 23:47:37 (1733806057) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 20096 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 23:47:39 (1733806059) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 20729 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 23:47:41 (1733806061) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 21365 Terminated $DIR1/$tdir/sleep 60 PASS 14c (3s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 23:47:44 (1733806064) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 22000 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 23:47:47 (1733806067) fail_loc=0x8000030a PASS 17 (5s) == sanityn test 19: test concurrent uncached read races ========================================================================= 23:47:52 (1733806072) oleg330-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg330-client: oleg330-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 23:47:54 (1733806074) PASS 20 (3s) == sanityn test 23: others should see updated atime while another read============================================================== 23:47:57 (1733806077) now is 1733806078 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.4995 new atime is 1733806139 PASS 23 (64s) == sanityn test 27: align non-overlapping extent locks from request ============================================================= 23:49:01 (1733806141) 4+0 records in 4+0 records out 16793600 bytes (17 MB) copied, 0.209676 s, 80.1 MB/s dd 1 started dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB) copied, 0.606256 s, 25.9 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB) copied, 0.0091313 s, 897 kB/s dd 3 finished PASS 27 (6s) == sanityn test 39a: file mtime does not change after rename ========================================================== 23:49:07 (1733806147) repeat after cancel_lru_locks PASS 39a (3s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 23:49:10 (1733806150) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 23:49:13 (1733806153) repeat after cancel_lru_locks PASS 39c (4s) == sanityn test 39d: sync write should update mtime ====== 23:49:17 (1733806157) fail_loc=0x411 fail_loc=0 PASS 39d (2s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 23:49:19 (1733806159) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00714357 s, 22.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3518: kill: (29020) - No such process PASS 51a (4s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 23:49:23 (1733806163) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0190538 s, 53.7 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 23:49:30 (1733806170) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128004 s, 81.9 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 107a: Basic grouplock conflict =========== 23:49:33 (1733806173) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.111229 s, 94.3 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x280000400:0x3db:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.4995 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.4995 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 23:49:38 (1733806178) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.109473 s, 95.8 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x240000400:0x3dd:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.4995 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) cleanup: ====================================================== == sanityn test complete, duration 378 sec =============== 23:49:47 (1733806187) === sanityn: start cleanup 23:49:48 (1733806188) === Stopping clients: oleg330-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg330-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 23:49:50 (1733806190) === PASS sanityn (384s) == sanity-dom test complete, duration 962 sec ============ 23:49:53 (1733806193) === sanity-dom: start cleanup 23:49:54 (1733806194) === Stopping clients: oleg330-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 23:49:55 (1733806195) ===