-----============= acceptance-small: sanity-dom ============----- Fri Sep 20 13:05:38 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: === sanity-dom: start setup 13:05:45 (1726851945) === Starting client oleg144-client.virtnet: -o user_xattr,flock 192.168.201.144@tcp:/lustre /mnt/lustre2 Started clients oleg144-client.virtnet: 192.168.201.144@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg144-client.virtnet: executing check_config_client /mnt/lustre oleg144-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg144-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5ca8000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8801368b5800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5ca8000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8801368b5800.idle_timeout=debug disable quota as required oleg144-server: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 13:05:58 (1726851958) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7746] 192.168.201.144@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 == sanity-dom test 1: write a file on one mount, truncate on the other, write again ========================================================== 13:05:58 (1726851958) 1+0 records in 1+0 records out 7168 bytes (7.2 kB) copied, 0.00920094 s, 779 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00886258 s, 347 kB/s /mnt/lustre2/f1.sanity-dom has type file OK /mnt/lustre2/f1.sanity-dom has size 6144 OK PASS 1 (2s) == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 13:06:00 (1726851960) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0095327 s, 110 MB/s 1+0 records in 1+0 records out 234852 bytes (235 kB) copied, 0.00222971 s, 105 MB/s 0+1 records in 0+1 records out 234852 bytes (235 kB) copied, 0.0188589 s, 12.5 MB/s /mnt/lustre/f2.sanity-dom_left has type file OK /mnt/lustre/f2.sanity-dom_left has size 234852 OK PASS 2 (2s) == sanity-dom test 3: Truncate over DoM size on different nodes ========================================================== 13:06:02 (1726851962) 1+0 records in 1+0 records out 1048476 bytes (1.0 MB) copied, 0.0190315 s, 55.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0169883 s, 241 kB/s /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049276 OK /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049076 OK /mnt/lustre/f3.sanity-dom has type file OK /mnt/lustre/f3.sanity-dom has size 1049076 OK PASS 3 (3s) == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 13:06:05 (1726851965) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.064213 s, 32.7 MB/s fail_loc=0x80000808 PASS 4 (5s) == sanity-dom test 5: DoM truncate deadlock ============== 13:06:10 (1726851970) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00359952 s, 1.1 MB/s multiop /mnt/lustre/f5.sanity-dom vO_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7746 multiop /mnt/lustre/f5.sanity-dom vO_Tc TMPPIPE=/tmp/multiop_open_wait_pipe.7746 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f5.sanity-dom user.job="dd.0" fail_loc=0x80001415 fail_val=5 PASS 5 (4s) == sanity-dom test 6: Race two writes, check file size === 13:06:14 (1726851974) /mnt/lustre2/f6.sanity-dom has size 500 OK PASS 6 (4s) == sanity-dom test 7: Stale pages after read-on-open ===== 13:06:18 (1726851978) 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00231355 s, 432 kB/s 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00176698 s, 566 kB/s PASS 7 (2s) == sanity-dom test fsx: Dual-mount fsx with DoM files ==== 13:06:20 (1726851980) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 1980 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[0] 1726851980.962132 mapwrite 0x15186f thru 0x154c7a (0x340c bytes) 1726851980.978400 truncate done 1726851980.978642 mmap done 1726851981.025808 msync done 1726851981.025882 munmap done 000002[0] 1726851981.028866 mapwrite 0x199873 thru 0x1a08d0 (0x705e bytes) 1726851981.034573 truncate done 1726851981.034775 mmap done 1726851981.064640 msync done 1726851981.064703 munmap done 000006[0] 1726851981.081851 mapread 0x0dbdd8 thru 0x0ddfae (0x21d7 bytes) 1726851981.082027 mmap done 1726851981.085318 memcpy done 1726851981.085410 munmap done 000008[1] 1726851981.094237 read 0x09ea4a thru 0x0aca77 (0xe02e bytes) 1726851981.141779 read done 000011[0] 1726851981.171584 mapwrite 0x146473 thru 0x15373d (0xd2cb bytes) 1726851981.174541 mmap done 1726851981.205021 msync done 1726851981.205100 munmap done 000013[0] 1726851981.212529 write 0x0a8568 thru 0x0abc09 (0x36a2 bytes) 1726851981.220311 write done 000017[0] 1726851981.238527 mapread 0x1799bd thru 0x17abe3 (0x1227 bytes) 1726851981.238717 mmap done 1726851981.244666 memcpy done 1726851981.244879 munmap done 000020[1] 1726851981.253431 mapwrite 0x100f0d thru 0x1065f0 (0x56e4 bytes) 1726851981.257260 mmap done 1726851981.310507 msync done 1726851981.310880 munmap done 000022[1] 1726851981.323699 mapread 0x184b25 thru 0x192a23 (0xdeff bytes) 1726851981.326778 mmap done 1726851981.334614 memcpy done 1726851981.334739 munmap done 000024[1] 1726851981.351275 write 0x1c1094 thru 0x1cd170 (0xc0dd bytes) 1726851981.351964 write done 000027[0] 1726851981.374326 read 0x08936a thru 0x0926f5 (0x938c bytes) 1726851981.378981 read done truncating to largest ever: 0x10ba54 000029[0] 1726851981.396625 trunc from 0x1cd171 to 0x10ba53 (0xc171d bytes) 1726851981.423685 truncate done 000030[1] 1726851981.441972 write 0x1165b6 thru 0x11ed8c (0x87d7 bytes) 1726851981.448883 write done 000031[1] 1726851981.457124 mapread 0x088634 thru 0x097ca2 (0xf66f bytes) 1726851981.460466 mmap done 1726851981.480043 memcpy done 1726851981.480178 munmap done 000032[1] 1726851981.493042 write 0x08a874 thru 0x0940db (0x9868 bytes) 1726851981.511764 write done truncating to largest ever: 0x14e126 000033[1] 1726851981.512235 trunc from 0x11ed8d to 0x14e125 (0x2f399 bytes) 1726851981.524679 truncate done 000034[0] 1726851981.527931 mapwrite 0x0abeac thru 0x0b23dd (0x6532 bytes) 1726851981.532542 mmap done 1726851981.639958 msync done 1726851981.640101 munmap done 000035[0] 1726851981.647313 write 0x0d9f7e thru 0x0e5eac (0xbf2f bytes) 1726851981.648214 write done 000036[0] 1726851981.659303 read 0x08595d thru 0x089e7f (0x4523 bytes) 1726851981.673390 read done 000039[0] 1726851981.696431 write 0x09ba2c thru 0x0aad3f (0xf314 bytes) 1726851981.697218 write done 000040[1] 1726851981.704008 write 0x178ae7 thru 0x18515f (0xc679 bytes) 1726851981.704789 write done 000041[1] 1726851981.710509 mapwrite 0x05be60 thru 0x05fa56 (0x3bf7 bytes) 1726851981.713428 mmap done 1726851981.769717 msync done 1726851981.769870 munmap done 000044[1] 1726851981.781094 read 0x0a7520 thru 0x0a7e70 (0x951 bytes) 1726851981.795635 read done 000045[1] 1726851981.804872 write 0x12239e thru 0x12aed6 (0x8b39 bytes) 1726851981.806232 write done 000049[0] 1726851981.840320 mapwrite 0x13349f thru 0x1334d9 (0x3b bytes) 1726851981.845634 mmap done 1726851981.899583 msync done 1726851981.900786 munmap done 000053[1] 1726851981.932057 mapwrite 0x195401 thru 0x1a310b (0xdd0b bytes) 1726851981.944183 truncate done 1726851981.944351 mmap done 1726851981.984279 msync done 1726851981.984454 munmap done 000054[1] 1726851981.986713 trunc from 0x1a310c to 0x06b35b (0x137db0 bytes) 1726851981.993230 truncate done 000055[0] 1726851982.003554 write 0x06e8c3 thru 0x070396 (0x1ad4 bytes) 1726851982.011552 write done 000058[1] 1726851982.035921 mapread 0x0510e6 thru 0x059de7 (0x8d02 bytes) 1726851982.039794 mmap done 1726851982.063235 memcpy done 1726851982.063417 munmap done 000059[1] 1726851982.063765 mapread 0x00b201 thru 0x01753f (0xc33f bytes) 1726851982.063923 mmap done 1726851982.094940 memcpy done 1726851982.095124 munmap done 000062[1] 1726851982.117217 mapwrite 0x15ca08 thru 0x16bc10 (0xf209 bytes) 1726851982.131583 truncate done 1726851982.131790 mmap done 1726851982.258281 msync done 1726851982.258423 munmap done 000063[0] 1726851982.275067 write 0x0c263b thru 0x0cd20f (0xabd5 bytes) 1726851982.281139 write done 000064[0] 1726851982.292634 mapread 0x03bbb8 thru 0x046845 (0xac8e bytes) 1726851982.297971 mmap done 1726851982.335954 memcpy done 1726851982.336043 munmap done 000067[0] 1726851982.363819 mapwrite 0x10b182 thru 0x115302 (0xa181 bytes) 1726851982.368441 mmap done 1726851982.420214 msync done 1726851982.420331 munmap done 000068[0] 1726851982.429518 mapread 0x100ff3 thru 0x107034 (0x6042 bytes) 1726851982.429776 mmap done 1726851982.429871 memcpy done 1726851982.429910 munmap done 000069[1] 1726851982.430344 write 0x0b9b24 thru 0x0bb01c (0x14f9 bytes) 1726851982.446341 write done 000071[0] 1726851982.464224 mapread 0x06e836 thru 0x077a4a (0x9215 bytes) 1726851982.468863 mmap done 1726851982.504967 memcpy done 1726851982.505515 munmap done 000072[0] 1726851982.514107 trunc from 0x16bc11 to 0x0f7c44 (0x73fcc bytes) 1726851982.528992 truncate done 000073[1] 1726851982.532589 write 0x199984 thru 0x19b90d (0x1f8a bytes) 1726851982.537440 write done 000075[1] 1726851982.552905 mapwrite 0x0fbf32 thru 0x0feea6 (0x2f75 bytes) 1726851982.555539 mmap done 1726851982.594109 msync done 1726851982.594338 munmap done 000077[0] 1726851982.609637 trunc from 0x19b90e to 0x05d205 (0x13e708 bytes) 1726851982.629681 truncate done 000080[1] 1726851982.644835 write 0x1d3950 thru 0x1daa15 (0x70c6 bytes) 1726851982.650869 write done 000085[1] 1726851982.690367 write 0x06d864 thru 0x07b156 (0xd8f3 bytes) 1726851982.702746 write done 000087[0] 1726851982.723857 mapwrite 0x0c69b2 thru 0x0d2663 (0xbcb2 bytes) 1726851982.729103 mmap done 1726851982.913755 msync done 1726851982.913999 munmap done 000091[0] 1726851982.948679 read 0x1a0cee thru 0x1a2ce3 (0x1ff6 bytes) 1726851982.978789 read done 000093[1] 1726851982.987478 mapread 0x0ff6be thru 0x10c4a1 (0xcde4 bytes) 1726851982.993682 mmap done 1726851983.036642 memcpy done 1726851983.038043 munmap done 000095[0] 1726851983.042641 mapread 0x1ac487 thru 0x1b1a2e (0x55a8 bytes) 1726851983.042810 mmap done 1726851983.042873 memcpy done 1726851983.042894 munmap done 000097[1] 1726851983.043486 trunc from 0x1daa16 to 0x0c31e5 (0x117830 bytes) 1726851983.065107 truncate done 000098[1] 1726851983.083444 read 0x012a01 thru 0x01855d (0x5b5d bytes) 1726851983.096771 read done 000099[1] 1726851983.100608 mapwrite 0x0b09fb thru 0x0be024 (0xd62a bytes) 1726851983.101001 mmap done 1726851983.131579 msync done 1726851983.131648 munmap done 000100[0] 1726851983.141181 mapwrite 0x08ff39 thru 0x09f97f (0xfa47 bytes) 1726851983.145706 mmap done 1726851983.221537 msync done 1726851983.221599 munmap done 000101[0] 1726851983.228817 mapread 0x049d82 thru 0x0561b1 (0xc430 bytes) 1726851983.232027 mmap done 1726851983.258876 memcpy done 1726851983.259075 munmap done 000104[1] 1726851983.280412 mapwrite 0x0962fe thru 0x09d249 (0x6f4c bytes) 1726851983.284000 mmap done 1726851983.329905 msync done 1726851983.329993 munmap done 000105[1] 1726851983.337508 mapread 0x085dfb thru 0x08aaef (0x4cf5 bytes) 1726851983.337708 mmap done 1726851983.351698 memcpy done 1726851983.351846 munmap done 000106[1] 1726851983.365994 mapread 0x04a47b thru 0x05220a (0x7d90 bytes) 1726851983.366241 mmap done 1726851983.400860 memcpy done 1726851983.401039 munmap done 000107[1] 1726851983.414097 read 0x0adf09 thru 0x0b6bac (0x8ca4 bytes) 1726851983.430875 read done 000108[0] 1726851983.443204 read 0x084f2f thru 0x0897d3 (0x48a5 bytes) 1726851983.470957 read done 000110[0] 1726851983.490519 mapread 0x071596 thru 0x07d6b1 (0xc11c bytes) 1726851983.498861 mmap done 1726851983.498977 memcpy done 1726851983.499834 munmap done 000112[0] 1726851983.519875 trunc from 0x0c31e6 to 0x1126e4 (0x4f4ff bytes) 1726851983.544311 truncate done truncating to largest ever: 0x1ba55d 000113[0] 1726851983.558612 trunc from 0x1126e5 to 0x1ba55c (0xa7e78 bytes) 1726851983.572715 truncate done 000114[0] 1726851983.589750 mapwrite 0x1a6163 thru 0x1b48fb (0xe799 bytes) 1726851983.590188 mmap done 1726851983.638650 msync done 1726851983.638735 munmap done 000115[0] 1726851983.650544 read 0x0e69b7 thru 0x0e8fee (0x2638 bytes) 1726851983.650687 read done 000126[1] 1726851983.686121 mapread 0x1a9f76 thru 0x1b3e48 (0x9ed3 bytes) 1726851983.689804 mmap done 1726851983.716663 memcpy done 1726851983.716946 munmap done 000127[0] 1726851983.724938 write 0x134741 thru 0x140f05 (0xc7c5 bytes) 1726851983.744084 write done 000128[1] 1726851983.744460 mapwrite 0x04be49 thru 0x052e21 (0x6fd9 bytes) 1726851983.748768 mmap done 1726851983.795923 msync done 1726851983.795982 munmap done 000129[0] 1726851983.805888 mapread 0x16dbcb thru 0x175fae (0x83e4 bytes) 1726851983.810189 mmap done 1726851983.810325 memcpy done 1726851983.810643 munmap done 000132[1] 1726851983.833506 write 0x1738cc thru 0x17ebe3 (0xb318 bytes) 1726851983.861800 write done 000133[1] 1726851983.872219 read 0x0d4071 thru 0x0db647 (0x75d7 bytes) 1726851983.872347 read done 000135[1] 1726851983.894999 mapwrite 0x00536a thru 0x00e041 (0x8cd8 bytes) 1726851983.895285 mmap done 1726851983.931505 msync done 1726851983.931588 munmap done 000137[1] 1726851983.932194 trunc from 0x1ba55d to 0x0c9f95 (0xf05c7 bytes) 1726851983.939665 truncate done 000138[1] 1726851983.957843 mapread 0x077aed thru 0x0849d9 (0xceed bytes) 1726851983.958131 mmap done 1726851983.959004 memcpy done 1726851983.959237 munmap done 000142[1] 1726851983.972253 mapwrite 0x0c7255 thru 0x0d2c18 (0xb9c4 bytes) 1726851983.986454 truncate done 1726851983.986935 mmap done 1726851984.053266 msync done 1726851984.053444 munmap done 000145[0] 1726851984.073864 mapread 0x032d06 thru 0x038927 (0x5c22 bytes) 1726851984.077865 mmap done 1726851984.101929 memcpy done 1726851984.102032 munmap done 000146[1] 1726851984.105682 mapwrite 0x0e11d3 thru 0x0e1e08 (0xc36 bytes) 1726851984.118087 truncate done 1726851984.118296 mmap done 1726851984.150363 msync done 1726851984.150477 munmap done 000148[0] 1726851984.152687 trunc from 0x0e1e09 to 0x1862d6 (0xa44ce bytes) 1726851984.169937 truncate done 000149[0] 1726851984.171842 read 0x12ae9f thru 0x139345 (0xe4a7 bytes) 1726851984.187788 read done truncating to largest ever: 0x1d8a31 000151[0] 1726851984.203131 trunc from 0x1862d7 to 0x1d8a30 (0x5275a bytes) 1726851984.210636 truncate done 000152[0] 1726851984.222809 mapread 0x190b06 thru 0x196fb6 (0x64b1 bytes) 1726851984.223095 mmap done 1726851984.230769 memcpy done 1726851984.230991 munmap done 000156[0] 1726851984.252744 trunc from 0x1d8a31 to 0x1461fa (0x92836 bytes) 1726851984.261409 truncate done 000157[0] 1726851984.271739 mapread 0x05a816 thru 0x065d8d (0xb578 bytes) 1726851984.272011 mmap done 1726851984.272126 memcpy done 1726851984.272576 munmap done 000159[1] 1726851984.300245 trunc from 0x1461fb to 0x0e32e9 (0x62f11 bytes) 1726851984.320991 truncate done 000161[1] 1726851984.324343 mapwrite 0x073052 thru 0x07ab8a (0x7b39 bytes) 1726851984.325109 mmap done 1726851984.376126 msync done 1726851984.376392 munmap done 000162[1] 1726851984.376893 mapread 0x09bd02 thru 0x0a68c6 (0xabc5 bytes) 1726851984.377059 mmap done 1726851984.404449 memcpy done 1726851984.404705 munmap done 000163[1] 1726851984.405232 mapwrite 0x0bc2b4 thru 0x0bd11e (0xe6b bytes) 1726851984.405393 mmap done 1726851984.442557 msync done 1726851984.442739 munmap done 000164[0] 1726851984.455364 mapwrite 0x0b5343 thru 0x0be2bd (0x8f7b bytes) 1726851984.459411 mmap done 1726851984.514497 msync done 1726851984.514744 munmap done 000165[1] 1726851984.522329 write 0x00de77 thru 0x01b559 (0xd6e3 bytes) 1726851984.533006 write done 000166[0] 1726851984.533629 write 0x1d7f0f thru 0x1db93b (0x3a2d bytes) 1726851984.539868 write done 000167[1] 1726851984.550316 write 0x1cf956 thru 0x1da2cb (0xa976 bytes) 1726851984.566331 write done 000168[0] 1726851984.567231 read 0x14a2b8 thru 0x152d1e (0x8a67 bytes) 1726851984.601491 read done 000170[1] 1726851984.619106 trunc from 0x1db93c to 0x1d4bd5 (0x6d66 bytes) 1726851984.635405 truncate done 000171[1] 1726851984.645302 trunc from 0x1d4bd6 to 0x1a423c (0x30999 bytes) 1726851984.651978 truncate done 000177[0] 1726851984.693187 mapwrite 0x0a34b2 thru 0x0a37b4 (0x303 bytes) 1726851984.701054 mmap done 1726851984.762031 msync done 1726851984.762274 munmap done 000178[1] 1726851984.778862 mapread 0x024c0a thru 0x0278ad (0x2ca4 bytes) 1726851984.785518 mmap done 1726851984.806968 memcpy done 1726851984.807135 munmap done 000179[0] 1726851984.828127 write 0x092b7e thru 0x097573 (0x49f6 bytes) 1726851984.843725 write done 000180[0] 1726851984.854180 read 0x14912c thru 0x151ef4 (0x8dc9 bytes) 1726851984.890882 read done 000182[1] 1726851984.902781 trunc from 0x1a423d to 0x05091b (0x153921 bytes) 1726851984.947105 truncate done 000183[1] 1726851984.959055 mapwrite 0x178eb5 thru 0x182b83 (0x9ccf bytes) 1726851984.966361 truncate done 1726851984.966541 mmap done 1726851985.068940 msync done 1726851985.069900 munmap done 000184[0] 1726851985.072791 mapread 0x17b3ce thru 0x1829cf (0x7602 bytes) 1726851985.077829 mmap done 1726851985.109666 memcpy done 1726851985.109823 munmap done 000185[0] 1726851985.112199 mapread 0x0afdf8 thru 0x0b1333 (0x153c bytes) 1726851985.117369 mmap done 1726851985.133304 memcpy done 1726851985.133804 munmap done 000186[0] 1726851985.136506 mapwrite 0x0e3f9c thru 0x0e8af9 (0x4b5e bytes) 1726851985.136723 mmap done 1726851985.231594 msync done 1726851985.232158 munmap done 000189[0] 1726851985.277536 trunc from 0x182b84 to 0x0c5913 (0xbd270 bytes) 1726851985.301940 truncate done 000193[1] 1726851985.317290 mapwrite 0x094b0d thru 0x0a312c (0xe620 bytes) 1726851985.324954 mmap done 1726851985.449426 msync done 1726851985.449650 munmap done 000196[1] 1726851985.478831 read 0x0153a1 thru 0x021dbb (0xca1b bytes) 1726851985.492485 read done 000197[0] 1726851985.506092 mapwrite 0x1ce251 thru 0x1dc93b (0xe6eb bytes) 1726851985.526106 truncate done 1726851985.526312 mmap done 1726851985.596116 msync done 1726851985.598469 munmap done 000198[0] 1726851985.602375 write 0x041f31 thru 0x0432b6 (0x1386 bytes) 1726851985.609117 write done 000199[0] 1726851985.626473 mapwrite 0x18d6e2 thru 0x19974d (0xc06c bytes) 1726851985.626777 mmap done 1726851985.715204 msync done 1726851985.715738 munmap done 000201[1] 1726851985.731726 write 0x013306 thru 0x01be36 (0x8b31 bytes) 1726851985.749566 write done 000202[1] 1726851985.762725 write 0x07fccf thru 0x086d0a (0x703c bytes) 1726851985.769937 write done 000203[1] 1726851985.777423 trunc from 0x1dc93c to 0x101e68 (0xdaad3 bytes) 1726851985.797089 truncate done 000207[0] 1726851985.846862 trunc from 0x101e69 to 0x0d324d (0x2ec1b bytes) 1726851985.879774 truncate done 000210[1] 1726851985.906494 mapread 0x0cb4c6 thru 0x0ccd30 (0x186b bytes) 1726851985.911413 mmap done 1726851985.922104 memcpy done 1726851985.922299 munmap done 000212[0] 1726851985.935354 trunc from 0x0d324e to 0x007e87 (0xcb3c6 bytes) 1726851985.957787 truncate done 000214[1] 1726851985.982126 write 0x15bd49 thru 0x164dfe (0x90b6 bytes) 1726851985.989743 write done 000217[1] 1726851986.029722 mapwrite 0x108bdd thru 0x10bfc2 (0x33e6 bytes) 1726851986.037214 mmap done 1726851986.124027 msync done 1726851986.124170 munmap done 000218[0] 1726851986.135712 mapwrite 0x0f8e4e thru 0x1040ae (0xb261 bytes) 1726851986.141544 mmap done 1726851986.315695 msync done 1726851986.315839 munmap done 000219[0] 1726851986.319711 trunc from 0x164dff to 0x098719 (0xcc6e5 bytes) 1726851986.331905 truncate done 000220[0] 1726851986.348844 mapwrite 0x037ae4 thru 0x039669 (0x1b86 bytes) 1726851986.349144 mmap done 1726851986.397966 msync done 1726851986.398419 munmap done 000223[0] 1726851986.417262 mapread 0x00d683 thru 0x0160c2 (0x8a40 bytes) 1726851986.417550 mmap done 1726851986.454832 memcpy done 1726851986.455431 munmap done 000225[0] 1726851986.456887 write 0x01072c thru 0x019a85 (0x935a bytes) 1726851986.461331 write done 000226[1] 1726851986.465036 read 0x04a55b thru 0x052002 (0x7aa8 bytes) 1726851986.501827 read done 000227[1] 1726851986.509535 write 0x06dd4b thru 0x0710b7 (0x336d bytes) 1726851986.516961 write done 000229[1] 1726851986.537966 read 0x075c30 thru 0x079f96 (0x4367 bytes) 1726851986.555025 read done 000231[0] 1726851986.586720 write 0x173672 thru 0x1744c0 (0xe4f bytes) 1726851986.587244 write done 000232[1] 1726851986.597047 mapwrite 0x1e0209 thru 0x1ef21d (0xf015 bytes) 1726851986.631768 truncate done 1726851986.631937 mmap done 1726851986.737608 msync done 1726851986.737722 munmap done 000233[0] 1726851986.749967 mapread 0x156376 thru 0x165a1c (0xf6a7 bytes) 1726851986.757777 mmap done 1726851986.825191 memcpy done 1726851986.825373 munmap done 000234[0] 1726851986.836001 read 0x04b3d8 thru 0x0522b6 (0x6edf bytes) 1726851986.899472 read done 000241[1] 1726851986.908644 mapread 0x171af2 thru 0x171bce (0xdd bytes) 1726851986.908850 mmap done 1726851986.913199 memcpy done 1726851986.913709 munmap done 000245[0] 1726851986.915269 trunc from 0x1ef21e to 0x1c09c5 (0x2e858 bytes) 1726851986.943064 truncate done 000246[0] 1726851986.948835 mapwrite 0x1f09b8 thru 0x1fffff (0xf648 bytes) 1726851986.956473 truncate done 1726851986.956665 mmap done 1726851987.024719 msync done 1726851987.024966 munmap done 000248[1] 1726851987.051201 write 0x024207 thru 0x033198 (0xef92 bytes) 1726851987.072723 write done 000251[0] 1726851987.106873 write 0x046909 thru 0x05103c (0xa734 bytes) 1726851987.125207 write done 000252[1] 1726851987.139491 mapwrite 0x086285 thru 0x08f941 (0x96bd bytes) 1726851987.145744 mmap done 1726851987.244651 msync done 1726851987.244928 munmap done 000254[0] 1726851987.284225 mapwrite 0x125a93 thru 0x1342d7 (0xe845 bytes) 1726851987.288505 mmap done 1726851987.406324 msync done 1726851987.406444 munmap done 000255[1] 1726851987.418782 mapwrite 0x128210 thru 0x135cb7 (0xdaa8 bytes) 1726851987.424989 mmap done 1726851987.543766 msync done 1726851987.543881 munmap done 000257[1] 1726851987.568272 write 0x1d785d thru 0x1df06f (0x7813 bytes) 1726851987.576813 write done 000258[0] 1726851987.593337 trunc from 0x200000 to 0x0413b5 (0x1bec4a bytes) 1726851987.623105 truncate done 000259[1] 1726851987.626447 read 0x0080b2 thru 0x014a90 (0xc9df bytes) 1726851987.639518 read done 000260[1] 1726851987.643311 read 0x001058 thru 0x00a132 (0x90db bytes) 1726851987.643515 read done 000268[0] 1726851987.697367 write 0x191420 thru 0x19c58c (0xb16d bytes) 1726851987.698794 write done 000269[1] 1726851987.707669 trunc from 0x19c58d to 0x159542 (0x4304a bytes) 1726851987.736998 truncate done 000271[1] 1726851987.740839 read 0x0e41b1 thru 0x0e923b (0x508b bytes) 1726851987.755200 read done 000272[1] 1726851987.755627 mapread 0x00ae3a thru 0x00b7a3 (0x96a bytes) 1726851987.755797 mmap done 1726851987.755835 memcpy done 1726851987.755966 munmap done 000273[0] 1726851987.756318 write 0x03a667 thru 0x03fee9 (0x5883 bytes) 1726851987.772908 write done 000275[1] 1726851987.799139 mapread 0x02af2b thru 0x03a892 (0xf968 bytes) 1726851987.803623 mmap done 1726851987.852514 memcpy done 1726851987.852696 munmap done 000277[0] 1726851987.863061 trunc from 0x159543 to 0x1cdc4a (0x74708 bytes) 1726851987.894103 truncate done 000278[0] 1726851987.898964 mapread 0x100192 thru 0x102ebd (0x2d2c bytes) 1726851987.899169 mmap done 1726851987.915431 memcpy done 1726851987.915644 munmap done 000282[1] 1726851987.946130 write 0x17e960 thru 0x182c20 (0x42c1 bytes) 1726851987.959838 write done 000283[1] 1726851987.970913 mapread 0x09430a thru 0x09ee44 (0xab3b bytes) 1726851987.973979 mmap done 1726851988.023002 memcpy done 1726851988.023288 munmap done 000285[0] 1726851988.024118 write 0x08f92e thru 0x09c94e (0xd021 bytes) 1726851988.032292 write done 000287[0] 1726851988.049590 read 0x1c3dc6 thru 0x1cbfb3 (0x81ee bytes) 1726851988.086026 read done 000288[1] 1726851988.086457 write 0x17cf04 thru 0x18ce54 (0xff51 bytes) 1726851988.097682 write done 000289[1] 1726851988.107807 mapread 0x0e5ec7 thru 0x0f45bc (0xe6f6 bytes) 1726851988.111633 mmap done 1726851988.170016 memcpy done 1726851988.170230 munmap done 000290[0] 1726851988.180983 trunc from 0x1cdc4b to 0x0edaec (0xe015e bytes) 1726851988.207645 truncate done truncating to largest ever: 0x1fb514 000298[0] 1726851988.277565 trunc from 0x0edaed to 0x1fb513 (0x10da27 bytes) 1726851988.284657 truncate done 000301[1] 1726851988.299693 mapread 0x02eacb thru 0x034dc0 (0x62f6 bytes) 1726851988.305499 mmap done 1726851988.342282 memcpy done 1726851988.343196 munmap done 000304[1] 1726851988.360648 read 0x130698 thru 0x138bb3 (0x851c bytes) 1726851988.399790 read done 000305[1] 1726851988.400178 mapread 0x1b8c42 thru 0x1c040f (0x77ce bytes) 1726851988.400545 mmap done 1726851988.400840 memcpy done 1726851988.400989 munmap done 000308[1] 1726851988.405236 write 0x18dda6 thru 0x193313 (0x556e bytes) 1726851988.416901 write done 000310[0] 1726851988.426584 write 0x027e5f thru 0x034427 (0xc5c9 bytes) 1726851988.440687 write done 000313[1] 1726851988.463666 write 0x107c88 thru 0x10f935 (0x7cae bytes) 1726851988.472540 write done 000314[1] 1726851988.481795 mapread 0x0c9d34 thru 0x0cb3db (0x16a8 bytes) 1726851988.487481 mmap done 1726851988.505560 memcpy done 1726851988.505759 munmap done 000317[0] 1726851988.521514 mapread 0x0882ef thru 0x08f68e (0x73a0 bytes) 1726851988.525735 mmap done 1726851988.545645 memcpy done 1726851988.545806 munmap done 000318[0] 1726851988.546177 read 0x00e3e2 thru 0x00eda7 (0x9c6 bytes) 1726851988.559885 read done 000319[0] 1726851988.560404 mapwrite 0x0178a3 thru 0x024733 (0xce91 bytes) 1726851988.564525 mmap done 1726851988.645095 msync done 1726851988.645314 munmap done 000322[0] 1726851988.671973 trunc from 0x1fb514 to 0x024d4f (0x1d67c4 bytes) 1726851988.688634 truncate done 000323[1] 1726851988.700774 trunc from 0x024d50 to 0x1d0535 (0x1ab7e6 bytes) 1726851988.717655 truncate done 000326[0] 1726851988.722026 mapread 0x10b31b thru 0x1142bf (0x8fa5 bytes) 1726851988.725400 mmap done 1726851988.752124 memcpy done 1726851988.752653 munmap done 000330[0] 1726851988.776440 trunc from 0x1d0536 to 0x0e219c (0xee399 bytes) 1726851988.799823 truncate done 000332[0] 1726851988.829198 read 0x0ac1ac thru 0x0ac545 (0x39a bytes) 1726851988.850872 read done 000333[0] 1726851988.862060 mapread 0x08069a thru 0x09005d (0xf9c4 bytes) 1726851988.862731 mmap done 1726851988.862857 memcpy done 1726851988.863126 munmap done 000336[0] 1726851988.881778 read 0x00e213 thru 0x018794 (0xa582 bytes) 1726851988.881958 read done 000339[0] 1726851988.906312 mapread 0x08a647 thru 0x08ecb8 (0x4672 bytes) 1726851988.906578 mmap done 1726851988.906783 memcpy done 1726851988.906996 munmap done 000340[1] 1726851988.907428 read 0x014b55 thru 0x020733 (0xbbdf bytes) 1726851988.934401 read done 000341[1] 1726851988.936799 mapwrite 0x1f2c6a thru 0x1f936d (0x6704 bytes) 1726851988.959707 truncate done 1726851988.959946 mmap done 1726851989.036142 msync done 1726851989.036578 munmap done 000344[1] 1726851989.071021 trunc from 0x1f936e to 0x1bb313 (0x3e05a bytes) 1726851989.079821 truncate done 000345[1] 1726851989.082675 read 0x17b1db thru 0x1896fe (0xe524 bytes) 1726851989.082829 read done 000346[0] 1726851989.109231 read 0x15b408 thru 0x16275c (0x7355 bytes) 1726851989.149748 read done 000348[1] 1726851989.166412 read 0x18a092 thru 0x18a1ea (0x159 bytes) 1726851989.184906 read done 000349[0] 1726851989.185767 mapwrite 0x00ebc3 thru 0x0192e0 (0xa71e bytes) 1726851989.197365 mmap done 1726851989.267566 msync done 1726851989.267769 munmap done 000350[0] 1726851989.268114 mapread 0x082d55 thru 0x08ccfa (0x9fa6 bytes) 1726851989.268298 mmap done 1726851989.268468 memcpy done 1726851989.268542 munmap done 000352[0] 1726851989.283941 write 0x12a4e2 thru 0x12e545 (0x4064 bytes) 1726851989.304471 write done 000353[1] 1726851989.314693 write 0x1647b9 thru 0x1673d5 (0x2c1d bytes) 1726851989.331802 write done 000355[0] 1726851989.355398 mapread 0x021a44 thru 0x02c38a (0xa947 bytes) 1726851989.360423 mmap done 1726851989.360517 memcpy done 1726851989.360836 munmap done 000360[0] 1726851989.409693 mapwrite 0x1008d2 thru 0x109e28 (0x9557 bytes) 1726851989.414624 mmap done 1726851989.492258 msync done 1726851989.492917 munmap done 000365[0] 1726851989.522705 mapread 0x0b93f0 thru 0x0bf6c5 (0x62d6 bytes) 1726851989.522901 mmap done 1726851989.522956 memcpy done 1726851989.523109 munmap done 000366[1] 1726851989.523803 write 0x116863 thru 0x11af54 (0x46f2 bytes) 1726851989.533471 write done 000367[0] 1726851989.540519 write 0x1a8812 thru 0x1ac14f (0x393e bytes) 1726851989.552213 write done 000368[1] 1726851989.552524 mapwrite 0x11061d thru 0x11e481 (0xde65 bytes) 1726851989.556228 mmap done 1726851989.662056 msync done 1726851989.662129 munmap done 000369[0] 1726851989.667491 mapread 0x094d0c thru 0x0a43d7 (0xf6cc bytes) 1726851989.671083 mmap done 1726851989.671268 memcpy done 1726851989.671307 munmap done 000370[1] 1726851989.678325 read 0x0e6bfd thru 0x0eb22c (0x4630 bytes) 1726851989.709760 read done 000373[1] 1726851989.710589 mapwrite 0x0757ab thru 0x084a1a (0xf270 bytes) 1726851989.711135 mmap done 1726851989.801645 msync done 1726851989.801894 munmap done 000374[1] 1726851989.811232 read 0x08cba4 thru 0x09845a (0xb8b7 bytes) 1726851989.833626 read done 000375[0] 1726851989.845254 mapread 0x1711ea thru 0x17e4c2 (0xd2d9 bytes) 1726851989.849709 mmap done 1726851989.898111 memcpy done 1726851989.898357 munmap done 000376[0] 1726851989.910827 read 0x04ecad thru 0x059def (0xb143 bytes) 1726851989.938854 read done 000379[1] 1726851989.943239 read 0x0a590c thru 0x0b1bd1 (0xc2c6 bytes) 1726851989.964844 read done 000383[1] 1726851989.966035 read 0x11928c thru 0x11be8b (0x2c00 bytes) 1726851989.966125 read done 000384[0] 1726851989.966418 mapread 0x0fb129 thru 0x109cf1 (0xebc9 bytes) 1726851989.966568 mmap done 1726851989.966657 memcpy done 1726851989.966937 munmap done 000385[1] 1726851989.967208 write 0x167397 thru 0x16acaa (0x3914 bytes) 1726851989.985237 write done 000387[1] 1726851990.010633 write 0x1d6c8d thru 0x1dfde6 (0x915a bytes) 1726851990.011281 write done 000388[0] 1726851990.011566 trunc from 0x1dfde7 to 0x08c915 (0x1534d1 bytes) 1726851990.052326 truncate done 000394[1] 1726851990.092086 trunc from 0x08c916 to 0x157d8c (0xcb477 bytes) 1726851990.117192 truncate done 000395[0] 1726851990.132091 mapread 0x03ce18 thru 0x044560 (0x7749 bytes) 1726851990.138027 mmap done 1726851990.178506 memcpy done 1726851990.178930 munmap done 000396[1] 1726851990.188817 mapwrite 0x00a1f3 thru 0x01298c (0x879a bytes) 1726851990.191990 mmap done 1726851990.264389 msync done 1726851990.264557 munmap done 000397[1] 1726851990.270392 read 0x05d020 thru 0x06cfd0 (0xffb1 bytes) 1726851990.286961 read done 000400[0] 1726851990.300619 mapread 0x0b46ef thru 0x0b6fc2 (0x28d4 bytes) 1726851990.304861 mmap done 1726851990.337783 memcpy done 1726851990.338569 munmap done 000401[1] 1726851990.342086 trunc from 0x157d8d to 0x1241c9 (0x33bc3 bytes) 1726851990.357491 truncate done 000403[0] 1726851990.360527 mapwrite 0x1f42f0 thru 0x1f6a6c (0x277d bytes) 1726851990.386306 truncate done 1726851990.388284 mmap done 1726851990.436784 msync done 1726851990.436995 munmap done 000405[0] 1726851990.439998 trunc from 0x1f6a6d to 0x1e1b2f (0x14f3d bytes) 1726851990.445195 truncate done 000406[1] 1726851990.447823 mapwrite 0x0883df thru 0x08cdec (0x4a0e bytes) 1726851990.452169 mmap done 1726851990.519887 msync done 1726851990.519979 munmap done 000407[1] 1726851990.540471 mapwrite 0x025745 thru 0x02e2df (0x8b9b bytes) 1726851990.546932 mmap done 1726851990.615693 msync done 1726851990.615828 munmap done 000408[0] 1726851990.626889 read 0x04c78f thru 0x056268 (0x9ada bytes) 1726851990.665390 read done 000409[0] 1726851990.665885 write 0x0250e8 thru 0x030687 (0xb5a0 bytes) 1726851990.687008 write done 000410[1] 1726851990.687363 mapread 0x0d6778 thru 0x0e29bb (0xc244 bytes) 1726851990.692981 mmap done 1726851990.793618 memcpy done 1726851990.793974 munmap done 000411[0] 1726851990.803629 read 0x1cbd31 thru 0x1d59d1 (0x9ca1 bytes) 1726851990.803796 read done 000415[0] 1726851990.842587 write 0x1616b2 thru 0x163adc (0x242b bytes) 1726851990.842947 write done 000418[1] 1726851990.853297 trunc from 0x1e1b30 to 0x04e7a4 (0x19338b bytes) 1726851990.882409 truncate done 000419[0] 1726851990.904053 trunc from 0x04e7a5 to 0x15ce10 (0x10e66c bytes) 1726851990.929834 truncate done 000420[0] 1726851990.933036 mapread 0x113d37 thru 0x11d624 (0x98ee bytes) 1726851990.933438 mmap done 1726851990.949098 memcpy done 1726851990.950181 munmap done 000421[0] 1726851990.964335 write 0x171477 thru 0x17dec8 (0xca52 bytes) 1726851990.964973 write done 000423[0] 1726851990.965521 write 0x0a458d thru 0x0b128c (0xcd00 bytes) 1726851990.966023 write done 000426[0] 1726851990.978118 trunc from 0x17dec9 to 0x17bbf7 (0x22d1 bytes) 1726851990.989710 truncate done 000427[0] 1726851990.992933 trunc from 0x17bbf8 to 0x0af4a0 (0xcc757 bytes) 1726851991.001699 truncate done 000428[0] 1726851991.013777 read 0x04324c thru 0x048351 (0x5106 bytes) 1726851991.013958 read done 000432[1] 1726851991.030448 read 0x012183 thru 0x01a7b7 (0x8635 bytes) 1726851991.060255 read done 000433[1] 1726851991.068656 write 0x028b25 thru 0x034ddf (0xc2bb bytes) 1726851991.080618 write done 000437[1] 1726851991.126520 write 0x1e2e48 thru 0x1f1845 (0xe9fe bytes) 1726851991.135560 write done 000438[1] 1726851991.135909 read 0x084acf thru 0x08a59f (0x5ad1 bytes) 1726851991.157454 read done 000439[1] 1726851991.168974 mapwrite 0x16c115 thru 0x179ad5 (0xd9c1 bytes) 1726851991.169581 mmap done 1726851991.237244 msync done 1726851991.237481 munmap done 000442[0] 1726851991.269726 read 0x0869d4 thru 0x08f770 (0x8d9d bytes) 1726851991.300499 read done 000443[1] 1726851991.308325 mapread 0x099b57 thru 0x09bccc (0x2176 bytes) 1726851991.310135 mmap done 1726851991.314734 memcpy done 1726851991.314890 munmap done 000447[0] 1726851991.334259 read 0x0b0269 thru 0x0b39e2 (0x377a bytes) 1726851991.353884 read done 000451[1] 1726851991.354908 mapwrite 0x02c166 thru 0x03a914 (0xe7af bytes) 1726851991.355182 mmap done 1726851991.438410 msync done 1726851991.438596 munmap done 000453[0] 1726851991.450040 trunc from 0x1f1846 to 0x1c152f (0x30316 bytes) 1726851991.483510 truncate done 000462[0] 1726851991.532371 trunc from 0x1c1530 to 0x146a8a (0x7aaa5 bytes) 1726851991.543886 truncate done 000463[1] 1726851991.557166 write 0x1f0910 thru 0x1ff1e7 (0xe8d8 bytes) 1726851991.566556 write done 000464[1] 1726851991.586926 read 0x051d76 thru 0x0545c9 (0x2854 bytes) 1726851991.633762 read done 000465[1] 1726851991.644565 mapread 0x0c4d44 thru 0x0cda21 (0x8cde bytes) 1726851991.644786 mmap done 1726851991.644863 memcpy done 1726851991.645031 munmap done 000466[1] 1726851991.645903 mapwrite 0x1eeaa8 thru 0x1f656e (0x7ac7 bytes) 1726851991.646106 mmap done 1726851991.690976 msync done 1726851991.692169 munmap done 000468[0] 1726851991.700582 mapwrite 0x0d53de thru 0x0e00e3 (0xad06 bytes) 1726851991.704592 mmap done 1726851991.902666 msync done 1726851991.903043 munmap done 000472[1] 1726851991.942053 write 0x075b36 thru 0x083bfd (0xe0c8 bytes) 1726851991.955935 write done 000473[1] 1726851991.971715 read 0x111f21 thru 0x11ebab (0xcc8b bytes) 1726851991.971945 read done 000475[0] 1726851991.985043 mapread 0x148a3f thru 0x1508d0 (0x7e92 bytes) 1726851991.992779 mmap done 1726851992.025646 memcpy done 1726851992.025889 munmap done 000476[1] 1726851992.029320 read 0x0393f2 thru 0x04936b (0xff7a bytes) 1726851992.047945 read done 000477[0] 1726851992.048328 trunc from 0x1ff1e8 to 0x0b4d27 (0x14a4c0 bytes) 1726851992.102388 truncate done 000479[0] 1726851992.136947 trunc from 0x0b4d28 to 0x0b3da9 (0xf7e bytes) 1726851992.151442 truncate done 000481[1] 1726851992.154594 read 0x021aba thru 0x031a2b (0xff72 bytes) 1726851992.177112 read done 000482[0] 1726851992.180655 mapread 0x05d016 thru 0x06568c (0x8677 bytes) 1726851992.180828 mmap done 1726851992.211926 memcpy done 1726851992.212057 munmap done 000483[1] 1726851992.226044 mapread 0x00d9d7 thru 0x010d4e (0x3378 bytes) 1726851992.230321 mmap done 1726851992.230436 memcpy done 1726851992.230475 munmap done 000484[0] 1726851992.230786 write 0x096071 thru 0x0a3325 (0xd2b5 bytes) 1726851992.256859 write done truncating to largest ever: 0x1fc7c8 000486[0] 1726851992.288722 trunc from 0x0b3daa to 0x1fc7c7 (0x148a1e bytes) 1726851992.303441 truncate done 000493[1] 1726851992.334523 trunc from 0x1fc7c8 to 0x079950 (0x182e77 bytes) 1726851992.358902 truncate done 000496[1] 1726851992.383996 read 0x04c3c8 thru 0x059bac (0xd7e5 bytes) 1726851992.393132 read done 000497[0] 1726851992.405700 write 0x0a7c2c thru 0x0a8425 (0x7fa bytes) 1726851992.416310 write done 000498[1] 1726851992.430653 mapread 0x09c0c3 thru 0x09fcab (0x3be9 bytes) 1726851992.443097 mmap done 1726851992.464297 memcpy done 1726851992.464542 munmap done 000503[0] 1726851992.491143 trunc from 0x0a8426 to 0x0e6c41 (0x3e81c bytes) 1726851992.513225 truncate done 000504[0] 1726851992.530650 mapread 0x017517 thru 0x0220bd (0xaba7 bytes) 1726851992.530921 mmap done 1726851992.557866 memcpy done 1726851992.558615 munmap done 000505[0] 1726851992.561644 mapwrite 0x1f787d thru 0x1fccf5 (0x5479 bytes) 1726851992.571547 truncate done 1726851992.571739 mmap done 1726851992.674643 msync done 1726851992.674696 munmap done 000507[1] 1726851992.689430 write 0x06b75d thru 0x079fec (0xe890 bytes) 1726851992.708781 write done 000513[1] 1726851992.783585 trunc from 0x1fccf6 to 0x018e82 (0x1e3e73 bytes) 1726851992.808496 truncate done 000514[0] 1726851992.813067 write 0x176450 thru 0x17a71d (0x42ce bytes) 1726851992.825002 write done 000515[0] 1726851992.833719 read 0x113b8d thru 0x120b8f (0xd003 bytes) 1726851992.864447 read done 000517[0] 1726851992.887672 write 0x020f56 thru 0x02597a (0x4a25 bytes) 1726851992.912778 write done 000519[1] 1726851992.924589 mapread 0x02fd76 thru 0x03f0b0 (0xf33b bytes) 1726851992.929969 mmap done 1726851993.095449 memcpy done 1726851993.095568 munmap done 000520[1] 1726851993.097458 write 0x04b79d thru 0x05ac7d (0xf4e1 bytes) 1726851993.107103 write done 000523[1] 1726851993.151973 mapread 0x062e24 thru 0x0691f8 (0x63d5 bytes) 1726851993.161193 mmap done 1726851993.225520 memcpy done 1726851993.225758 munmap done 000525[0] 1726851993.244654 mapwrite 0x104ae5 thru 0x110e66 (0xc382 bytes) 1726851993.249305 mmap done 1726851993.303262 msync done 1726851993.303361 munmap done 000527[0] 1726851993.321703 read 0x093875 thru 0x09e806 (0xaf92 bytes) 1726851993.347636 read done 000530[0] 1726851993.374011 write 0x1f652f thru 0x1f8415 (0x1ee7 bytes) 1726851993.374481 write done 000533[0] 1726851993.407265 mapread 0x10ed77 thru 0x11a4cf (0xb759 bytes) 1726851993.407545 mmap done 1726851993.407634 memcpy done 1726851993.407748 munmap done 000534[1] 1726851993.408047 mapread 0x0d4264 thru 0x0db7c1 (0x755e bytes) 1726851993.411938 mmap done 1726851993.482253 memcpy done 1726851993.482431 munmap done 000538[1] 1726851993.492237 write 0x1c7053 thru 0x1d4599 (0xd547 bytes) 1726851993.526248 write done 000541[0] 1726851993.553769 mapwrite 0x1e465d thru 0x1f2581 (0xdf25 bytes) 1726851993.560846 mmap done 1726851993.643829 msync done 1726851993.644007 munmap done 000544[0] 1726851993.653408 mapread 0x0fedcf thru 0x1083f1 (0x9623 bytes) 1726851993.653601 mmap done 1726851993.674490 memcpy done 1726851993.674560 munmap done 000545[1] 1726851993.674883 trunc from 0x1f8416 to 0x0c1409 (0x13700c bytes) 1726851993.701694 truncate done 000547[0] 1726851993.710292 mapread 0x017235 thru 0x01ea6a (0x7836 bytes) 1726851993.716467 mmap done 1726851993.739475 memcpy done 1726851993.739666 munmap done 000548[1] 1726851993.751643 mapwrite 0x02ac57 thru 0x0302a8 (0x5652 bytes) 1726851993.753766 mmap done 1726851993.818548 msync done 1726851993.818955 munmap done 000551[1] 1726851993.855490 read 0x093e0d thru 0x09415e (0x352 bytes) 1726851993.877567 read done 000552[0] 1726851993.895193 mapwrite 0x1e06f4 thru 0x1e6be2 (0x64ef bytes) 1726851993.921391 truncate done 1726851993.921594 mmap done 1726851993.986556 msync done 1726851993.986993 munmap done 000553[1] 1726851994.002435 write 0x09a069 thru 0x0a7024 (0xcfbc bytes) 1726851994.020297 write done 000554[0] 1726851994.030392 write 0x01a4e2 thru 0x022642 (0x8161 bytes) 1726851994.047490 write done 000555[0] 1726851994.054072 write 0x1b1fe5 thru 0x1bcda4 (0xadc0 bytes) 1726851994.059840 write done 000556[1] 1726851994.062252 write 0x10ef27 thru 0x1150b8 (0x6192 bytes) 1726851994.081497 write done 000558[0] 1726851994.109386 trunc from 0x1e6be3 to 0x01669b (0x1d0547 bytes) 1726851994.136825 truncate done 000560[0] 1726851994.160471 write 0x1063a9 thru 0x1092fe (0x2f56 bytes) 1726851994.162243 write done 000564[1] 1726851994.196631 write 0x0de297 thru 0x0e71fb (0x8f65 bytes) 1726851994.203476 write done 000565[1] 1726851994.218636 write 0x16a4fd thru 0x16cdb3 (0x28b7 bytes) 1726851994.235411 write done 000566[0] 1726851994.251199 mapread 0x0784f6 thru 0x081de6 (0x98f1 bytes) 1726851994.257593 mmap done 1726851994.304785 memcpy done 1726851994.305028 munmap done 000568[0] 1726851994.307936 mapread 0x047f10 thru 0x055434 (0xd525 bytes) 1726851994.312767 mmap done 1726851994.370127 memcpy done 1726851994.371010 munmap done 000569[1] 1726851994.389210 mapread 0x01b084 thru 0x023c3f (0x8bbc bytes) 1726851994.389529 mmap done 1726851994.435626 memcpy done 1726851994.436118 munmap done 000575[0] 1726851994.493529 mapwrite 0x030296 thru 0x033d59 (0x3ac4 bytes) 1726851994.498808 mmap done 1726851994.558864 msync done 1726851994.559768 munmap done 000576[1] 1726851994.566538 mapwrite 0x162d0a thru 0x16c2ab (0x95a2 bytes) 1726851994.571690 mmap done 1726851994.614646 msync done 1726851994.614716 munmap done 000579[1] 1726851994.647664 write 0x189c38 thru 0x1964ff (0xc8c8 bytes) 1726851994.649047 write done 000581[1] 1726851994.673733 mapread 0x09c4fa thru 0x0a683a (0xa341 bytes) 1726851994.678938 mmap done 1726851994.728810 memcpy done 1726851994.731454 munmap done 000582[0] 1726851994.743771 mapread 0x161b60 thru 0x16b020 (0x94c1 bytes) 1726851994.751674 mmap done 1726851994.797340 memcpy done 1726851994.797663 munmap done 000584[1] 1726851994.804384 read 0x057f68 thru 0x057ff5 (0x8e bytes) 1726851994.827091 read done 000585[0] 1726851994.827548 mapwrite 0x1905bb thru 0x1956a4 (0x50ea bytes) 1726851994.829344 mmap done 1726851994.907108 msync done 1726851994.907543 munmap done 000586[1] 1726851994.907938 mapwrite 0x01e28f thru 0x02b2f4 (0xd066 bytes) 1726851994.911212 mmap done 1726851995.014214 msync done 1726851995.014482 munmap done 000588[1] 1726851995.030088 read 0x0079c8 thru 0x00d6a1 (0x5cda bytes) 1726851995.042066 read done 000590[0] 1726851995.061217 mapwrite 0x0be8ec thru 0x0c8273 (0x9988 bytes) 1726851995.067349 mmap done 1726851995.149784 msync done 1726851995.149877 munmap done 000591[0] 1726851995.150315 mapwrite 0x19a43f thru 0x19d090 (0x2c52 bytes) 1726851995.168799 truncate done 1726851995.169110 mmap done 1726851995.239785 msync done 1726851995.239960 munmap done 000592[0] 1726851995.253383 read 0x147bde thru 0x151263 (0x9686 bytes) 1726851995.282443 read done 000593[0] 1726851995.287227 mapwrite 0x12b4a5 thru 0x12c19b (0xcf7 bytes) 1726851995.287455 mmap done 1726851995.311439 msync done 1726851995.311589 munmap done 000594[0] 1726851995.311883 mapread 0x1644e3 thru 0x173851 (0xf36f bytes) 1726851995.312333 mmap done 1726851995.312471 memcpy done 1726851995.312503 munmap done 000595[1] 1726851995.325725 write 0x024205 thru 0x029947 (0x5743 bytes) 1726851995.338726 write done 000597[1] 1726851995.362247 mapread 0x0ebae7 thru 0x0f01d8 (0x46f2 bytes) 1726851995.369840 mmap done 1726851995.435913 memcpy done 1726851995.436558 munmap done 000598[1] 1726851995.456730 trunc from 0x19d091 to 0x0f6f8a (0xa6106 bytes) 1726851995.477267 truncate done 000599[1] 1726851995.483892 mapread 0x0c3c8d thru 0x0d1eba (0xe22e bytes) 1726851995.484097 mmap done 1726851995.535395 memcpy done 1726851995.535849 munmap done 000600[0] 1726851995.557945 trunc from 0x0f6f8b to 0x1090e7 (0x1215d bytes) 1726851995.580438 truncate done 000602[1] 1726851995.585315 write 0x13194a thru 0x13e88c (0xcf43 bytes) 1726851995.593629 write done 000606[1] 1726851995.662673 mapread 0x036fdf thru 0x040cc5 (0x9ce7 bytes) 1726851995.668820 mmap done 1726851995.713746 memcpy done 1726851995.713949 munmap done 000611[0] 1726851995.737380 write 0x11af6c thru 0x1252a5 (0xa33a bytes) 1726851995.759444 write done 000614[1] 1726851995.811303 mapread 0x01156e thru 0x0131ee (0x1c81 bytes) 1726851995.816912 mmap done 1726851995.825426 memcpy done 1726851995.825691 munmap done 000617[1] 1726851995.847723 write 0x09b2b3 thru 0x0a4dbe (0x9b0c bytes) 1726851995.864691 write done 000619[0] 1726851995.891983 mapwrite 0x1ec66a thru 0x1f871e (0xc0b5 bytes) 1726851995.915557 truncate done 1726851995.915783 mmap done 1726851995.998143 msync done 1726851995.998570 munmap done 000621[1] 1726851996.002815 write 0x075fd0 thru 0x0781dd (0x220e bytes) 1726851996.019260 write done 000622[1] 1726851996.032290 trunc from 0x1f871f to 0x050f4a (0x1a77d4 bytes) 1726851996.050885 truncate done 000624[1] 1726851996.066647 mapread 0x038966 thru 0x0407f3 (0x7e8e bytes) 1726851996.066925 mmap done 1726851996.121175 memcpy done 1726851996.121826 munmap done 000625[0] 1726851996.135331 trunc from 0x050f4b to 0x0a1046 (0x500fc bytes) 1726851996.163406 truncate done 000626[0] 1726851996.168536 mapread 0x04c4bf thru 0x05a86a (0xe3ac bytes) 1726851996.168752 mmap done 1726851996.220908 memcpy done 1726851996.221513 munmap done 000632[0] 1726851996.255626 mapread 0x08139e thru 0x090de2 (0xfa45 bytes) 1726851996.255831 mmap done 1726851996.306933 memcpy done 1726851996.307341 munmap done 000635[1] 1726851996.320627 mapwrite 0x1a340b thru 0x1a8330 (0x4f26 bytes) 1726851996.348449 truncate done 1726851996.348621 mmap done 1726851996.443206 msync done 1726851996.443781 munmap done 000637[0] 1726851996.449237 write 0x041674 thru 0x04ee97 (0xd824 bytes) 1726851996.462571 write done 000638[1] 1726851996.479215 trunc from 0x1a8331 to 0x15f410 (0x48f20 bytes) 1726851996.499807 truncate done 000639[0] 1726851996.521397 read 0x0b415e thru 0x0baa9f (0x6942 bytes) 1726851996.590324 read done 000640[0] 1726851996.601290 write 0x03c3e6 thru 0x048c33 (0xc84e bytes) 1726851996.623124 write done 000643[1] 1726851996.656651 read 0x0d9676 thru 0x0e6adf (0xd46a bytes) 1726851996.695161 read done 000644[0] 1726851996.695602 mapwrite 0x14e4c9 thru 0x151647 (0x317f bytes) 1726851996.709577 mmap done 1726851996.814017 msync done 1726851996.814363 munmap done 000655[1] 1726851996.866452 write 0x006943 thru 0x0079d3 (0x1091 bytes) 1726851996.879756 write done 000659[1] 1726851996.925033 write 0x082951 thru 0x09236e (0xfa1e bytes) 1726851996.934807 write done 000660[1] 1726851996.945562 write 0x02e4bc thru 0x03223c (0x3d81 bytes) 1726851996.951727 write done 000661[1] 1726851996.961750 read 0x0873ba thru 0x0893f6 (0x203d bytes) 1726851996.961882 read done 000662[1] 1726851996.972526 mapread 0x0a2d1f thru 0x0a4661 (0x1943 bytes) 1726851996.978821 mmap done 1726851997.018030 memcpy done 1726851997.018247 munmap done 000669[0] 1726851997.103235 write 0x1e01d1 thru 0x1e9765 (0x9595 bytes) 1726851997.105032 write done 000674[1] 1726851997.155483 mapwrite 0x0d033a thru 0x0d29f7 (0x26be bytes) 1726851997.161355 mmap done 1726851997.248912 msync done 1726851997.249909 munmap done 000676[0] 1726851997.276844 mapwrite 0x1728da thru 0x174423 (0x1b4a bytes) 1726851997.283738 mmap done 1726851997.341873 msync done 1726851997.343115 munmap done 000677[0] 1726851997.355733 trunc from 0x1e9766 to 0x0309b5 (0x1b8db0 bytes) 1726851997.379474 truncate done 000679[0] 1726851997.395037 trunc from 0x0309b6 to 0x0c7689 (0x96cd4 bytes) 1726851997.403978 truncate done 000683[1] 1726851997.442443 trunc from 0x0c768a to 0x0c3db0 (0x38d9 bytes) 1726851997.460902 truncate done 000684[1] 1726851997.463849 trunc from 0x0c3db1 to 0x02dbbd (0x961f3 bytes) 1726851997.470442 truncate done 000685[1] 1726851997.489261 write 0x017df8 thru 0x01dd1f (0x5f28 bytes) 1726851997.496269 write done 000686[1] 1726851997.501562 write 0x1fc85e thru 0x1fffff (0x37a2 bytes) 1726851997.502498 write done 000687[1] 1726851997.511136 trunc from 0x200000 to 0x15bff4 (0xa400b bytes) 1726851997.517350 truncate done 000693[1] 1726851997.558536 mapread 0x0be9cf thru 0x0c602c (0x765e bytes) 1726851997.559036 mmap done 1726851997.592570 memcpy done 1726851997.593380 munmap done 000694[1] 1726851997.593770 mapwrite 0x1bab7f thru 0x1bc873 (0x1cf5 bytes) 1726851997.603111 truncate done 1726851997.603359 mmap done 1726851997.712188 msync done 1726851997.712274 munmap done 000696[1] 1726851997.747064 read 0x107706 thru 0x11668d (0xef88 bytes) 1726851997.747263 read done 000697[0] 1726851997.750143 trunc from 0x1bc874 to 0x00defc (0x1ae977 bytes) 1726851997.777538 truncate done 000699[0] 1726851997.799505 trunc from 0x00defd to 0x0aa869 (0x9c96d bytes) 1726851997.807394 truncate done 000701[0] 1726851997.811552 read 0x0a1828 thru 0x0a2939 (0x1112 bytes) 1726851997.825736 read done 000703[0] 1726851997.826448 write 0x1edb93 thru 0x1f3987 (0x5df5 bytes) 1726851997.827434 write done 000705[0] 1726851997.827945 read 0x0ca45c thru 0x0d7679 (0xd21e bytes) 1726851997.836347 read done 000708[1] 1726851997.865462 write 0x0f391a thru 0x0fd89f (0x9f86 bytes) 1726851997.879312 write done 000710[0] 1726851997.895242 trunc from 0x1f3988 to 0x1d65b2 (0x1d3d5 bytes) 1726851997.919043 truncate done 000717[1] 1726851997.971927 mapread 0x17c890 thru 0x1873f4 (0xab65 bytes) 1726851997.977380 mmap done 1726851998.028296 memcpy done 1726851998.028662 munmap done 000724[0] 1726851998.074012 mapwrite 0x0e4daa thru 0x0ebe4f (0x70a6 bytes) 1726851998.074284 mmap done 1726851998.159056 msync done 1726851998.159370 munmap done 000725[1] 1726851998.159729 read 0x1b5f4e thru 0x1c2b1f (0xcbd2 bytes) 1726851998.210794 read done 000726[0] 1726851998.223917 read 0x03122e thru 0x03dd18 (0xcaeb bytes) 1726851998.258754 read done 000727[0] 1726851998.268430 mapread 0x099d23 thru 0x09afe1 (0x12bf bytes) 1726851998.268707 mmap done 1726851998.268809 memcpy done 1726851998.268875 munmap done 000731[0] 1726851998.269865 mapwrite 0x0605cf thru 0x068bfc (0x862e bytes) 1726851998.270655 mmap done 1726851998.319868 msync done 1726851998.320070 munmap done 000732[0] 1726851998.320885 write 0x11b8d4 thru 0x128701 (0xce2e bytes) 1726851998.335063 write done 000735[0] 1726851998.356876 mapwrite 0x057b77 thru 0x05fc61 (0x80eb bytes) 1726851998.357811 mmap done 1726851998.393252 msync done 1726851998.393338 munmap done 000738[1] 1726851998.407567 mapread 0x15af30 thru 0x15fffb (0x50cc bytes) 1726851998.414606 mmap done 1726851998.455078 memcpy done 1726851998.455373 munmap done 000744[0] 1726851998.505182 trunc from 0x1d65b3 to 0x07137b (0x165237 bytes) 1726851998.524409 truncate done 000745[0] 1726851998.532893 mapread 0x0458c2 thru 0x04f7b7 (0x9ef6 bytes) 1726851998.533078 mmap done 1726851998.538110 memcpy done 1726851998.540662 munmap done 000746[0] 1726851998.542617 mapread 0x027d40 thru 0x0325f0 (0xa8b1 bytes) 1726851998.542787 mmap done 1726851998.542868 memcpy done 1726851998.542901 munmap done 000750[1] 1726851998.583070 read 0x034242 thru 0x0402da (0xc099 bytes) 1726851998.606673 read done 000752[0] 1726851998.642979 trunc from 0x07137c to 0x14e7e0 (0xdd465 bytes) 1726851998.671028 truncate done 000755[0] 1726851998.705495 write 0x074b46 thru 0x07c6c0 (0x7b7b bytes) 1726851998.713585 write done 000759[0] 1726851998.748008 trunc from 0x14e7e1 to 0x1f61a0 (0xa79c0 bytes) 1726851998.760940 truncate done 000762[0] 1726851998.798505 mapread 0x1e04ab thru 0x1eea6a (0xe5c0 bytes) 1726851998.798887 mmap done 1726851998.806440 memcpy done 1726851998.806577 munmap done 000763[0] 1726851998.816916 mapread 0x08dfc7 thru 0x0929da (0x4a14 bytes) 1726851998.817133 mmap done 1726851998.830498 memcpy done 1726851998.830648 munmap done 000764[0] 1726851998.839688 write 0x1ca8e5 thru 0x1d1e8e (0x75aa bytes) 1726851998.848950 write done 000766[0] 1726851998.856997 write 0x1dbda1 thru 0x1e2f50 (0x71b0 bytes) 1726851998.857622 write done 000768[1] 1726851998.875472 write 0x0d406f thru 0x0e2bae (0xeb40 bytes) 1726851998.886715 write done 000769[0] 1726851998.894335 write 0x1d4b99 thru 0x1e074e (0xbbb6 bytes) 1726851998.898725 write done 000771[1] 1726851998.924205 trunc from 0x1f61a1 to 0x02cc3b (0x1c9565 bytes) 1726851998.963387 truncate done 000773[0] 1726851998.984583 mapread 0x01883a thru 0x0191ee (0x9b5 bytes) 1726851998.989641 mmap done 1726851998.998656 memcpy done 1726851998.998814 munmap done 000775[0] 1726851999.006921 trunc from 0x02cc3c to 0x124fda (0xf839f bytes) 1726851999.026301 truncate done 000779[0] 1726851999.063363 read 0x0a0b3b thru 0x0a16f5 (0xbbb bytes) 1726851999.083133 read done 000781[0] 1726851999.094828 trunc from 0x124fdb to 0x141830 (0x1c856 bytes) 1726851999.104235 truncate done 000785[0] 1726851999.107508 read 0x0474ce thru 0x048e16 (0x1949 bytes) 1726851999.107595 read done 000786[0] 1726851999.121458 mapwrite 0x0e09a1 thru 0x0ee3f3 (0xda53 bytes) 1726851999.121981 mmap done 1726851999.163764 msync done 1726851999.163890 munmap done 000788[0] 1726851999.192115 read 0x01e8dc thru 0x029137 (0xa85c bytes) 1726851999.192290 read done 000790[0] 1726851999.202366 mapwrite 0x177b55 thru 0x181cba (0xa166 bytes) 1726851999.217760 truncate done 1726851999.218677 mmap done 1726851999.274583 msync done 1726851999.274658 munmap done 000791[1] 1726851999.277391 read 0x0cc47d thru 0x0d3827 (0x73ab bytes) 1726851999.306253 read done 000793[0] 1726851999.334139 write 0x12a890 thru 0x12cbab (0x231c bytes) 1726851999.335485 write done 000795[0] 1726851999.337029 mapwrite 0x076c39 thru 0x078a87 (0x1e4f bytes) 1726851999.338008 mmap done 1726851999.394057 msync done 1726851999.394257 munmap done 000796[1] 1726851999.406393 write 0x0c0c23 thru 0x0cb453 (0xa831 bytes) 1726851999.417925 write done 000798[0] 1726851999.445864 trunc from 0x181cbb to 0x162953 (0x1f367 bytes) 1726851999.463600 truncate done 000799[1] 1726851999.479513 read 0x118485 thru 0x11b948 (0x34c4 bytes) 1726851999.507730 read done 000802[0] 1726851999.511845 read 0x091d8c thru 0x099110 (0x7385 bytes) 1726851999.533400 read done 000803[1] 1726851999.533758 mapread 0x078173 thru 0x0826ad (0xa53b bytes) 1726851999.538567 mmap done 1726851999.561889 memcpy done 1726851999.561991 munmap done 000804[1] 1726851999.564391 trunc from 0x162954 to 0x013edc (0x14ea77 bytes) 1726851999.586329 truncate done 000807[0] 1726851999.615752 mapread 0x00f99d thru 0x013edc (0x4540 bytes) 1726851999.620034 mmap done 1726851999.649109 memcpy done 1726851999.649343 munmap done 000811[1] 1726851999.661016 trunc from 0x013edd to 0x0606f3 (0x4c817 bytes) 1726851999.685234 truncate done 000812[1] 1726851999.688099 mapwrite 0x039fdb thru 0x03aec8 (0xeee bytes) 1726851999.689918 mmap done 1726851999.730402 msync done 1726851999.730564 munmap done 000813[0] 1726851999.754583 read 0x0265a3 thru 0x035394 (0xedf2 bytes) 1726851999.772463 read done 000815[1] 1726851999.787758 mapread 0x0388de thru 0x043188 (0xa8ab bytes) 1726851999.789561 mmap done 1726851999.814568 memcpy done 1726851999.814730 munmap done 000818[1] 1726851999.845749 read 0x04a65d thru 0x04e93c (0x42e0 bytes) 1726851999.852690 read done 000822[0] 1726851999.882960 mapwrite 0x1fa403 thru 0x1ff362 (0x4f60 bytes) 1726851999.905464 truncate done 1726851999.905646 mmap done 1726851999.962045 msync done 1726851999.962267 munmap done 000826[1] 1726851999.987515 write 0x0aefbc thru 0x0ba538 (0xb57d bytes) 1726851999.995799 write done 000827[0] 1726852000.006926 mapwrite 0x1153e1 thru 0x117962 (0x2582 bytes) 1726852000.012122 mmap done 1726852000.048377 msync done 1726852000.049577 munmap done 000830[1] 1726852000.075017 mapwrite 0x1f9222 thru 0x1faef9 (0x1cd8 bytes) 1726852000.079872 mmap done 1726852000.150183 msync done 1726852000.151364 munmap done 000832[1] 1726852000.173470 mapwrite 0x1d0c21 thru 0x1d451e (0x38fe bytes) 1726852000.173717 mmap done 1726852000.215447 msync done 1726852000.215700 munmap done 000834[1] 1726852000.216947 mapwrite 0x1f85ed thru 0x1fffff (0x7a13 bytes) 1726852000.229006 truncate done 1726852000.229767 mmap done 1726852000.279282 msync done 1726852000.279347 munmap done 000837[0] 1726852000.301673 mapread 0x04a7c7 thru 0x057bbf (0xd3f9 bytes) 1726852000.307308 mmap done 1726852000.374338 memcpy done 1726852000.374676 munmap done 000841[1] 1726852000.394807 write 0x19f0f5 thru 0x1a8811 (0x971d bytes) 1726852000.395425 write done 000842[0] 1726852000.404094 mapread 0x05ea7a thru 0x062b62 (0x40e9 bytes) 1726852000.408086 mmap done 1726852000.421329 memcpy done 1726852000.421402 munmap done 000843[0] 1726852000.421713 write 0x0f60b2 thru 0x101d19 (0xbc68 bytes) 1726852000.439554 write done 000844[1] 1726852000.439870 mapwrite 0x1c6fe9 thru 0x1cf94e (0x8966 bytes) 1726852000.443314 mmap done 1726852000.500479 msync done 1726852000.500651 munmap done 000846[1] 1726852000.521910 mapread 0x15cb3a thru 0x169d7c (0xd243 bytes) 1726852000.531856 mmap done 1726852000.562570 memcpy done 1726852000.562770 munmap done 000847[0] 1726852000.570320 write 0x056016 thru 0x05a810 (0x47fb bytes) 1726852000.576354 write done 000852[1] 1726852000.632599 mapwrite 0x17519c thru 0x17cca6 (0x7b0b bytes) 1726852000.640144 mmap done 1726852000.702299 msync done 1726852000.702567 munmap done 000853[0] 1726852000.713253 read 0x0dd436 thru 0x0e180d (0x43d8 bytes) 1726852000.729373 read done 000854[1] 1726852000.736582 mapread 0x10bc65 thru 0x11895e (0xccfa bytes) 1726852000.739122 mmap done 1726852000.771859 memcpy done 1726852000.772055 munmap done 000858[0] 1726852000.801725 mapwrite 0x123e21 thru 0x12ac7c (0x6e5c bytes) 1726852000.805581 mmap done 1726852000.857471 msync done 1726852000.857543 munmap done 000859[0] 1726852000.863633 read 0x1b7341 thru 0x1bfd5f (0x8a1f bytes) 1726852000.863810 read done 000862[0] 1726852000.877784 mapread 0x0199d3 thru 0x01dfa5 (0x45d3 bytes) 1726852000.877963 mmap done 1726852000.878023 memcpy done 1726852000.878070 munmap done 000863[0] 1726852000.882999 read 0x0cf5aa thru 0x0dd0e4 (0xdb3b bytes) 1726852000.883200 read done 000864[1] 1726852000.894718 mapread 0x0f3197 thru 0x0fdf43 (0xadad bytes) 1726852000.898136 mmap done 1726852000.933920 memcpy done 1726852000.934020 munmap done 000866[0] 1726852000.942063 read 0x0a4bdd thru 0x0a95d0 (0x49f4 bytes) 1726852000.957110 read done 000867[0] 1726852000.957508 trunc from 0x200000 to 0x1d2d0d (0x2d2f2 bytes) 1726852000.971877 truncate done 000868[1] 1726852000.986395 read 0x059035 thru 0x065d21 (0xcced bytes) 1726852001.011954 read done 000871[0] 1726852001.045703 trunc from 0x1d2d0e to 0x18a525 (0x487e8 bytes) 1726852001.065966 truncate done 000872[1] 1726852001.083561 read 0x0b5a25 thru 0x0bc136 (0x6712 bytes) 1726852001.107412 read done 000873[1] 1726852001.113095 write 0x09a98d thru 0x09c821 (0x1e95 bytes) 1726852001.128341 write done 000874[0] 1726852001.137735 trunc from 0x18a526 to 0x066b77 (0x1239ae bytes) 1726852001.158041 truncate done 000875[1] 1726852001.161093 trunc from 0x066b78 to 0x0e0664 (0x79aed bytes) 1726852001.181215 truncate done 000876[1] 1726852001.197634 read 0x023283 thru 0x0329bb (0xf739 bytes) 1726852001.211995 read done 000881[1] 1726852001.237900 mapwrite 0x1f5699 thru 0x1fa070 (0x49d8 bytes) 1726852001.244804 truncate done 1726852001.245019 mmap done 1726852001.325267 msync done 1726852001.325731 munmap done 000883[0] 1726852001.347329 read 0x000a05 thru 0x006fb3 (0x65af bytes) 1726852001.371249 read done 000885[1] 1726852001.389918 write 0x038138 thru 0x038789 (0x652 bytes) 1726852001.408657 write done 000886[0] 1726852001.409041 write 0x1fe809 thru 0x1fffff (0x17f7 bytes) 1726852001.416525 write done 000887[0] 1726852001.424872 mapwrite 0x0ab549 thru 0x0b94c1 (0xdf79 bytes) 1726852001.433754 mmap done 1726852001.551743 msync done 1726852001.551893 munmap done 000888[0] 1726852001.561665 mapwrite 0x02c2de thru 0x03725c (0xaf7f bytes) 1726852001.561960 mmap done 1726852001.635035 msync done 1726852001.635562 munmap done 000890[0] 1726852001.668805 mapwrite 0x17c18b thru 0x183bf6 (0x7a6c bytes) 1726852001.669084 mmap done 1726852001.701590 msync done 1726852001.701701 munmap done 000891[0] 1726852001.711829 write 0x1e2c68 thru 0x1e3c09 (0xfa2 bytes) 1726852001.713140 write done 000892[1] 1726852001.722015 write 0x1c7b6c thru 0x1c9c76 (0x210b bytes) 1726852001.740396 write done 000894[1] 1726852001.758408 trunc from 0x200000 to 0x1e8b7f (0x17480 bytes) 1726852001.778031 truncate done 000895[1] 1726852001.792697 trunc from 0x1e8b80 to 0x05c473 (0x18c70c bytes) 1726852001.805489 truncate done 000896[0] 1726852001.823340 mapwrite 0x103a2f thru 0x10d4e2 (0x9ab4 bytes) 1726852001.851874 truncate done 1726852001.852112 mmap done 1726852001.952704 msync done 1726852001.952779 munmap done 000897[0] 1726852001.956107 read 0x01177b thru 0x018ffd (0x7883 bytes) 1726852001.972687 read done 000900[1] 1726852001.984617 trunc from 0x10d4e3 to 0x1bf853 (0xb2371 bytes) 1726852002.004317 truncate done 000901[0] 1726852002.014805 mapread 0x1abce2 thru 0x1afba9 (0x3ec8 bytes) 1726852002.020189 mmap done 1726852002.043879 memcpy done 1726852002.044795 munmap done 000903[1] 1726852002.064299 mapread 0x138d4d thru 0x139e97 (0x114b bytes) 1726852002.067917 mmap done 1726852002.073626 memcpy done 1726852002.074019 munmap done 000904[1] 1726852002.083850 read 0x1801f1 thru 0x18f2c8 (0xf0d8 bytes) 1726852002.115405 read done 000905[1] 1726852002.126561 mapread 0x048632 thru 0x057f6b (0xf93a bytes) 1726852002.126954 mmap done 1726852002.127092 memcpy done 1726852002.127140 munmap done 000906[1] 1726852002.134367 mapwrite 0x19ddd1 thru 0x1a8e7e (0xb0ae bytes) 1726852002.134677 mmap done 1726852002.256596 msync done 1726852002.256767 munmap done 000908[1] 1726852002.268308 write 0x0488d9 thru 0x04960b (0xd33 bytes) 1726852002.268930 write done 000910 1726852002.292852 [1]close/open 1726852002.294816 close done 1726852002.302271 open done 000912[0] 1726852002.321315 write 0x1b8f1a thru 0x1c3461 (0xa548 bytes) 1726852002.330239 write done 000913[0] 1726852002.343033 mapread 0x1660ae thru 0x17126e (0xb1c1 bytes) 1726852002.347950 mmap done 1726852002.390659 memcpy done 1726852002.390976 munmap done 000915[1] 1726852002.415474 trunc from 0x1c3462 to 0x19de7d (0x255e4 bytes) 1726852002.439607 truncate done 000916[0] 1726852002.443262 mapwrite 0x03f291 thru 0x03fee8 (0xc58 bytes) 1726852002.447944 mmap done 1726852002.494057 msync done 1726852002.494284 munmap done 000917[1] 1726852002.503716 mapread 0x1763a2 thru 0x17882e (0x248d bytes) 1726852002.509916 mmap done 1726852002.524098 memcpy done 1726852002.524337 munmap done 000918[1] 1726852002.533291 mapread 0x0b9a6a thru 0x0c2ca0 (0x9237 bytes) 1726852002.541408 mmap done 1726852002.555448 memcpy done 1726852002.555542 munmap done 000919[0] 1726852002.555848 trunc from 0x19de7e to 0x09dc54 (0x100229 bytes) 1726852002.579954 truncate done 000922[0] 1726852002.583961 trunc from 0x09dc55 to 0x0f482c (0x56bd8 bytes) 1726852002.593082 truncate done 000925[0] 1726852002.631693 trunc from 0x0f482d to 0x0f070d (0x411f bytes) 1726852002.640513 truncate done 000926[0] 1726852002.643408 write 0x04fe7f thru 0x05be71 (0xbff3 bytes) 1726852002.652069 write done 000927[1] 1726852002.668086 write 0x0a688c thru 0x0a6aa0 (0x215 bytes) 1726852002.692350 write done 000928[0] 1726852002.703273 read 0x0958fc thru 0x09601c (0x721 bytes) 1726852002.740831 read done 000929[0] 1726852002.741209 write 0x10df7e thru 0x115885 (0x7908 bytes) 1726852002.741713 write done 000930[1] 1726852002.741967 trunc from 0x115886 to 0x1d6840 (0xc0fbb bytes) 1726852002.772731 truncate done 000941[1] 1726852002.817356 mapread 0x09eca3 thru 0x0a0934 (0x1c92 bytes) 1726852002.817569 mmap done 1726852002.823277 memcpy done 1726852002.823393 munmap done 000946[0] 1726852002.835474 trunc from 0x1d6841 to 0x075fac (0x160894 bytes) 1726852002.852209 truncate done 000948[1] 1726852002.874749 read 0x003ebe thru 0x007c00 (0x3d43 bytes) 1726852002.886778 read done 000949[1] 1726852002.894577 read 0x023569 thru 0x029c8c (0x6724 bytes) 1726852002.906490 read done 000955[1] 1726852002.951659 read 0x0341db thru 0x038298 (0x40be bytes) 1726852002.951818 read done 000957[1] 1726852002.960872 write 0x1b6f8f thru 0x1c362a (0xc69c bytes) 1726852002.968700 write done 000958[1] 1726852002.970473 mapread 0x11c3a4 thru 0x121dea (0x5a47 bytes) 1726852002.970642 mmap done 1726852002.985221 memcpy done 1726852002.985402 munmap done 000965[1] 1726852003.019770 mapread 0x01c9a2 thru 0x02b691 (0xecf0 bytes) 1726852003.019994 mmap done 1726852003.020092 memcpy done 1726852003.020196 munmap done 000970[0] 1726852003.052254 mapread 0x10d0c5 thru 0x113df8 (0x6d34 bytes) 1726852003.055586 mmap done 1726852003.081846 memcpy done 1726852003.082366 munmap done 000971[1] 1726852003.082706 read 0x1ae2a8 thru 0x1b246e (0x41c7 bytes) 1726852003.106797 read done 000973[0] 1726852003.107771 mapwrite 0x07fb8f thru 0x08c0b3 (0xc525 bytes) 1726852003.108008 mmap done 1726852003.198833 msync done 1726852003.198980 munmap done 000974[0] 1726852003.208470 trunc from 0x1c362b to 0x0990d2 (0x12a558 bytes) 1726852003.228903 truncate done 000975[0] 1726852003.232350 read 0x02b6ce thru 0x035adc (0xa40f bytes) 1726852003.245343 read done 000976[1] 1726852003.261508 mapread 0x0795c2 thru 0x07e5ca (0x5009 bytes) 1726852003.269582 mmap done 1726852003.303360 memcpy done 1726852003.303594 munmap done 000978[0] 1726852003.307602 mapread 0x05b7e2 thru 0x066221 (0xaa40 bytes) 1726852003.307797 mmap done 1726852003.350461 memcpy done 1726852003.351180 munmap done 000979[0] 1726852003.351577 read 0x011ae4 thru 0x020bc7 (0xf0e4 bytes) 1726852003.364393 read done 000984[0] 1726852003.402085 write 0x117467 thru 0x124d3e (0xd8d8 bytes) 1726852003.402993 write done 000985[1] 1726852003.403321 read 0x10fcad thru 0x11472c (0x4a80 bytes) 1726852003.432024 read done 000988[0] 1726852003.437055 read 0x0550af thru 0x062a73 (0xd9c5 bytes) 1726852003.438606 read done 000990[0] 1726852003.439204 read 0x0f2e7f thru 0x0ff525 (0xc6a7 bytes) 1726852003.448270 read done 000991[0] 1726852003.448674 mapwrite 0x096339 thru 0x0997f0 (0x34b8 bytes) 1726852003.448876 mmap done 1726852003.521045 msync done 1726852003.521405 munmap done 000992[1] 1726852003.521820 mapread 0x080d29 thru 0x0845ff (0x38d7 bytes) 1726852003.527176 mmap done 1726852003.555641 memcpy done 1726852003.555876 munmap done 000996[1] 1726852003.560788 write 0x14746c thru 0x14f06b (0x7c00 bytes) 1726852003.570638 write done 000997[1] 1726852003.584253 read 0x07284d thru 0x07fd77 (0xd52b bytes) 1726852003.602557 read done 000999[0] 1726852003.617607 trunc from 0x14f06c to 0x1165d7 (0x38a94 bytes) 1726852003.644449 truncate done All operations completed A-OK! PASS fsx (25s) == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 13:06:45 (1726852005) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 excepting tests: 42a 42c 42b 118c 118d 407 56x 56xa 56xb 119i 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 13:06:54 (1726852014) === Stopping clients: oleg144-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg144-client.virtnet /mnt/lustre2 opts: oleg144-client.virtnet: executing check_config_client /mnt/lustre oleg144-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg144-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5ca8000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5ca8000.idle_timeout=debug disable quota as required oleg144-server: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 13:07:04 (1726852024) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f15085] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 13:07:06 (1726852026) utime: good mknod times 1726852025 <= 1726852026 <= 1726852026 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (2s) == sanity test 36b: OST utime check (open, utime) ======== 13:07:08 (1726852028) utime: good utime mtimes 100000, atime 200000 PASS 36b (2s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 13:07:10 (1726852030) striped dir -i0 -c2 -H crush2 /mnt/lustre/d36 running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1726852030 <= 1726852031 <= 1726852031 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (3s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 13:07:13 (1726852033) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (2s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 13:07:15 (1726852035) striped dir -i0 -c2 -H all_char /mnt/lustre/d36e.sanity running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (2s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 13:07:17 (1726852037) striped dir -i0 -c2 -H all_char /mnt/lustre/d36f.sanity fail_loc=0x80000214 Fri Sep 20 13:07:17 EDT 2024 1726852037 Fri Sep 20 13:07:19 EDT 2024 1726852039 PASS 36f (4s) == sanity test 36g: FMD cache expiry =============================================================================== 13:07:21 (1726852041) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d36g.sanity FMD max age: 30s FMD before: 6 FMD after: 0 PASS 36g (46s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 13:08:07 (1726852087) striped dir -i0 -c2 -H crush /mnt/lustre/d36h.sanity fail_loc=0x80000227 Fri Sep 20 13:08:08 EDT 2024 1726852088 Fri Sep 20 13:08:09 EDT 2024 1726852089 PASS 36h (3s) == sanity test 36i: change mtime on striped directory ==== 13:08:10 (1726852090) striped dir -i0 -c2 -H crush /mnt/lustre/d36i.sanity PASS 36i (3s) == sanity test 39a: mtime changed on create ============== 13:08:13 (1726852093) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (4s) == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 13:08:17 (1726852097) striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d39b.sanity repeat after cancel_lru_locks PASS 39b (4s) == sanity test 39c: mtime change on rename ===================================================================================== 13:08:21 (1726852101) repeat after cancel_lru_locks PASS 39c (5s) == sanity test 39d: create, utime, stat ======================================================================================== 13:08:26 (1726852106) repeat after cancel_lru_locks PASS 39d (2s) == sanity test 39e: create, stat, utime, stat ================================================================================== 13:08:28 (1726852108) repeat after cancel_lru_locks PASS 39e (1s) == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 13:08:30 (1726852110) repeat after cancel_lru_locks PASS 39f (4s) == sanity test 39g: write, chmod, stat ========================================================================================= 13:08:33 (1726852113) repeat after cancel_lru_locks PASS 39g (4s) == sanity test 39h: write, utime within one second, stat ======================================================================= 13:08:37 (1726852117) repeat after cancel_lru_locks PASS 39h (4s) == sanity test 39i: write, rename, stat ======================================================================================== 13:08:41 (1726852121) repeat after cancel_lru_locks PASS 39i (3s) == sanity test 39j: write, rename, close, stat ================================================================================= 13:08:44 (1726852124) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.15085 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (6s) == sanity test 39k: write, utime, close, stat ================================================================================== 13:08:50 (1726852130) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.15085 repeat after cancel_lru_locks PASS 39k (4s) == sanity test 39l: directory atime update ===================================================================================== 13:08:54 (1726852134) PASS 39l (9s) == sanity test 39m: test atime and mtime before 1970 ===== 13:09:03 (1726852143) repeat after cancel_lru_locks PASS 39m (4s) == sanity test 39n: check that O_NOATIME is honored ====== 13:09:07 (1726852147) 1+0 records in 1+0 records out PASS 39n (13s) == sanity test 39o: directory cached attributes updated after create ========================================================== 13:09:20 (1726852160) a b PASS 39o (3s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 13:09:23 (1726852163) striped dir -i1 -c2 -H crush /mnt/lustre/d39p.sanity/d39p.sanity striped dir -i1 -c2 -H crush2 /mnt/lustre/d39p.sanity/d39p.sanity/remote_dir1 striped dir -i1 -c2 -H crush2 /mnt/lustre/d39p.sanity/d39p.sanity/remote_dir2 remote_dir1 remote_dir2 PASS 39p (3s) == sanity test 39r: lazy atime update on OST ============= 13:09:26 (1726852166) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) == sanity test 39q: close won't zero out atime =========== 13:09:27 (1726852167) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.15085 PASS 39q (2s) == sanity test 39s: relatime is supported ================ 13:09:29 (1726852169) 192.168.201.144@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg144-client.virtnet /mnt/lustre (opts:) Starting client: oleg144-client.virtnet: -o relatime 192.168.201.144@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg144-client.virtnet /mnt/lustre (opts:) Starting client: oleg144-client.virtnet: -o user_xattr,flock 192.168.201.144@tcp:/lustre /mnt/lustre PASS 39s (8s) == sanity test 39u: stat race ============================ 13:09:37 (1726852177) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361681 s, 29.0 MB/s fail_loc=0x80001434 PASS 39u (16s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 13:09:53 (1726852193) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00757417 s, 541 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (3s) == sanity test 41: test small file write + fstat =============================================================================== 13:09:56 (1726852196) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (3s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 13:09:59 (1726852199) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.0279352 s, 3.7 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 7168 2199936 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 10240 7528448 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (2s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 13:10:01 (1726852201) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d42e.sanitye total: 1000 open/close in 6.70 seconds: 149.14 ops/second total: 934 open/close in 6.76 seconds: 138.22 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 13.6788 s, 35.8 MB/s osc.lustre-OST0000-osc-ffff8800a7f3a800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800a7f3a800.cur_grant_bytes=490733568 osc.lustre-OST0000-osc-ffff8800a7f3a800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800a7f3a800.cur_grant_bytes=490471424 osc.lustre-OST0000-osc-ffff8800a7f3a800.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800a7f3a800.rpc_stats= snapshot_time: 1726852277.723364397 secs.nsecs start_time: 1726852275.255042733 secs.nsecs elapsed_time: 2.468321664 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 34 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 34 100 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 34 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 7424 2201216 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 3712 2204928 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 182272 3587072 5% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 187392 7351296 3% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (98s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 13:11:39 (1726852299) striped dir -i1 -c2 -H crush2 /mnt/lustre/d43A.sanity /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5839: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (4s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 13:11:43 (1726852303) striped dir -i1 -c2 -H crush2 /mnt/lustre/d43a.sanity open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4827: 9459 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (3s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 13:11:46 (1726852306) striped dir -i1 -c2 -H crush /mnt/lustre/d43b.sanity truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4827: 10103 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (4s) == sanity test 43c: md5sum of copy into lustre =========== 13:11:50 (1726852310) striped dir -i1 -c2 -H crush /mnt/lustre/d43c.sanity bash: OK PASS 43c (2s) == sanity test 46: dirtying a previously written page ========================================================================== 13:11:52 (1726852312) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00671695 s, 610 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00151416 s, 2.7 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00305664 s, 1.3 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (3s) == sanity test 56r: check lfs find -size works =========== 13:11:55 (1726852315) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d56r.sanity striped dir -i0 -c2 -H all_char /mnt/lustre/d56r.sanity/dir1 striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d56r.sanity/dir2 striped dir -i0 -c2 -H crush2 /mnt/lustre/d56r.sanity/dir3 PASS 56r (5s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 13:12:01 (1726852321) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff8800a7f3a800.max_cached_mb= users: 6 max_cached_mb: 1865 used_mb: 49 unused_mb: 1816 unevict_mb: 0 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff8800a7f3a800.read_ahead_stats= snapshot_time 1726852346.158609278 secs.nsecs start_time 1726852336.440495374 secs.nsecs elapsed_time 9.718113904 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (29s) resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119a: Short directIO read must return actual read amount ========================================================== 13:12:31 (1726852351) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (3s) == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 13:12:34 (1726852354) PASS 131a (4s) == sanity test 131b: test append writev ================== 13:12:38 (1726852358) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (3s) == sanity test 131c: test read/write on file w/o objects ========================================================== 13:12:41 (1726852361) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (2s) == sanity test 131d: test short read ===================== 13:12:43 (1726852363) PASS 131d (2s) == sanity test 131e: test read hitting hole ============== 13:12:45 (1726852365) PASS 131e (3s) == sanity test 150a: truncate/append tests =============== 13:12:48 (1726852368) 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.0012714 s, 4.8 MB/s Stopping client oleg144-client.virtnet /mnt/lustre (opts:) Starting client: oleg144-client.virtnet: -o user_xattr,flock 192.168.201.144@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.201.144@tcp:/lustre 7542784 10240 7528448 1% /mnt/lustre sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete PASS 150a (19s) == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 13:13:07 (1726852387) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (1s) == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 13:13:08 (1726852388) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (2s) == sanity test 150c: Verify fallocate Size and Blocks ==== 13:13:10 (1726852390) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (1s) == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 13:13:11 (1726852391) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (2s) == sanity test 150f: Verify fallocate punch functionality ========================================================== 13:13:13 (1726852393) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (1s) == sanity test 150g: Verify fallocate punch on large range ========================================================== 13:13:14 (1726852394) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (2s) == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 13:13:16 (1726852396) oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000328045 s, 18.6 MB/s oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 PASS 155a (6s) == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 13:13:22 (1726852402) oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00168531 s, 3.6 MB/s oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 PASS 155b (5s) == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 13:13:27 (1726852407) oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000395521 s, 15.4 MB/s oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 PASS 155c (5s) == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 13:13:32 (1726852412) oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 oleg144-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg144-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00031605 s, 19.3 MB/s oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 oleg144-server: error: set_param: setting : Invalid argument pdsh@oleg144-client: oleg144-server: ssh exited with exit code 22 PASS 155d (5s) == sanity test 207a: can refresh layout at glimpse ======= 13:13:37 (1726852417) 6+0 records in 6+0 records out 24576 bytes (25 kB) copied, 0.0173999 s, 1.4 MB/s fail_loc=0x170 PASS 207a (3s) == sanity test 207b: can refresh layout at open ========== 13:13:40 (1726852420) 4+0 records in 4+0 records out 16384 bytes (16 kB) copied, 0.00842875 s, 1.9 MB/s fail_loc=0x171 checksum is ce338fe6899778aacfc28414f2d9498b /mnt/lustre/f207b.sanity PASS 207b (3s) == sanity test 241a: bio vs dio ========================== 13:13:43 (1726852423) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.0126757 s, 3.2 MB/s -rw-r--r-- 1 root root 40960 Sep 20 13:13 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c9ca800.lock_unused_count=1 PASS 241a (43s) == sanity test 241b: dio vs dio ========================== 13:14:26 (1726852466) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00908941 s, 4.5 MB/s -rw-r--r-- 1 root root 40960 Sep 20 13:14 /mnt/lustre/f241b.sanity PASS 241b (24s) == sanity test 251a: Handling short read and write correctly ========================================================== 13:14:50 (1726852490) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (4s) == sanity test 251b: short read restore offset correctly ========================================================== 13:14:54 (1726852494) 4+0 records in 4+0 records out 4096 bytes (4.1 kB) copied, 0.00641792 s, 638 kB/s fail_loc=0x1431 fail_val=5 PASS 251b (7s) == sanity test complete, duration 498 sec ================ 13:15:04 (1726852504) === sanity: start cleanup 13:15:04 (1726852504) === Starting client oleg144-client.virtnet: -o user_xattr,flock 192.168.201.144@tcp:/lustre /mnt/lustre2 Started clients oleg144-client.virtnet: 192.168.201.144@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Stopping clients: oleg144-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg144-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 13:15:07 (1726852507) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (503s) == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 13:15:08 (1726852508) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 excepting tests: 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 13:15:15 (1726852515) === Starting client oleg144-client.virtnet: -o user_xattr,flock 192.168.201.144@tcp:/lustre /mnt/lustre2 Started clients oleg144-client.virtnet: 192.168.201.144@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg144-client.virtnet: executing check_config_client /mnt/lustre oleg144-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg144-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88007c9ca800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b64df800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88007c9ca800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b64df800.idle_timeout=debug disable quota as required oleg144-server: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 13:15:25 (1726852525) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123614 s, 84.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f5915] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 13:15:25 (1726852525) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 13:15:27 (1726852527) -rw-r--r-- 1 root root 0 Sep 20 13:15 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 13:15:29 (1726852529) -rw-r--r-- 1 root root 0 Sep 20 13:15 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 13:15:31 (1726852531) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (1s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 13:15:32 (1726852532) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 13:15:34 (1726852534) total 366 -rwxrwxrwx 1 root root 0 Sep 20 13:15 f2a -rwxrwxrwx 1 root root 0 Sep 20 13:15 f2b -rw-r--r-- 1 root root 1140184 Sep 20 13:06 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Sep 20 13:06 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71192 Sep 20 13:06 ffsx.sanity-dom.fsxlog total 366 -rwxrwxrwx 1 root root 0 Sep 20 13:15 f2a -rwxrwxrwx 1 root root 0 Sep 20 13:15 f2b -rw-r--r-- 1 root root 1140184 Sep 20 13:06 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Sep 20 13:06 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71192 Sep 20 13:06 ffsx.sanity-dom.fsxlog running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00370845 s, 138 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 13:15:37 (1726852537) /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has type file OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn has perms 0777 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by user #500 OK /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn is owned by group #500 OK Can't lstat /mnt/lustre2/d2f.sanityn/remote_dir/f2f.sanityn: No such file or directory PASS 2f (3s) == sanityn test 2g: check blocks update on sync write ==== 13:15:39 (1726852539) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.132368 s, 15.8 MB/s /mnt/lustre/f2g.sanityn has 4113 blocks /mnt/lustre2/f2g.sanityn has 4113 blocks PASS 2g (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 13:15:41 (1726852541) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 13:15:44 (1726852544) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 13:15:47 (1726852547) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (3s) == sanityn test 7: remove of open directory on other node ======================================================================= 13:15:49 (1726852549) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 13:15:51 (1726852551) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 13:15:53 (1726852553) PASS 9a (3s) == sanityn test 9b: append to striped sparse file ======== 13:15:56 (1726852556) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177701 s, 59.0 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0146841 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 13:15:58 (1726852558) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0020832 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00367804 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00348237 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00311436 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00674334 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00388056 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00392062 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0043597 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00346834 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00519536 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00339872 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00251038 s, 0.4 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 13:16:00 (1726852560) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00437686 s, 702 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.01769 s, 232 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000413849 s, 7.4 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 13:16:02 (1726852562) striped dir -i1 -c2 -H all_char /mnt/lustre/d11 multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.5915 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (3s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 13:16:05 (1726852565) warning: '-runtime' deprecated, use '-t runtime' instead - link 1520 (time 1726852576.14 total 10.00 last 152.00) - link 3021 (time 1726852586.14 total 20.00 last 150.04) - link 4668 (time 1726852596.15 total 30.01 last 164.60) - link 6254 (time 1726852606.15 total 40.01 last 158.60) - link 8121 (time 1726852616.15 total 50.02 last 186.58) - link 9440 (time 1726852626.16 total 60.03 last 131.79) - link 10000 (time 1726852631.11 total 64.97 last 113.15) - link 11132 (time 1726852641.12 total 74.98 last 113.15) - link 12121 (time 1726852651.12 total 84.98 last 98.89) - link 13309 (time 1726852661.12 total 94.98 last 118.76) total: 13851 link in 100.01 seconds: 138.50 ops/second using seed 4143139905 running for 100 seconds - stat 3961 (time 1726852578 ; total 11 ; last 11) - stat 10000 (time 1726852580 ; total 13 ; last 2) - stat 20000 (time 1726852584 ; total 17 ; last 4) - stat 30000 (time 1726852589 ; total 22 ; last 5) - stat 40000 (time 1726852593 ; total 26 ; last 4) - stat 50000 (time 1726852597 ; total 30 ; last 4) - stat 60000 (time 1726852601 ; total 34 ; last 4) - stat 70000 (time 1726852605 ; total 38 ; last 4) - stat 80000 (time 1726852610 ; total 43 ; last 5) - stat 90000 (time 1726852613 ; total 46 ; last 3) - stat 100000 (time 1726852619 ; total 52 ; last 6) - stat 105708 (time 1726852630 ; total 63 ; last 11) - stat 110000 (time 1726852638 ; total 71 ; last 8) - stat 115350 (time 1726852649 ; total 82 ; last 11) - stat 120000 (time 1726852655 ; total 88 ; last 6) - stat 125659 (time 1726852666 ; total 99 ; last 11) total: 126838 stats in 100 seconds: 1268.380005 stats/second - unlinked 0 (time 1726852617 ; total 0 ; last 0) - unlinked 10000 (time 1726852708 ; total 91 ; last 91) unlink(/mnt/lustre2/lockdir/lockfile13851) error: No such file or directory total: 13850 unlinks in 115 seconds: 120.434784 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (19469) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (19471) - No such process PASS 12 (168s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 13:18:53 (1726852733) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d14aa.sanityn multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.5915 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4827: 20251 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 13:18:55 (1726852735) striped dir -i0 -c2 -H all_char /mnt/lustre/d14ab.sanityn open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4827: 20894 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 13:18:57 (1726852737) striped dir -i0 -c2 -H crush2 /mnt/lustre/d14b.sanityn truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 21536 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 13:18:59 (1726852739) striped dir -i0 -c2 -H all_char /mnt/lustre/d14c.sanityn cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 22179 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 13:19:01 (1726852741) striped dir -i0 -c2 -H crush /mnt/lustre/d14d.sanityn chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 22822 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 13:19:05 (1726852745) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 19: test concurrent uncached read races ========================================================================= 13:19:09 (1726852749) oleg144-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg144-client: oleg144-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 13:19:11 (1726852751) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d20.sanityn PASS 20 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 13:19:13 (1726852753) now is 1726852754 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.5915 new atime is 1726852815 PASS 23 (64s) == sanityn test 27: align non-overlapping extent locks from request ============================================================= 13:20:17 (1726852817) 4+0 records in 4+0 records out 16793600 bytes (17 MB) copied, 0.322063 s, 52.1 MB/s dd 1 started dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB) copied, 0.666609 s, 23.6 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB) copied, 0.0124492 s, 658 kB/s dd 3 finished PASS 27 (7s) == sanityn test 39a: file mtime does not change after rename ========================================================== 13:20:24 (1726852824) repeat after cancel_lru_locks PASS 39a (3s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 13:20:27 (1726852827) repeat after cancel_lru_locks PASS 39b (4s) == sanityn test 39c: check truncate mtime update ================================================================================ 13:20:31 (1726852831) repeat after cancel_lru_locks PASS 39c (4s) == sanityn test 39d: sync write should update mtime ====== 13:20:35 (1726852835) fail_loc=0x411 fail_loc=0 PASS 39d (3s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 13:20:38 (1726852838) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00981775 s, 16.2 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3514: kill: (29896) - No such process PASS 51a (5s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 13:20:43 (1726852843) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0088326 s, 116 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 13:20:50 (1726852850) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011591 s, 90.5 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 107a: Basic grouplock conflict =========== 13:20:54 (1726852854) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.187413 s, 55.9 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x2c0000401:0x1f4:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.5915 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.5915 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 13:20:59 (1726852859) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.163194 s, 64.3 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x280000401:0x1f7:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.5915 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) cleanup: ====================================================== == sanityn test complete, duration 360 sec =============== 13:21:09 (1726852869) === sanityn: start cleanup 13:21:09 (1726852869) === Stopping clients: oleg144-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg144-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 13:21:10 (1726852870) === PASS sanityn (364s) == sanity-dom test complete, duration 933 sec ============ 13:21:12 (1726852872) === sanity-dom: start cleanup 13:21:12 (1726852872) === Stopping clients: oleg144-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 13:21:12 (1726852872) ===