-----============= acceptance-small: sanity-dom ============----- Fri Mar 22 03:09:36 EDT 2024 excepting tests: === sanity-dom: start setup 03:09:37 (1711091377) === Starting client oleg448-client.virtnet: -o user_xattr,flock oleg448-server@tcp:/lustre /mnt/lustre2 Started clients oleg448-client.virtnet: 192.168.204.148@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg448-client.virtnet: executing check_config_client /mnt/lustre oleg448-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg448-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a9e2e000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012a6dc000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9e2e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a6dc000.idle_timeout=debug disable quota as required oleg448-server: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 03:09:45 (1711091385) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6742] 192.168.204.148@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 1: write a file on one mount, truncate on the other, write again ========================================================== 03:09:47 (1711091387) 1+0 records in 1+0 records out 7168 bytes (7.2 kB) copied, 0.00158974 s, 4.5 MB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00225184 s, 1.4 MB/s /mnt/lustre2/f1.sanity-dom has type file OK /mnt/lustre2/f1.sanity-dom has size 6144 OK PASS 1 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 03:09:50 (1711091390) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00704984 s, 149 MB/s 1+0 records in 1+0 records out 234852 bytes (235 kB) copied, 0.00174737 s, 134 MB/s 0+1 records in 0+1 records out 234852 bytes (235 kB) copied, 0.00563068 s, 41.7 MB/s /mnt/lustre/f2.sanity-dom_left has type file OK /mnt/lustre/f2.sanity-dom_left has size 234852 OK PASS 2 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 3: Truncate over DoM size on different nodes ========================================================== 03:09:52 (1711091392) 1+0 records in 1+0 records out 1048476 bytes (1.0 MB) copied, 0.00832035 s, 126 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00612986 s, 668 kB/s /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049276 OK /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049076 OK /mnt/lustre/f3.sanity-dom has type file OK /mnt/lustre/f3.sanity-dom has size 1049076 OK PASS 3 (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 03:09:55 (1711091395) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.026586 s, 78.9 MB/s fail_loc=0x80000808 PASS 4 (3s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 5: DoM truncate deadlock ============== 03:09:59 (1711091399) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00119046 s, 3.4 MB/s multiop /mnt/lustre/f5.sanity-dom vO_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6742 multiop /mnt/lustre/f5.sanity-dom vO_Tc TMPPIPE=/tmp/multiop_open_wait_pipe.6742 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f5.sanity-dom user.job="dd.0" fail_loc=0x80001415 fail_val=5 PASS 5 (4s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 6: Race two writes, check file size === 03:10:05 (1711091405) /mnt/lustre2/f6.sanity-dom has size 500 OK PASS 6 (3s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 7: Stale pages after read-on-open ===== 03:10:09 (1711091409) 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00173288 s, 577 kB/s 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00175037 s, 571 kB/s PASS 7 (1s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test fsx: Dual-mount fsx with DoM files ==== 03:10:12 (1711091412) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 1412 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x8361e 000004[1] 1711091412.561447 trunc from 00000000 to 0x08361d (0x8361e bytes) 1711091412.565405 truncate done 000005[1] 1711091412.566579 mapwrite 0x1bfcdf thru 0x1cbaab (0xbdcd bytes) 1711091412.569694 truncate done 1711091412.569880 mmap done 1711091412.599978 msync done 1711091412.600056 munmap done 000008[0] 1711091412.606659 read 0x13796e thru 0x14520d (0xd8a0 bytes) 1711091412.612873 read done 000010[1] 1711091412.617525 trunc from 0x1cbaac to 0x06e83e (0x15d26d bytes) 1711091412.623420 truncate done 000011[1] 1711091412.627979 mapwrite 0x0b6105 thru 0x0bad74 (0x4c70 bytes) 1711091412.631057 truncate done 1711091412.631165 mmap done 1711091412.647169 msync done 1711091412.647225 munmap done truncating to largest ever: 0x1b0413 000013[0] 1711091412.652847 trunc from 0x0bad75 to 0x1b0412 (0xf569e bytes) 1711091412.662005 truncate done 000015[1] 1711091412.663632 trunc from 0x1b0413 to 0x0efc5b (0xc07b7 bytes) 1711091412.671317 truncate done 000016[1] 1711091412.676157 trunc from 0x0efc5c to 0x019131 (0xd6b2a bytes) 1711091412.680125 truncate done 000018[1] 1711091412.689409 write 0x19c9f9 thru 0x1a3cc4 (0x72cc bytes) 1711091412.690399 write done 000019[1] 1711091412.694172 mapwrite 0x19de40 thru 0x1aa05a (0xc21b bytes) 1711091412.697618 truncate done 1711091412.697796 mmap done 1711091412.722861 msync done 1711091412.722961 munmap done 000020[1] 1711091412.728157 mapread 0x0af271 thru 0x0b9aba (0xa84a bytes) 1711091412.728426 mmap done 1711091412.732386 memcpy done 1711091412.732438 munmap done 000022[1] 1711091412.737378 mapwrite 0x0647df thru 0x06ac01 (0x6423 bytes) 1711091412.737672 mmap done 1711091412.757222 msync done 1711091412.757299 munmap done 000026[0] 1711091412.769179 trunc from 0x1aa05b to 0x12a6ce (0x7f98c bytes) 1711091412.778761 truncate done 000029[0] 1711091412.789902 trunc from 0x12a6cf to 0x0d8b7f (0x51b4f bytes) 1711091412.794364 truncate done 000030[0] 1711091412.795917 mapwrite 0x03e630 thru 0x04b2b6 (0xcc87 bytes) 1711091412.796224 mmap done 1711091412.821757 msync done 1711091412.821847 munmap done 000033[1] 1711091412.822866 mapread 0x029a66 thru 0x036055 (0xc5f0 bytes) 1711091412.825025 mmap done 1711091412.835574 memcpy done 1711091412.835639 munmap done 000036[0] 1711091412.845551 mapwrite 0x1006b1 thru 0x102cf4 (0x2644 bytes) 1711091412.852039 truncate done 1711091412.852180 mmap done 1711091412.866563 msync done 1711091412.866634 munmap done 000037[1] 1711091412.868128 mapread 0x0d0ba4 thru 0x0d5273 (0x46d0 bytes) 1711091412.869993 mmap done 1711091412.878302 memcpy done 1711091412.878370 munmap done 000038[0] 1711091412.879628 write 0x1dd8ef thru 0x1e5270 (0x7982 bytes) 1711091412.880223 write done 000039[1] 1711091412.884818 read 0x05253b thru 0x059f03 (0x79c9 bytes) 1711091412.886291 read done 000042[0] 1711091412.890045 mapwrite 0x0c964e thru 0x0d5b44 (0xc4f7 bytes) 1711091412.890258 mmap done 1711091412.908056 msync done 1711091412.908140 munmap done 000043[0] 1711091412.908507 read 0x070cd8 thru 0x076a0c (0x5d35 bytes) 1711091412.916812 read done 000044[1] 1711091412.920817 mapwrite 0x070891 thru 0x079741 (0x8eb1 bytes) 1711091412.922696 mmap done 1711091412.944976 msync done 1711091412.945040 munmap done 000045[0] 1711091412.948763 write 0x15ec1e thru 0x16ebc0 (0xffa3 bytes) 1711091412.949539 write done 000046[1] 1711091412.952918 read 0x0da54a thru 0x0df414 (0x4ecb bytes) 1711091412.958189 read done 000047[1] 1711091412.961356 mapwrite 0x12e18e thru 0x13caee (0xe961 bytes) 1711091412.963387 mmap done 1711091412.992944 msync done 1711091412.993015 munmap done 000049[1] 1711091413.000760 trunc from 0x1e5271 to 0x0150ed (0x1d0183 bytes) 1711091413.006259 truncate done 000050[0] 1711091413.007914 mapread 0x00e717 thru 0x0150ed (0x69d7 bytes) 1711091413.010351 mmap done 1711091413.022751 memcpy done 1711091413.022837 munmap done 000052[1] 1711091413.028582 trunc from 0x0150ee to 0x177ef9 (0x162e0c bytes) 1711091413.034155 truncate done 000058[1] 1711091413.044367 mapread 0x10a87f thru 0x1196ad (0xee2f bytes) 1711091413.044539 mmap done 1711091413.062857 memcpy done 1711091413.062921 munmap done 000059[1] 1711091413.063226 trunc from 0x177efa to 0x16c9d9 (0xb520 bytes) 1711091413.067375 truncate done 000060[0] 1711091413.072011 write 0x0c1777 thru 0x0cdb77 (0xc401 bytes) 1711091413.074870 write done 000062[0] 1711091413.083309 trunc from 0x16c9da to 0x07992c (0xf30ad bytes) 1711091413.088741 truncate done 000067[0] 1711091413.110472 mapread 0x064e0a thru 0x066c9b (0x1e92 bytes) 1711091413.110710 mmap done 1711091413.115188 memcpy done 1711091413.115243 munmap done 000068[0] 1711091413.119887 write 0x08e41e thru 0x09a6ec (0xc2cf bytes) 1711091413.120454 write done 000070[0] 1711091413.125804 read 0x0981b5 thru 0x09a6ec (0x2538 bytes) 1711091413.125970 read done 000074[0] 1711091413.127213 read 0x029812 thru 0x02e696 (0x4e85 bytes) 1711091413.132874 read done 000075[0] 1711091413.133197 write 0x1d55c3 thru 0x1e2936 (0xd374 bytes) 1711091413.133943 write done 000076[0] 1711091413.138231 mapread 0x1b343c thru 0x1c21b1 (0xed76 bytes) 1711091413.138476 mmap done 1711091413.143887 memcpy done 1711091413.143959 munmap done 000077[0] 1711091413.144262 mapwrite 0x1a6093 thru 0x1b5195 (0xf103 bytes) 1711091413.144476 mmap done 1711091413.168738 msync done 1711091413.168812 munmap done 000078[1] 1711091413.172771 write 0x17f880 thru 0x18d54f (0xdcd0 bytes) 1711091413.179065 write done 000079[0] 1711091413.182988 write 0x0f449b thru 0x0f9deb (0x5951 bytes) 1711091413.183437 write done 000081[1] 1711091413.190646 mapread 0x08387b thru 0x085d18 (0x249e bytes) 1711091413.192493 mmap done 1711091413.201378 memcpy done 1711091413.201474 munmap done 000082[0] 1711091413.205024 mapwrite 0x07bf33 thru 0x08316d (0x723b bytes) 1711091413.207065 mmap done 1711091413.231134 msync done 1711091413.231195 munmap done 000083[1] 1711091413.234895 write 0x19fa17 thru 0x1ab72c (0xbd16 bytes) 1711091413.237878 write done truncating to largest ever: 0x1d63c6 000084[1] 1711091413.241375 trunc from 0x1e2937 to 0x1d63c5 (0xc571 bytes) 1711091413.246945 truncate done 000085[1] 1711091413.248224 mapread 0x1ae4af thru 0x1b8163 (0x9cb5 bytes) 1711091413.248396 mmap done 1711091413.259306 memcpy done 1711091413.259382 munmap done 000086[0] 1711091413.259630 trunc from 0x1d63c6 to 0x0d84da (0xfdeeb bytes) 1711091413.270428 truncate done 000090[1] 1711091413.283488 mapread 0x0c2c05 thru 0x0c320c (0x608 bytes) 1711091413.285546 mmap done 1711091413.289624 memcpy done 1711091413.289688 munmap done 000091[1] 1711091413.292970 mapread 0x02f44a thru 0x03acc2 (0xb879 bytes) 1711091413.294622 mmap done 1711091413.307544 memcpy done 1711091413.307613 munmap done 000093[0] 1711091413.314189 mapwrite 0x069d70 thru 0x06e5b0 (0x4841 bytes) 1711091413.315219 mmap done 1711091413.334366 msync done 1711091413.334444 munmap done 000094[1] 1711091413.334729 mapwrite 0x13360a thru 0x13711e (0x3b15 bytes) 1711091413.342623 truncate done 1711091413.342801 mmap done 1711091413.364014 msync done 1711091413.364094 munmap done 000096[1] 1711091413.370915 mapread 0x032113 thru 0x037274 (0x5162 bytes) 1711091413.371174 mmap done 1711091413.378213 memcpy done 1711091413.378269 munmap done 000097[1] 1711091413.382138 trunc from 0x13711f to 0x09590d (0xa1811 bytes) 1711091413.386167 truncate done 000098[1] 1711091413.390886 write 0x09419f thru 0x09ca7f (0x88e1 bytes) 1711091413.392683 write done 000103[0] 1711091413.409462 trunc from 0x09ca80 to 0x141629 (0xa4baa bytes) 1711091413.419897 truncate done 000104[1] 1711091413.425959 write 0x18af4c thru 0x19161f (0x66d4 bytes) 1711091413.428842 write done 000106[1] 1711091413.435772 write 0x1c9e08 thru 0x1d03f1 (0x65ea bytes) 1711091413.436286 write done 000107[1] 1711091413.439506 trunc from 0x1d03f2 to 0x1ab526 (0x24ecb bytes) 1711091413.443832 truncate done 000110[0] 1711091413.445615 read 0x0cad68 thru 0x0cb6f3 (0x98c bytes) 1711091413.457558 read done 000111[1] 1711091413.462564 mapwrite 0x17a746 thru 0x17eaa6 (0x4361 bytes) 1711091413.463617 mmap done 1711091413.489580 msync done 1711091413.489650 munmap done 000113[1] 1711091413.493667 write 0x1aafd4 thru 0x1b25ba (0x75e7 bytes) 1711091413.495484 write done 000114[1] 1711091413.499073 write 0x0912d6 thru 0x09b6ef (0xa41a bytes) 1711091413.504886 write done 000116[1] 1711091413.509326 write 0x1088e2 thru 0x110ed7 (0x85f6 bytes) 1711091413.512084 write done 000117[1] 1711091413.512396 trunc from 0x1b25bb to 0x003d1f (0x1ae89b bytes) 1711091413.516620 truncate done 000119[0] 1711091413.522656 mapwrite 0x0b7e94 thru 0x0c5f08 (0xe075 bytes) 1711091413.530333 truncate done 1711091413.530513 mmap done 1711091413.546062 msync done 1711091413.546160 munmap done 000120[1] 1711091413.550800 write 0x0eadf7 thru 0x0f9347 (0xe551 bytes) 1711091413.553783 write done 000124[1] 1711091413.568356 mapwrite 0x17b8a4 thru 0x17e64a (0x2da7 bytes) 1711091413.574423 truncate done 1711091413.574618 mmap done 1711091413.593278 msync done 1711091413.593344 munmap done 000125[0] 1711091413.594892 write 0x013568 thru 0x014676 (0x110f bytes) 1711091413.603507 write done 000129[0] 1711091413.618595 read 0x103141 thru 0x1077aa (0x466a bytes) 1711091413.629457 read done 000132[0] 1711091413.641133 read 0x0b3d0e thru 0x0b4a1a (0xd0d bytes) 1711091413.641252 read done 000133[1] 1711091413.641545 mapread 0x1449fe thru 0x14fb2c (0xb12f bytes) 1711091413.643381 mmap done 1711091413.657528 memcpy done 1711091413.657592 munmap done 000134[0] 1711091413.661223 write 0x0e2be6 thru 0x0ecc26 (0xa041 bytes) 1711091413.661798 write done 000135[1] 1711091413.665401 trunc from 0x17e64b to 0x0b5c69 (0xc89e1 bytes) 1711091413.676250 truncate done 000136[1] 1711091413.680736 write 0x0ae9b4 thru 0x0b82de (0x992b bytes) 1711091413.682438 write done 000137[1] 1711091413.685846 read 0x08d3cb thru 0x08ea15 (0x164b bytes) 1711091413.691452 read done 000140[0] 1711091413.696425 mapread 0x0b16bc thru 0x0b82de (0x6c23 bytes) 1711091413.698049 mmap done 1711091413.709462 memcpy done 1711091413.709525 munmap done 000142[1] 1711091413.711274 mapwrite 0x0eb587 thru 0x0ee72b (0x31a5 bytes) 1711091413.718513 truncate done 1711091413.718710 mmap done 1711091413.733800 msync done 1711091413.733875 munmap done 000144[0] 1711091413.735854 trunc from 0x0ee72c to 0x15bcec (0x6d5c1 bytes) 1711091413.744355 truncate done 000146[1] 1711091413.750286 mapwrite 0x10599b thru 0x10ddeb (0x8451 bytes) 1711091413.752410 mmap done 1711091413.778868 msync done 1711091413.778991 munmap done 000147[0] 1711091413.783758 mapread 0x121bde thru 0x12e02a (0xc44d bytes) 1711091413.785867 mmap done 1711091413.793246 memcpy done 1711091413.793309 munmap done 000149[0] 1711091413.797508 mapwrite 0x080aaa thru 0x085d53 (0x52aa bytes) 1711091413.797769 mmap done 1711091413.818019 msync done 1711091413.818086 munmap done 000155[1] 1711091413.829845 trunc from 0x15bced to 0x194f5c (0x39270 bytes) 1711091413.839431 truncate done 000157[0] 1711091413.848994 read 0x192e41 thru 0x194f5c (0x211c bytes) 1711091413.857612 read done 000160[0] 1711091413.868987 mapread 0x10d9cb thru 0x11cb91 (0xf1c7 bytes) 1711091413.871142 mmap done 1711091413.889771 memcpy done 1711091413.889893 munmap done 000164[1] 1711091413.897909 trunc from 0x194f5d to 0x07c05c (0x118f00 bytes) 1711091413.904302 truncate done 000166[1] 1711091413.911144 write 0x090684 thru 0x09cad3 (0xc450 bytes) 1711091413.911918 write done 000167[1] 1711091413.912249 mapwrite 0x1f419a thru 0x1ff209 (0xb070 bytes) 1711091413.916306 truncate done 1711091413.916472 mmap done 1711091413.949602 msync done 1711091413.949709 munmap done 000169[0] 1711091413.956304 write 0x123240 thru 0x124a51 (0x1812 bytes) 1711091413.962326 write done 000171[0] 1711091413.970837 trunc from 0x1ff20a to 0x0aed04 (0x150505 bytes) 1711091413.979314 truncate done 000173[1] 1711091413.988006 write 0x046255 thru 0x04da10 (0x77bc bytes) 1711091413.993097 write done 000179[0] 1711091414.018771 read 0x01254b thru 0x01ba87 (0x953d bytes) 1711091414.028385 read done 000181[0] 1711091414.035410 read 0x09446e thru 0x0a3a3c (0xf5cf bytes) 1711091414.035555 read done 000182[1] 1711091414.035766 read 0x0875b4 thru 0x08d4ed (0x5f3a bytes) 1711091414.042133 read done 000187[1] 1711091414.050637 write 0x15c5f7 thru 0x1648e8 (0x82f2 bytes) 1711091414.053519 write done 000189[0] 1711091414.057552 write 0x093ce3 thru 0x09819b (0x44b9 bytes) 1711091414.068564 write done 000190[0] 1711091414.073147 mapwrite 0x143981 thru 0x14cc0e (0x928e bytes) 1711091414.075461 mmap done 1711091414.123451 msync done 1711091414.123549 munmap done 000191[0] 1711091414.123832 read 0x03a9ae thru 0x049a19 (0xf06c bytes) 1711091414.124001 read done 000194[1] 1711091414.134150 mapwrite 0x158d08 thru 0x167780 (0xea79 bytes) 1711091414.146745 truncate done 1711091414.147000 mmap done 1711091414.176423 msync done 1711091414.176512 munmap done 000195[0] 1711091414.181615 trunc from 0x167781 to 0x05a457 (0x10d329 bytes) 1711091414.189140 truncate done 000196[1] 1711091414.190551 mapread 0x041331 thru 0x04c892 (0xb562 bytes) 1711091414.192563 mmap done 1711091414.208404 memcpy done 1711091414.208550 munmap done 000197[1] 1711091414.210232 mapread 0x026913 thru 0x0361ee (0xf8dc bytes) 1711091414.212378 mmap done 1711091414.231678 memcpy done 1711091414.231751 munmap done 000200[0] 1711091414.232708 mapwrite 0x09584a thru 0x0a1ee6 (0xc69d bytes) 1711091414.238193 truncate done 1711091414.238397 mmap done 1711091414.264176 msync done 1711091414.264357 munmap done 000201[1] 1711091414.272523 mapread 0x074739 thru 0x07dbae (0x9476 bytes) 1711091414.274654 mmap done 1711091414.290843 memcpy done 1711091414.290955 munmap done 000202[0] 1711091414.294625 mapwrite 0x1a9968 thru 0x1afecf (0x6568 bytes) 1711091414.301371 truncate done 1711091414.301574 mmap done 1711091414.328268 msync done 1711091414.328372 munmap done 000205[1] 1711091414.335461 trunc from 0x1afed0 to 0x0044eb (0x1ab9e4 bytes) 1711091414.344059 truncate done 000207[0] 1711091414.351281 mapread 0x001ee1 thru 0x0044eb (0x260b bytes) 1711091414.353462 mmap done 1711091414.362289 memcpy done 1711091414.362398 munmap done 000209[1] 1711091414.364088 write 0x1169f9 thru 0x123b57 (0xd15f bytes) 1711091414.364949 write done 000215[0] 1711091414.377260 read 0x09fa3d thru 0x0a32fa (0x38be bytes) 1711091414.388750 read done 000217[0] 1711091414.396673 mapread 0x10e904 thru 0x113b1d (0x521a bytes) 1711091414.399012 mmap done 1711091414.409501 memcpy done 1711091414.409581 munmap done 000218[0] 1711091414.411051 write 0x125a76 thru 0x12da55 (0x7fe0 bytes) 1711091414.414555 write done 000219[1] 1711091414.414816 read 0x011644 thru 0x01ff2c (0xe8e9 bytes) 1711091414.434321 read done 000220[0] 1711091414.434738 write 0x1a725f thru 0x1b1a2e (0xa7d0 bytes) 1711091414.435527 write done 000222[0] 1711091414.443605 mapwrite 0x0f3484 thru 0x101924 (0xe4a1 bytes) 1711091414.443971 mmap done 1711091414.498264 msync done 1711091414.498355 munmap done 000225[1] 1711091414.499296 read 0x0aa85f thru 0x0b83cb (0xdb6d bytes) 1711091414.512349 read done 000228[1] 1711091414.514263 mapwrite 0x16245f thru 0x167d3f (0x58e1 bytes) 1711091414.516392 mmap done 1711091414.541658 msync done 1711091414.541723 munmap done 000229[1] 1711091414.546016 write 0x1a9649 thru 0x1aedaa (0x5762 bytes) 1711091414.546374 write done 000233[1] 1711091414.550898 mapwrite 0x1c0c6b thru 0x1c9623 (0x89b9 bytes) 1711091414.558857 truncate done 1711091414.559077 mmap done 1711091414.578751 msync done 1711091414.578895 munmap done 000234[1] 1711091414.580714 mapwrite 0x163717 thru 0x1697bc (0x60a6 bytes) 1711091414.580996 mmap done 1711091414.601526 msync done 1711091414.601581 munmap done 000236[0] 1711091414.607178 read 0x06ba6b thru 0x077cbb (0xc251 bytes) 1711091414.617185 read done 000237[0] 1711091414.618530 mapwrite 0x10399e thru 0x10e926 (0xaf89 bytes) 1711091414.620493 mmap done 1711091414.642593 msync done 1711091414.642655 munmap done 000238[1] 1711091414.642963 mapread 0x123f2e thru 0x12500f (0x10e2 bytes) 1711091414.644828 mmap done 1711091414.650567 memcpy done 1711091414.650638 munmap done 000241[0] 1711091414.652056 mapread 0x10846e thru 0x10b6a4 (0x3237 bytes) 1711091414.652224 mmap done 1711091414.655767 memcpy done 1711091414.655807 munmap done 000244[1] 1711091414.656311 mapread 0x0bd8b5 thru 0x0c9412 (0xbb5e bytes) 1711091414.656421 mmap done 1711091414.670449 memcpy done 1711091414.670518 munmap done 000245[0] 1711091414.670902 trunc from 0x1c9624 to 0x02fa09 (0x199c1a bytes) 1711091414.680869 truncate done 000247[1] 1711091414.682517 trunc from 0x02fa0a to 0x1bfd9b (0x190392 bytes) 1711091414.690438 truncate done 000249[0] 1711091414.691894 write 0x18f892 thru 0x1981e9 (0x8958 bytes) 1711091414.696376 write done 000254[1] 1711091414.714639 mapwrite 0x1bf445 thru 0x1c3f7e (0x4b3a bytes) 1711091414.722956 truncate done 1711091414.723106 mmap done 1711091414.753033 msync done 1711091414.753125 munmap done 000255[1] 1711091414.754659 trunc from 0x1c3f7f to 0x0d9b20 (0xea45e bytes) 1711091414.757276 truncate done 000256[1] 1711091414.761885 read 0x05f219 thru 0x0666fa (0x74e2 bytes) 1711091414.769143 read done 000260[1] 1711091414.782166 write 0x107722 thru 0x11427e (0xcb5d bytes) 1711091414.783010 write done 000263[0] 1711091414.787052 write 0x05110e thru 0x05b9f1 (0xa8e4 bytes) 1711091414.792397 write done 000264[1] 1711091414.796050 mapwrite 0x1c76be thru 0x1c81f5 (0xb38 bytes) 1711091414.804219 truncate done 1711091414.804360 mmap done 1711091414.831847 msync done 1711091414.831942 munmap done 000265[1] 1711091414.836862 mapwrite 0x0def0a thru 0x0e67b5 (0x78ac bytes) 1711091414.837153 mmap done 1711091414.848849 msync done 1711091414.848942 munmap done 000266[1] 1711091414.852447 mapwrite 0x159a38 thru 0x1657ae (0xbd77 bytes) 1711091414.852732 mmap done 1711091414.868471 msync done 1711091414.868543 munmap done 000267[0] 1711091414.870301 mapwrite 0x178c7e thru 0x17eb89 (0x5f0c bytes) 1711091414.872450 mmap done 1711091414.895648 msync done 1711091414.895700 munmap done 000268[0] 1711091414.898908 write 0x0ca6f9 thru 0x0d0b5d (0x6465 bytes) 1711091414.903351 write done 000272[0] 1711091414.907169 mapread 0x1708ae thru 0x174cd2 (0x4425 bytes) 1711091414.907298 mmap done 1711091414.912322 memcpy done 1711091414.912371 munmap done 000273[1] 1711091414.915984 mapwrite 0x13f592 thru 0x143d84 (0x47f3 bytes) 1711091414.917663 mmap done 1711091414.939691 msync done 1711091414.939751 munmap done 000274[1] 1711091414.943444 mapwrite 0x1f5e0a thru 0x1fffff (0xa1f6 bytes) 1711091414.951649 truncate done 1711091414.951861 mmap done 1711091414.982401 msync done 1711091414.982475 munmap done 000276[0] 1711091414.990833 trunc from 0x200000 to 0x17e770 (0x8188f bytes) 1711091414.997116 truncate done 000277[0] 1711091414.998415 trunc from 0x17e771 to 0x1b88a4 (0x3a134 bytes) 1711091415.000511 truncate done 000279[0] 1711091415.008423 read 0x067e9b thru 0x07034a (0x84b0 bytes) 1711091415.019151 read done 000280[1] 1711091415.022774 read 0x0b7d9f thru 0x0c3915 (0xbb77 bytes) 1711091415.032579 read done 000281[1] 1711091415.036361 read 0x1364fe thru 0x138ce1 (0x27e4 bytes) 1711091415.045867 read done truncating to largest ever: 0x1d794e 000282[0] 1711091415.048120 trunc from 0x1b88a5 to 0x1d794d (0x1f0a9 bytes) 1711091415.056694 truncate done 000283[0] 1711091415.061156 trunc from 0x1d794e to 0x01b029 (0x1bc924 bytes) 1711091415.064467 truncate done 000284[1] 1711091415.069127 mapwrite 0x14a6b5 thru 0x14f8d6 (0x5222 bytes) 1711091415.075426 truncate done 1711091415.075565 mmap done 1711091415.104515 msync done 1711091415.104569 munmap done 000286[1] 1711091415.106111 mapread 0x1407f5 thru 0x14f594 (0xeda0 bytes) 1711091415.106241 mmap done 1711091415.115882 memcpy done 1711091415.115968 munmap done 000287[0] 1711091415.120713 trunc from 0x14f8d7 to 0x1378de (0x17ff8 bytes) 1711091415.128089 truncate done 000292[0] 1711091415.143045 write 0x06f718 thru 0x07a679 (0xaf62 bytes) 1711091415.145989 write done 000295[1] 1711091415.156986 mapread 0x04c4c3 thru 0x04e8f8 (0x2436 bytes) 1711091415.158675 mmap done 1711091415.166133 memcpy done 1711091415.166227 munmap done 000297[0] 1711091415.173452 trunc from 0x1378df to 0x164674 (0x2cd96 bytes) 1711091415.179593 truncate done 000301[0] 1711091415.189980 mapwrite 0x1aeeb7 thru 0x1b1a26 (0x2b70 bytes) 1711091415.193767 truncate done 1711091415.193985 mmap done 1711091415.221313 msync done 1711091415.221370 munmap done 000302[1] 1711091415.226673 mapwrite 0x101a81 thru 0x103276 (0x17f6 bytes) 1711091415.228669 mmap done 1711091415.248313 msync done 1711091415.248379 munmap done 000303[0] 1711091415.252316 trunc from 0x1b1a27 to 0x069d66 (0x147cc0 bytes) 1711091415.258001 truncate done 000305[0] 1711091415.265385 trunc from 0x069d67 to 0x0fc970 (0x92c0a bytes) 1711091415.268648 truncate done 000306[1] 1711091415.269747 read 0x0de957 thru 0x0ee812 (0xfebc bytes) 1711091415.282581 read done 000312[1] 1711091415.297027 mapread 0x0dfb16 thru 0x0eb816 (0xbd01 bytes) 1711091415.298813 mmap done 1711091415.298896 memcpy done 1711091415.298975 munmap done 000313[1] 1711091415.302325 read 0x00106b thru 0x00a197 (0x912d bytes) 1711091415.302433 read done 000314[0] 1711091415.305542 mapread 0x04f1a0 thru 0x05115e (0x1fbf bytes) 1711091415.305698 mmap done 1711091415.309187 memcpy done 1711091415.309238 munmap done 000315[1] 1711091415.309567 read 0x0df313 thru 0x0e3ee1 (0x4bcf bytes) 1711091415.309656 read done 000316[1] 1711091415.310005 mapwrite 0x0719c4 thru 0x07c33a (0xa977 bytes) 1711091415.312027 mmap done 1711091415.346301 msync done 1711091415.346385 munmap done 000317[1] 1711091415.350885 write 0x09dcb5 thru 0x0a31d7 (0x5523 bytes) 1711091415.351384 write done 000318[0] 1711091415.355151 mapread 0x045452 thru 0x04a7ea (0x5399 bytes) 1711091415.357190 mmap done 1711091415.369321 memcpy done 1711091415.369414 munmap done truncating to largest ever: 0x1daad8 000319[1] 1711091415.372882 trunc from 0x0fc971 to 0x1daad7 (0xde167 bytes) 1711091415.380437 truncate done 000323[1] 1711091415.386575 mapwrite 0x0584ac thru 0x05c1b1 (0x3d06 bytes) 1711091415.386733 mmap done 1711091415.406063 msync done 1711091415.406141 munmap done 000324[0] 1711091415.409900 mapwrite 0x07195d thru 0x07a220 (0x88c4 bytes) 1711091415.411651 mmap done 1711091415.435341 msync done 1711091415.435455 munmap done 000325[0] 1711091415.438852 read 0x0e45b8 thru 0x0f09e0 (0xc429 bytes) 1711091415.446760 read done 000331[1] 1711091415.466111 mapread 0x09aa9d thru 0x0a49e7 (0x9f4b bytes) 1711091415.467754 mmap done 1711091415.480667 memcpy done 1711091415.480753 munmap done 000333[1] 1711091415.484588 read 0x0901a6 thru 0x092050 (0x1eab bytes) 1711091415.492220 read done 000336[0] 1711091415.499503 mapwrite 0x0fbf02 thru 0x0fe1ce (0x22cd bytes) 1711091415.501248 mmap done 1711091415.530820 msync done 1711091415.530890 munmap done 000338[1] 1711091415.538292 read 0x04c5e7 thru 0x052ee0 (0x68fa bytes) 1711091415.549556 read done 000340[0] 1711091415.550276 read 0x178c5a thru 0x184c44 (0xbfeb bytes) 1711091415.565008 read done 000343[0] 1711091415.565860 mapwrite 0x12ab9b thru 0x12dc3a (0x30a0 bytes) 1711091415.566044 mmap done 1711091415.599397 msync done 1711091415.599458 munmap done 000344[0] 1711091415.599765 write 0x009bc2 thru 0x010876 (0x6cb5 bytes) 1711091415.606675 write done 000350[0] 1711091415.618469 trunc from 0x1daad8 to 0x1b6ce3 (0x23df4 bytes) 1711091415.622032 truncate done 000352[1] 1711091415.623501 write 0x0f8ec3 thru 0x0fc0a9 (0x31e7 bytes) 1711091415.629423 write done 000354[0] 1711091415.636960 mapread 0x0714c4 thru 0x073b79 (0x26b6 bytes) 1711091415.638668 mmap done 1711091415.646069 memcpy done 1711091415.646157 munmap done 000356[0] 1711091415.646663 read 0x0d6eca thru 0x0d7351 (0x488 bytes) 1711091415.658667 read done 000357[1] 1711091415.659031 mapwrite 0x0c4e3d thru 0x0ce32d (0x94f1 bytes) 1711091415.661273 mmap done 1711091415.689284 msync done 1711091415.689349 munmap done 000358[0] 1711091415.693237 trunc from 0x1b6ce4 to 0x17d402 (0x398e1 bytes) 1711091415.699483 truncate done 000361[0] 1711091415.710034 mapwrite 0x032877 thru 0x038209 (0x5993 bytes) 1711091415.710287 mmap done 1711091415.731409 msync done 1711091415.731494 munmap done 000371[1] 1711091415.756167 write 0x040d41 thru 0x041004 (0x2c4 bytes) 1711091415.760368 write done 000374[1] 1711091415.770983 read 0x16477e thru 0x16ee35 (0xa6b8 bytes) 1711091415.783372 read done 000375[1] 1711091415.788186 mapwrite 0x19ee75 thru 0x1a3871 (0x49fd bytes) 1711091415.795697 truncate done 1711091415.795890 mmap done 1711091415.817404 msync done 1711091415.817476 munmap done 000376[1] 1711091415.822564 trunc from 0x1a3872 to 0x19ab0b (0x8d66 bytes) 1711091415.826180 truncate done 000379[1] 1711091415.827701 read 0x099047 thru 0x0a0b7c (0x7b36 bytes) 1711091415.827830 read done 000381[0] 1711091415.836050 mapwrite 0x1fdcc7 thru 0x1fffff (0x2339 bytes) 1711091415.845521 truncate done 1711091415.845656 mmap done 1711091415.874025 msync done 1711091415.874134 munmap done 000383[1] 1711091415.876106 mapread 0x08c1ff thru 0x08e5b0 (0x23b2 bytes) 1711091415.878098 mmap done 1711091415.887549 memcpy done 1711091415.887631 munmap done 000385[1] 1711091415.896399 trunc from 0x200000 to 0x16e05e (0x91fa1 bytes) 1711091415.904734 truncate done 000386[1] 1711091415.906354 mapwrite 0x03684e thru 0x038ee8 (0x269b bytes) 1711091415.906551 mmap done 1711091415.924018 msync done 1711091415.924097 munmap done 000388[0] 1711091415.932115 write 0x00e127 thru 0x01c021 (0xdefb bytes) 1711091415.936843 write done 000389[0] 1711091415.940308 mapread 0x135eda thru 0x13fe60 (0x9f87 bytes) 1711091415.942157 mmap done 1711091415.956043 memcpy done 1711091415.956151 munmap done 000390[1] 1711091415.959546 write 0x091e3a thru 0x0a0af7 (0xecbe bytes) 1711091415.966382 write done 000392[0] 1711091415.969849 mapread 0x13c101 thru 0x145b19 (0x9a19 bytes) 1711091415.971408 mmap done 1711091415.977558 memcpy done 1711091415.977629 munmap done 000393[1] 1711091415.980945 write 0x156be3 thru 0x163e38 (0xd256 bytes) 1711091415.986021 write done 000394[0] 1711091415.986257 read 0x05a7d0 thru 0x05fd24 (0x5555 bytes) 1711091415.997606 read done 000395[1] 1711091416.001286 trunc from 0x16e05f to 0x167d75 (0x62e9 bytes) 1711091416.007984 truncate done 000396[0] 1711091416.009335 mapread 0x0ed20d thru 0x0f3f73 (0x6d67 bytes) 1711091416.011196 mmap done 1711091416.020729 memcpy done 1711091416.020845 munmap done 000399[0] 1711091416.027062 mapread 0x024b8f thru 0x024b9b (0xd bytes) 1711091416.028877 mmap done 1711091416.030149 memcpy done 1711091416.030215 munmap done 000401[0] 1711091416.033911 read 0x06e2bd thru 0x06f263 (0xfa7 bytes) 1711091416.041434 read done 000403[0] 1711091416.048375 trunc from 0x167d76 to 0x10c7e3 (0x5b592 bytes) 1711091416.058265 truncate done 000406[0] 1711091416.066962 mapread 0x09ba90 thru 0x09fddb (0x434c bytes) 1711091416.067190 mmap done 1711091416.073522 memcpy done 1711091416.073605 munmap done 000408[0] 1711091416.074017 mapread 0x00ec93 thru 0x011b43 (0x2eb1 bytes) 1711091416.074174 mmap done 1711091416.078050 memcpy done 1711091416.078093 munmap done 000409[0] 1711091416.081445 write 0x007663 thru 0x00b83d (0x41db bytes) 1711091416.083721 write done 000412[1] 1711091416.088048 mapread 0x02ff19 thru 0x0336ef (0x37d7 bytes) 1711091416.089846 mmap done 1711091416.099901 memcpy done 1711091416.100016 munmap done 000413[0] 1711091416.103436 write 0x049702 thru 0x04bb07 (0x2406 bytes) 1711091416.107563 write done 000421[0] 1711091416.118804 mapwrite 0x0fed79 thru 0x1061b0 (0x7438 bytes) 1711091416.119095 mmap done 1711091416.149983 msync done 1711091416.150093 munmap done 000431[1] 1711091416.162627 mapwrite 0x176202 thru 0x17dfa3 (0x7da2 bytes) 1711091416.170737 truncate done 1711091416.170907 mmap done 1711091416.188843 msync done 1711091416.188949 munmap done 000432[0] 1711091416.190523 trunc from 0x17dfa4 to 0x05b180 (0x122e23 bytes) 1711091416.197827 truncate done 000433[1] 1711091416.202284 mapwrite 0x150b64 thru 0x155978 (0x4e15 bytes) 1711091416.208787 truncate done 1711091416.208913 mmap done 1711091416.240473 msync done 1711091416.240558 munmap done 000434[1] 1711091416.246272 write 0x11b673 thru 0x120748 (0x50d6 bytes) 1711091416.248980 write done 000436[1] 1711091416.254006 mapread 0x001d54 thru 0x00593b (0x3be8 bytes) 1711091416.254165 mmap done 1711091416.259525 memcpy done 1711091416.259595 munmap done 000437[0] 1711091416.263152 mapwrite 0x105161 thru 0x105e3d (0xcdd bytes) 1711091416.264863 mmap done 1711091416.284163 msync done 1711091416.284252 munmap done 000438[1] 1711091416.287664 write 0x085867 thru 0x08cf58 (0x76f2 bytes) 1711091416.288186 write done 000439[0] 1711091416.291321 trunc from 0x155979 to 0x0cea5b (0x86f1d bytes) 1711091416.298575 truncate done 000441[1] 1711091416.299962 trunc from 0x0cea5c to 0x15d0ec (0x8e691 bytes) 1711091416.306585 truncate done 000442[1] 1711091416.307760 mapread 0x0ae41d thru 0x0ae883 (0x467 bytes) 1711091416.307963 mmap done 1711091416.309097 memcpy done 1711091416.309336 munmap done 000447[0] 1711091416.317049 mapwrite 0x00ba94 thru 0x0118a9 (0x5e16 bytes) 1711091416.318815 mmap done 1711091416.336493 msync done 1711091416.336579 munmap done 000449[0] 1711091416.343171 read 0x0fac32 thru 0x0fda00 (0x2dcf bytes) 1711091416.355955 read done 000451[0] 1711091416.362482 trunc from 0x15d0ed to 0x1b9136 (0x5c04a bytes) 1711091416.367818 truncate done 000454[1] 1711091416.376981 mapread 0x02c0fb thru 0x038479 (0xc37f bytes) 1711091416.378828 mmap done 1711091416.394606 memcpy done 1711091416.394697 munmap done 000455[0] 1711091416.398133 read 0x0b7013 thru 0x0c3216 (0xc204 bytes) 1711091416.408374 read done 000456[0] 1711091416.408642 read 0x09900a thru 0x0a74c4 (0xe4bb bytes) 1711091416.408729 read done 000458[1] 1711091416.409086 write 0x0eccdd thru 0x0facfd (0xe021 bytes) 1711091416.412958 write done 000459[1] 1711091416.416219 write 0x0bea20 thru 0x0cd442 (0xea23 bytes) 1711091416.418844 write done 000460[1] 1711091416.422084 mapwrite 0x066fbb thru 0x06735e (0x3a4 bytes) 1711091416.423827 mmap done 1711091416.438309 msync done 1711091416.438378 munmap done 000461[1] 1711091416.441871 read 0x135ff4 thru 0x13e847 (0x8854 bytes) 1711091416.452592 read done 000463[1] 1711091416.453296 write 0x089f9b thru 0x08fffc (0x6062 bytes) 1711091416.455111 write done 000464[1] 1711091416.458595 mapwrite 0x144a2e thru 0x152ef7 (0xe4ca bytes) 1711091416.458879 mmap done 1711091416.504699 msync done 1711091416.504780 munmap done 000465[1] 1711091416.508426 mapread 0x11b4d1 thru 0x1255f8 (0xa128 bytes) 1711091416.508590 mmap done 1711091416.519995 memcpy done 1711091416.520086 munmap done 000466[1] 1711091416.523716 read 0x1a910c thru 0x1b7804 (0xe6f9 bytes) 1711091416.528959 read done 000467[1] 1711091416.532700 trunc from 0x1b9137 to 0x1703b5 (0x48d81 bytes) 1711091416.536363 truncate done 000468[0] 1711091416.537504 read 0x0cf22f thru 0x0d51e5 (0x5fb7 bytes) 1711091416.547691 read done 000470[0] 1711091416.555221 mapread 0x153118 thru 0x1588f1 (0x57da bytes) 1711091416.556711 mmap done 1711091416.562625 memcpy done 1711091416.562696 munmap done 000471[0] 1711091416.563776 read 0x0159c6 thru 0x020783 (0xadbe bytes) 1711091416.563877 read done 000473[0] 1711091416.564323 write 0x126d4e thru 0x12fb0d (0x8dc0 bytes) 1711091416.570974 write done 000474[0] 1711091416.571212 trunc from 0x1703b6 to 0x1d793e (0x67589 bytes) 1711091416.577371 truncate done 000475[1] 1711091416.578597 mapwrite 0x0a3c17 thru 0x0a5ced (0x20d7 bytes) 1711091416.580456 mmap done 1711091416.596376 msync done 1711091416.596438 munmap done 000479[1] 1711091416.610265 write 0x0c6abb thru 0x0d2287 (0xb7cd bytes) 1711091416.612861 write done 000480[0] 1711091416.616105 write 0x04877f thru 0x055d43 (0xd5c5 bytes) 1711091416.623966 write done 000488[0] 1711091416.635009 mapwrite 0x140481 thru 0x1441d4 (0x3d54 bytes) 1711091416.635196 mmap done 1711091416.656085 msync done 1711091416.656149 munmap done 000489[0] 1711091416.656533 mapread 0x020750 thru 0x026b76 (0x6427 bytes) 1711091416.656717 mmap done 1711091416.664304 memcpy done 1711091416.664345 munmap done 000490[0] 1711091416.668375 read 0x0662f7 thru 0x06cd49 (0x6a53 bytes) 1711091416.675243 read done 000491[0] 1711091416.675583 mapread 0x14edb6 thru 0x14fce8 (0xf33 bytes) 1711091416.675718 mmap done 1711091416.675753 memcpy done 1711091416.675792 munmap done truncating to largest ever: 0x1f405a 000498[0] 1711091416.694503 trunc from 0x1d793f to 0x1f4059 (0x1c71b bytes) 1711091416.698313 truncate done 000499[0] 1711091416.699712 mapwrite 0x149c30 thru 0x157bb7 (0xdf88 bytes) 1711091416.700079 mmap done 1711091416.716122 msync done 1711091416.716187 munmap done 000500[0] 1711091416.721155 mapwrite 0x178e91 thru 0x17e9b5 (0x5b25 bytes) 1711091416.721342 mmap done 1711091416.736346 msync done 1711091416.736410 munmap done 000503[1] 1711091416.740708 trunc from 0x1f405a to 0x1e97a4 (0xa8b5 bytes) 1711091416.751809 truncate done 000504[1] 1711091416.753291 read 0x02f167 thru 0x03cf29 (0xddc3 bytes) 1711091416.763757 read done 000505[1] 1711091416.768399 read 0x018c7e thru 0x01cb73 (0x3ef6 bytes) 1711091416.768513 read done 000507[1] 1711091416.772354 mapwrite 0x09cd42 thru 0x0a8737 (0xb9f6 bytes) 1711091416.772589 mmap done 1711091416.784533 msync done 1711091416.784603 munmap done 000512[1] 1711091416.798673 mapread 0x1ac21c thru 0x1b565a (0x943f bytes) 1711091416.798866 mmap done 1711091416.798957 memcpy done 1711091416.798994 munmap done 000513[0] 1711091416.799184 mapwrite 0x0fa26f thru 0x103f5f (0x9cf1 bytes) 1711091416.800848 mmap done 1711091416.854241 msync done 1711091416.854321 munmap done 000514[0] 1711091416.857833 write 0x1ce453 thru 0x1d0d29 (0x28d7 bytes) 1711091416.860707 write done 000521[0] 1711091416.875586 read 0x0d9cec thru 0x0e55a8 (0xb8bd bytes) 1711091416.886522 read done 000526[1] 1711091416.894599 write 0x0baebd thru 0x0bd3c0 (0x2504 bytes) 1711091416.903891 write done 000527[1] 1711091416.907345 mapwrite 0x0a9c76 thru 0x0b367d (0x9a08 bytes) 1711091416.909487 mmap done 1711091416.920952 msync done 1711091416.921031 munmap done 000528[1] 1711091416.924869 write 0x12bd3d thru 0x13075e (0x4a22 bytes) 1711091416.936539 write done 000530[1] 1711091416.944289 write 0x1013c6 thru 0x10deab (0xcae6 bytes) 1711091416.944909 write done 000531[0] 1711091416.945166 write 0x095dd9 thru 0x09b78c (0x59b4 bytes) 1711091416.951286 write done 000532[1] 1711091416.955154 trunc from 0x1e97a5 to 0x189442 (0x60362 bytes) 1711091416.962983 truncate done 000534[1] 1711091416.969051 read 0x0747fc thru 0x078ea1 (0x46a6 bytes) 1711091416.976029 read done 000536[0] 1711091416.976684 mapwrite 0x1c2e94 thru 0x1d0dbf (0xdf2c bytes) 1711091416.989319 truncate done 1711091416.989500 mmap done 1711091417.030716 msync done 1711091417.030808 munmap done 000537[1] 1711091417.035727 trunc from 0x1d0dc0 to 0x1e303d (0x1227e bytes) 1711091417.042199 truncate done 000539[1] 1711091417.043656 mapread 0x0e2b06 thru 0x0e7394 (0x488f bytes) 1711091417.043855 mmap done 1711091417.051210 memcpy done 1711091417.051260 munmap done 000541[1] 1711091417.051605 write 0x1e2004 thru 0x1ebd14 (0x9d11 bytes) 1711091417.052056 write done 000545[1] 1711091417.057182 mapwrite 0x0c0cf5 thru 0x0c4a7b (0x3d87 bytes) 1711091417.057357 mmap done 1711091417.072212 msync done 1711091417.072274 munmap done 000548[1] 1711091417.076031 write 0x0dff6d thru 0x0efbd2 (0xfc66 bytes) 1711091417.078736 write done 000549[1] 1711091417.079038 trunc from 0x1ebd15 to 0x0378e8 (0x1b442c bytes) 1711091417.083267 truncate done 000550[0] 1711091417.084568 mapread 0x032c38 thru 0x0378e8 (0x4cb1 bytes) 1711091417.086485 mmap done 1711091417.096546 memcpy done 1711091417.096636 munmap done 000553[0] 1711091417.102581 write 0x0ee265 thru 0x0fc44b (0xe1e7 bytes) 1711091417.105976 write done 000554[0] 1711091417.109791 write 0x12d4fb thru 0x13b69b (0xe1a1 bytes) 1711091417.112504 write done 000556[0] 1711091417.119229 mapread 0x10756b thru 0x110f42 (0x99d8 bytes) 1711091417.119456 mmap done 1711091417.129969 memcpy done 1711091417.130048 munmap done 000557[0] 1711091417.133883 read 0x132779 thru 0x13b69b (0x8f23 bytes) 1711091417.134016 read done 000558[0] 1711091417.135279 trunc from 0x13b69c to 0x167a6d (0x2c3d2 bytes) 1711091417.139292 truncate done 000560[0] 1711091417.147806 mapwrite 0x1e770a thru 0x1f4988 (0xd27f bytes) 1711091417.151050 truncate done 1711091417.151187 mmap done 1711091417.184541 msync done 1711091417.184639 munmap done 000561[0] 1711091417.190132 write 0x177d36 thru 0x17e9da (0x6ca5 bytes) 1711091417.190584 write done 000564[1] 1711091417.198874 write 0x112d45 thru 0x116841 (0x3afd bytes) 1711091417.207026 write done 000566[1] 1711091417.213878 write 0x06acb6 thru 0x06d9d0 (0x2d1b bytes) 1711091417.221478 write done 000567[1] 1711091417.225415 read 0x11b62d thru 0x1224f5 (0x6ec9 bytes) 1711091417.235513 read done 000570[1] 1711091417.240083 trunc from 0x1f4989 to 0x110bc3 (0xe3dc5 bytes) 1711091417.244529 truncate done 000572[0] 1711091417.250242 read 0x0aaa02 thru 0x0b5833 (0xae32 bytes) 1711091417.262305 read done 000574[0] 1711091417.267338 mapread 0x0c0fa7 thru 0x0c833d (0x7397 bytes) 1711091417.269381 mmap done 1711091417.269481 memcpy done 1711091417.269554 munmap done 000576[1] 1711091417.269980 mapread 0x06006f thru 0x06be73 (0xbe05 bytes) 1711091417.270106 mmap done 1711091417.285145 memcpy done 1711091417.285208 munmap done 000580[1] 1711091417.299506 mapread 0x0b2f08 thru 0x0c1654 (0xe74d bytes) 1711091417.299713 mmap done 1711091417.323910 memcpy done 1711091417.324002 munmap done 000581[1] 1711091417.324329 mapwrite 0x08d2a8 thru 0x08e82f (0x1588 bytes) 1711091417.324504 mmap done 1711091417.343599 msync done 1711091417.343687 munmap done 000582[1] 1711091417.347455 trunc from 0x110bc4 to 0x1bda43 (0xace80 bytes) 1711091417.351092 truncate done 000586[1] 1711091417.357099 read 0x073e6b thru 0x078ad4 (0x4c6a bytes) 1711091417.367109 read done 000587[1] 1711091417.367407 write 0x17d805 thru 0x17f773 (0x1f6f bytes) 1711091417.367724 write done 000589[1] 1711091417.375024 mapread 0x0c903f thru 0x0d8f82 (0xff44 bytes) 1711091417.375236 mmap done 1711091417.375358 memcpy done 1711091417.375430 munmap done 000593[1] 1711091417.386892 read 0x04992f thru 0x059786 (0xfe58 bytes) 1711091417.387068 read done 000594[1] 1711091417.387280 trunc from 0x1bda44 to 0x14b621 (0x72422 bytes) 1711091417.391465 truncate done 000598[0] 1711091417.393372 read 0x0e5325 thru 0x0edd71 (0x8a4d bytes) 1711091417.403472 read done 000599[1] 1711091417.404631 trunc from 0x14b622 to 0x07592b (0xd5cf6 bytes) 1711091417.410544 truncate done 000602[1] 1711091417.416715 read 0x02b922 thru 0x02e622 (0x2d01 bytes) 1711091417.421044 read done 000603[1] 1711091417.421389 trunc from 0x07592c to 0x06c2c3 (0x9668 bytes) 1711091417.424891 truncate done 000604[1] 1711091417.426059 read 0x034de8 thru 0x03d2cd (0x84e6 bytes) 1711091417.426148 read done 000605[1] 1711091417.426317 write 0x1715fd thru 0x172e4b (0x184f bytes) 1711091417.426739 write done 000606[0] 1711091417.431028 mapread 0x065b9f thru 0x06b62c (0x5a8e bytes) 1711091417.432596 mmap done 1711091417.441920 memcpy done 1711091417.442016 munmap done 000608[0] 1711091417.446494 mapwrite 0x172266 thru 0x175718 (0x34b3 bytes) 1711091417.455398 truncate done 1711091417.455590 mmap done 1711091417.482848 msync done 1711091417.482952 munmap done 000609[1] 1711091417.487890 read 0x163fc9 thru 0x173db8 (0xfdf0 bytes) 1711091417.508403 read done 000610[1] 1711091417.512133 read 0x053e4e thru 0x05fb5e (0xbd11 bytes) 1711091417.521517 read done 000611[0] 1711091417.523857 write 0x07cd28 thru 0x07d7f0 (0xac9 bytes) 1711091417.529429 write done 000614[0] 1711091417.535576 mapwrite 0x0c0a2c thru 0x0ce2b0 (0xd885 bytes) 1711091417.535919 mmap done 1711091417.564320 msync done 1711091417.564388 munmap done 000615[0] 1711091417.568022 mapread 0x165114 thru 0x172a34 (0xd921 bytes) 1711091417.568184 mmap done 1711091417.585312 memcpy done 1711091417.585374 munmap done 000616[0] 1711091417.588720 write 0x08edd2 thru 0x0977b3 (0x89e2 bytes) 1711091417.591177 write done 000617[0] 1711091417.594526 mapwrite 0x0d6b19 thru 0x0e5f67 (0xf44f bytes) 1711091417.594895 mmap done 1711091417.624759 msync done 1711091417.624819 munmap done 000619[1] 1711091417.628658 mapwrite 0x0ee98d thru 0x0fb202 (0xc876 bytes) 1711091417.630633 mmap done 1711091417.661334 msync done 1711091417.661428 munmap done 000620[1] 1711091417.665317 trunc from 0x175719 to 0x19770a (0x21ff2 bytes) 1711091417.672126 truncate done 000621[1] 1711091417.676994 mapwrite 0x02a8f6 thru 0x036d1c (0xc427 bytes) 1711091417.677282 mmap done 1711091417.706825 msync done 1711091417.707009 munmap done 000622[0] 1711091417.710618 trunc from 0x19770b to 0x1273a0 (0x7036a bytes) 1711091417.717963 truncate done 000623[1] 1711091417.719262 write 0x01d463 thru 0x0216fd (0x429b bytes) 1711091417.723603 write done 000626[1] 1711091417.734850 trunc from 0x1273a1 to 0x131636 (0xa296 bytes) 1711091417.740382 truncate done 000627[1] 1711091417.741669 read 0x04cca2 thru 0x05554a (0x88a9 bytes) 1711091417.748538 read done 000630[0] 1711091417.756610 write 0x162609 thru 0x165f09 (0x3901 bytes) 1711091417.759423 write done 000631[0] 1711091417.763139 mapwrite 0x0bd295 thru 0x0c1618 (0x4384 bytes) 1711091417.764866 mmap done 1711091417.786527 msync done 1711091417.786602 munmap done 000632[1] 1711091417.790334 write 0x0538bb thru 0x06187c (0xdfc2 bytes) 1711091417.795436 write done 000635[1] 1711091417.805875 trunc from 0x165f0a to 0x1859c0 (0x1fab7 bytes) 1711091417.812711 truncate done 000636[1] 1711091417.814091 write 0x00a1b8 thru 0x00e6a0 (0x44e9 bytes) 1711091417.817647 write done 000637[1] 1711091417.822256 mapwrite 0x00d6bd thru 0x01a29f (0xcbe3 bytes) 1711091417.822489 mmap done 1711091417.847735 msync done 1711091417.847829 munmap done 000638[0] 1711091417.851279 write 0x062a12 thru 0x071c41 (0xf230 bytes) 1711091417.856417 write done 000639[0] 1711091417.860046 mapread 0x01951a thru 0x01a906 (0x13ed bytes) 1711091417.861965 mmap done 1711091417.864100 memcpy done 1711091417.864144 munmap done 000641[1] 1711091417.870767 mapread 0x0519e0 thru 0x05326c (0x188d bytes) 1711091417.872508 mmap done 1711091417.880436 memcpy done 1711091417.880497 munmap done 000642[1] 1711091417.880848 trunc from 0x1859c1 to 0x0c1434 (0xc458c bytes) 1711091417.886285 truncate done 000644[0] 1711091417.892377 trunc from 0x0c1435 to 0x07a734 (0x46d00 bytes) 1711091417.900681 truncate done 000649[0] 1711091417.918977 read 0x07165b thru 0x07a734 (0x90da bytes) 1711091417.923818 read done 000650[1] 1711091417.924195 mapwrite 0x099f2f thru 0x0a5f0c (0xbfde bytes) 1711091417.933274 truncate done 1711091417.933458 mmap done 1711091417.960679 msync done 1711091417.960761 munmap done 000654[0] 1711091417.967237 mapread 0x075366 thru 0x084d69 (0xfa04 bytes) 1711091417.968951 mmap done 1711091417.979084 memcpy done 1711091417.979161 munmap done 000656[0] 1711091417.985861 read 0x0a4785 thru 0x0a5f0c (0x1788 bytes) 1711091417.985994 read done 000658[1] 1711091417.992776 mapwrite 0x0a7d51 thru 0x0b21b4 (0xa464 bytes) 1711091417.999466 truncate done 1711091417.999641 mmap done 1711091418.026077 msync done 1711091418.026142 munmap done 000660[0] 1711091418.031813 mapwrite 0x0f9fcd thru 0x0fd471 (0x34a5 bytes) 1711091418.039511 truncate done 1711091418.039631 mmap done 1711091418.059317 msync done 1711091418.059378 munmap done 000661[1] 1711091418.060841 mapwrite 0x049ac6 thru 0x04afd5 (0x1510 bytes) 1711091418.062629 mmap done 1711091418.078858 msync done 1711091418.078917 munmap done 000662[0] 1711091418.084238 trunc from 0x0fd472 to 0x037977 (0xc5afa bytes) 1711091418.090427 truncate done 000663[1] 1711091418.095635 mapwrite 0x110e64 thru 0x11f26c (0xe409 bytes) 1711091418.102692 truncate done 1711091418.102849 mmap done 1711091418.153281 msync done 1711091418.153380 munmap done 000664[0] 1711091418.159755 trunc from 0x11f26d to 0x11edfc (0x470 bytes) 1711091418.167182 truncate done 000665[1] 1711091418.172860 mapwrite 0x09487d thru 0x0a4466 (0xfbea bytes) 1711091418.174878 mmap done 1711091418.210521 msync done 1711091418.210596 munmap done 000666[1] 1711091418.214763 mapwrite 0x05d842 thru 0x05f637 (0x1df6 bytes) 1711091418.216783 mmap done 1711091418.232233 msync done 1711091418.232305 munmap done 000667[1] 1711091418.236020 trunc from 0x11edfd to 0x157b0a (0x38d0e bytes) 1711091418.241091 truncate done 000669[0] 1711091418.242654 write 0x073d07 thru 0x07b873 (0x7b6d bytes) 1711091418.247744 write done 000670[1] 1711091418.251202 write 0x082bad thru 0x084004 (0x1458 bytes) 1711091418.257697 write done 000673[1] 1711091418.258561 write 0x12f0a1 thru 0x132acd (0x3a2d bytes) 1711091418.261304 write done 000674[1] 1711091418.261586 read 0x01c966 thru 0x020826 (0x3ec1 bytes) 1711091418.269468 read done 000675[0] 1711091418.269856 write 0x0ed115 thru 0x0f66e5 (0x95d1 bytes) 1711091418.275630 write done 000677[0] 1711091418.284442 mapread 0x0bd994 thru 0x0c9f1a (0xc587 bytes) 1711091418.286327 mmap done 1711091418.302107 memcpy done 1711091418.302185 munmap done 000678[0] 1711091418.306060 trunc from 0x157b0b to 0x0c8212 (0x8f8f8 bytes) 1711091418.314030 truncate done 000681[1] 1711091418.320890 mapwrite 0x000bc0 thru 0x0108f8 (0xfd39 bytes) 1711091418.323429 mmap done 1711091418.357126 msync done 1711091418.357200 munmap done 000682[0] 1711091418.360713 mapread 0x078a79 thru 0x0843a9 (0xb931 bytes) 1711091418.362328 mmap done 1711091418.378003 memcpy done 1711091418.378087 munmap done 000684[0] 1711091418.378488 mapwrite 0x136168 thru 0x13f19f (0x9038 bytes) 1711091418.383041 truncate done 1711091418.383169 mmap done 1711091418.404656 msync done 1711091418.404771 munmap done 000686[0] 1711091418.416823 mapread 0x01c759 thru 0x02aa8c (0xe334 bytes) 1711091418.417125 mmap done 1711091418.436076 memcpy done 1711091418.436173 munmap done 000687[0] 1711091418.437724 mapwrite 0x124816 thru 0x12fa56 (0xb241 bytes) 1711091418.437958 mmap done 1711091418.454190 msync done 1711091418.454281 munmap done 000688[1] 1711091418.454613 write 0x06083f thru 0x06f50a (0xeccc bytes) 1711091418.460105 write done 000689[0] 1711091418.463664 read 0x03af25 thru 0x03f12f (0x420b bytes) 1711091418.474799 read done 000691[1] 1711091418.482349 mapwrite 0x0c4cf6 thru 0x0c55de (0x8e9 bytes) 1711091418.484168 mmap done 1711091418.498983 msync done 1711091418.499059 munmap done 000692[1] 1711091418.502919 read 0x051820 thru 0x05bb4d (0xa32e bytes) 1711091418.509044 read done 000694[0] 1711091418.516070 write 0x0848f9 thru 0x08c9ca (0x80d2 bytes) 1711091418.521121 write done 000695[0] 1711091418.521480 mapwrite 0x1eeb38 thru 0x1f14de (0x29a7 bytes) 1711091418.525461 truncate done 1711091418.525624 mmap done 1711091418.547748 msync done 1711091418.547836 munmap done 000696[0] 1711091418.553448 mapread 0x0bac43 thru 0x0c7321 (0xc6df bytes) 1711091418.553660 mmap done 1711091418.569368 memcpy done 1711091418.569479 munmap done 000697[1] 1711091418.573489 read 0x15b569 thru 0x1649d1 (0x9469 bytes) 1711091418.587806 read done 000698[0] 1711091418.590247 mapwrite 0x126f0d thru 0x12a539 (0x362d bytes) 1711091418.590447 mmap done 1711091418.612401 msync done 1711091418.612473 munmap done 000699[1] 1711091418.612886 trunc from 0x1f14df to 0x07287a (0x17ec64 bytes) 1711091418.623384 truncate done 000701[1] 1711091418.629052 mapwrite 0x1eccd2 thru 0x1ed60f (0x93e bytes) 1711091418.633123 truncate done 1711091418.633245 mmap done 1711091418.666294 msync done 1711091418.666373 munmap done 000702[0] 1711091418.668073 write 0x1db51e thru 0x1eaf69 (0xfa4c bytes) 1711091418.674219 write done 000703[1] 1711091418.678346 read 0x12b754 thru 0x13231b (0x6bc8 bytes) 1711091418.693203 read done 000705[0] 1711091418.693864 trunc from 0x1ed610 to 0x150ba0 (0x9ca6f bytes) 1711091418.704905 truncate done 000706[1] 1711091418.706554 read 0x073f63 thru 0x079e64 (0x5f02 bytes) 1711091418.723113 read done 000707[0] 1711091418.724300 mapread 0x0fb495 thru 0x0fb9f9 (0x565 bytes) 1711091418.724517 mmap done 1711091418.725582 memcpy done 1711091418.725638 munmap done 000709[1] 1711091418.730561 write 0x106a87 thru 0x10cfc4 (0x653e bytes) 1711091418.736911 write done 000710[1] 1711091418.737177 read 0x0ddaf1 thru 0x0e2b65 (0x5075 bytes) 1711091418.737262 read done 000713[1] 1711091418.744107 read 0x0f662a thru 0x0fbf7a (0x5951 bytes) 1711091418.744217 read done 000715[0] 1711091418.747834 trunc from 0x150ba1 to 0x038855 (0x11834b bytes) 1711091418.758744 truncate done 000717[1] 1711091418.760137 mapread 0x031be7 thru 0x038855 (0x6c6f bytes) 1711091418.761875 mmap done 1711091418.766785 memcpy done 1711091418.766887 munmap done 000722[1] 1711091418.787688 write 0x0b15ec thru 0x0b62eb (0x4d00 bytes) 1711091418.789484 write done 000726[0] 1711091418.804704 trunc from 0x0b62ec to 0x0a620f (0x100dc bytes) 1711091418.813053 truncate done 000727[1] 1711091418.818425 mapwrite 0x1bfb85 thru 0x1cf2df (0xf75b bytes) 1711091418.826195 truncate done 1711091418.826420 mmap done 1711091418.860394 msync done 1711091418.860499 munmap done 000730[0] 1711091418.870070 mapread 0x0ae7e2 thru 0x0b7256 (0x8a75 bytes) 1711091418.871748 mmap done 1711091418.903389 memcpy done 1711091418.903481 munmap done 000733[1] 1711091418.911025 read 0x19aa7f thru 0x19cee3 (0x2465 bytes) 1711091418.911123 read done 000737[0] 1711091418.918052 write 0x119d5f thru 0x12524d (0xb4ef bytes) 1711091418.924012 write done 000738[0] 1711091418.927676 mapwrite 0x1c00f4 thru 0x1cbee4 (0xbdf1 bytes) 1711091418.928041 mmap done 1711091418.961232 msync done 1711091418.961326 munmap done 000740[1] 1711091418.961947 read 0x04cd01 thru 0x054908 (0x7c08 bytes) 1711091418.968048 read done 000741[0] 1711091418.972145 mapread 0x00835f thru 0x00c6b1 (0x4353 bytes) 1711091418.972316 mmap done 1711091418.977864 memcpy done 1711091418.977911 munmap done 000742[0] 1711091418.981848 mapread 0x1a24b0 thru 0x1af952 (0xd4a3 bytes) 1711091418.982051 mmap done 1711091418.999234 memcpy done 1711091418.999313 munmap done 000743[0] 1711091418.999566 mapwrite 0x06afec thru 0x07a1ec (0xf201 bytes) 1711091418.999822 mmap done 1711091419.040686 msync done 1711091419.040767 munmap done 000744[0] 1711091419.041049 mapread 0x1298b9 thru 0x13553a (0xbc82 bytes) 1711091419.041179 mmap done 1711091419.055706 memcpy done 1711091419.055790 munmap done 000748[1] 1711091419.064431 mapread 0x08f46c thru 0x09a099 (0xac2e bytes) 1711091419.066452 mmap done 1711091419.082782 memcpy done 1711091419.082868 munmap done 000749[0] 1711091419.086612 mapread 0x1a2bb3 thru 0x1ac3e9 (0x9837 bytes) 1711091419.087581 mmap done 1711091419.087646 memcpy done 1711091419.087687 munmap done 000752[0] 1711091419.094765 trunc from 0x1cf2e0 to 0x14ec66 (0x80679 bytes) 1711091419.101218 truncate done 000753[1] 1711091419.106179 trunc from 0x14ec67 to 0x01c413 (0x132853 bytes) 1711091419.112247 truncate done 000754[1] 1711091419.113505 read 0x007af5 thru 0x00d18e (0x569a bytes) 1711091419.115968 read done 000755[1] 1711091419.116226 read 0x003472 thru 0x00ca96 (0x9625 bytes) 1711091419.116307 read done 000756[1] 1711091419.116492 write 0x1bcb70 thru 0x1c19aa (0x4e3b bytes) 1711091419.117198 write done 000759[0] 1711091419.122580 trunc from 0x1c19ab to 0x1c04a9 (0x1501 bytes) 1711091419.134514 truncate done 000761[1] 1711091419.141871 read 0x016759 thru 0x025ec3 (0xf76b bytes) 1711091419.158602 read done 000764[1] 1711091419.164247 mapread 0x04c4b2 thru 0x04cf4c (0xa9b bytes) 1711091419.166075 mmap done 1711091419.168996 memcpy done 1711091419.169077 munmap done 000765[1] 1711091419.172534 write 0x1ce91e thru 0x1dc033 (0xd716 bytes) 1711091419.175409 write done 000768[1] 1711091419.182547 mapwrite 0x0dad77 thru 0x0ea56d (0xf7f7 bytes) 1711091419.182913 mmap done 1711091419.205458 msync done 1711091419.205591 munmap done 000769[0] 1711091419.205890 trunc from 0x1dc034 to 0x1e58e3 (0x98b0 bytes) 1711091419.218201 truncate done 000774[0] 1711091419.225345 trunc from 0x1e58e4 to 0x043a65 (0x1a1e7e bytes) 1711091419.229052 truncate done 000775[0] 1711091419.230393 write 0x10270f thru 0x106cf7 (0x45e9 bytes) 1711091419.231067 write done 000776[1] 1711091419.236125 mapwrite 0x149583 thru 0x1510df (0x7b5d bytes) 1711091419.246485 truncate done 1711091419.246731 mmap done 1711091419.284776 msync done 1711091419.284890 munmap done 000777[0] 1711091419.290092 mapread 0x11bc7d thru 0x11c674 (0x9f8 bytes) 1711091419.291823 mmap done 1711091419.296083 memcpy done 1711091419.296153 munmap done 000778[0] 1711091419.299220 mapwrite 0x0f667a thru 0x104410 (0xdd97 bytes) 1711091419.300817 mmap done 1711091419.346360 msync done 1711091419.346463 munmap done 000780[0] 1711091419.346904 read 0x080669 thru 0x08a504 (0x9e9c bytes) 1711091419.354909 read done 000781[1] 1711091419.355211 read 0x0664f9 thru 0x067e4e (0x1956 bytes) 1711091419.370419 read done 000782[0] 1711091419.372019 trunc from 0x1510e0 to 0x16f40d (0x1e32e bytes) 1711091419.379012 truncate done 000786[1] 1711091419.385904 mapread 0x035458 thru 0x0394fa (0x40a3 bytes) 1711091419.388441 mmap done 1711091419.396684 memcpy done 1711091419.396783 munmap done 000787[0] 1711091419.398090 mapread 0x006fef thru 0x008a15 (0x1a27 bytes) 1711091419.398257 mmap done 1711091419.402354 memcpy done 1711091419.402445 munmap done 000789[0] 1711091419.407102 write 0x0dea3f thru 0x0e9c72 (0xb234 bytes) 1711091419.411953 write done 000790[0] 1711091419.415958 mapread 0x0fd386 thru 0x0fdf43 (0xbbe bytes) 1711091419.416180 mmap done 1711091419.417268 memcpy done 1711091419.417322 munmap done 000791[1] 1711091419.417519 mapread 0x06c142 thru 0x074890 (0x874f bytes) 1711091419.419428 mmap done 1711091419.434638 memcpy done 1711091419.434731 munmap done 000792[0] 1711091419.438591 mapwrite 0x0dbbe3 thru 0x0e76cc (0xbaea bytes) 1711091419.439746 mmap done 1711091419.467463 msync done 1711091419.467544 munmap done 000793[1] 1711091419.467818 read 0x0b8b7a thru 0x0bf5d2 (0x6a59 bytes) 1711091419.477518 read done 000795[1] 1711091419.482086 read 0x05f985 thru 0x06a354 (0xa9d0 bytes) 1711091419.482227 read done 000797[0] 1711091419.489078 mapread 0x12a5ef thru 0x1377c7 (0xd1d9 bytes) 1711091419.489267 mmap done 1711091419.489368 memcpy done 1711091419.489404 munmap done 000798[0] 1711091419.493243 mapwrite 0x0f3124 thru 0x0fa45a (0x7337 bytes) 1711091419.493515 mmap done 1711091419.515511 msync done 1711091419.515591 munmap done 000799[0] 1711091419.515905 mapread 0x021846 thru 0x02dde3 (0xc59e bytes) 1711091419.516075 mmap done 1711091419.530528 memcpy done 1711091419.530600 munmap done 000800[0] 1711091419.534422 read 0x00b132 thru 0x01488b (0x975a bytes) 1711091419.541878 read done 000801[1] 1711091419.542194 mapread 0x14fcee thru 0x157bc6 (0x7ed9 bytes) 1711091419.544359 mmap done 1711091419.557065 memcpy done 1711091419.557170 munmap done 000805[0] 1711091419.569805 read 0x06d1c4 thru 0x078195 (0xafd2 bytes) 1711091419.569980 read done 000806[0] 1711091419.573605 write 0x0345e5 thru 0x04226b (0xdc87 bytes) 1711091419.574325 write done 000807[0] 1711091419.577742 read 0x007c88 thru 0x016a82 (0xedfb bytes) 1711091419.577889 read done 000808[0] 1711091419.578192 mapwrite 0x041de2 thru 0x049494 (0x76b3 bytes) 1711091419.578419 mmap done 1711091419.590452 msync done 1711091419.590527 munmap done 000810[0] 1711091419.598388 write 0x0e2333 thru 0x0eb9e3 (0x96b1 bytes) 1711091419.598964 write done 000811[0] 1711091419.602516 read 0x03d0df thru 0x045dea (0x8d0c bytes) 1711091419.602621 read done 000812[0] 1711091419.606308 write 0x1f132f thru 0x1f4dfb (0x3acd bytes) 1711091419.609147 write done 000813[1] 1711091419.613069 mapwrite 0x1f6620 thru 0x1fcb9a (0x657b bytes) 1711091419.625634 truncate done 1711091419.625831 mmap done 1711091419.662192 msync done 1711091419.662257 munmap done 000815[1] 1711091419.664174 trunc from 0x1fcb9b to 0x0a9ad5 (0x1530c5 bytes) 1711091419.668731 truncate done 000816[1] 1711091419.673427 trunc from 0x0a9ad6 to 0x1f249f (0x1489ca bytes) 1711091419.677021 truncate done 000817[1] 1711091419.678242 write 0x000d0f thru 0x003576 (0x2868 bytes) 1711091419.678509 write done 000820[0] 1711091419.683475 mapread 0x0825f4 thru 0x085640 (0x304d bytes) 1711091419.685057 mmap done 1711091419.694279 memcpy done 1711091419.694352 munmap done 000821[0] 1711091419.697895 mapwrite 0x1f4229 thru 0x1faa45 (0x681d bytes) 1711091419.704428 truncate done 1711091419.704583 mmap done 1711091419.733347 msync done 1711091419.733402 munmap done 000823[0] 1711091419.741006 trunc from 0x1faa46 to 0x0ac4cf (0x14e576 bytes) 1711091419.745949 truncate done 000824[0] 1711091419.747328 write 0x09e7bd thru 0x0ad490 (0xecd4 bytes) 1711091419.749335 write done 000825[0] 1711091419.749659 write 0x0549a5 thru 0x055f72 (0x15ce bytes) 1711091419.751964 write done 000826[0] 1711091419.756714 mapwrite 0x1f183e thru 0x1fdc03 (0xc3c6 bytes) 1711091419.761057 truncate done 1711091419.761252 mmap done 1711091419.796230 msync done 1711091419.796325 munmap done 000827[0] 1711091419.801654 trunc from 0x1fdc04 to 0x03bbdf (0x1c2024 bytes) 1711091419.805658 truncate done 000828[1] 1711091419.806843 read 0x00fb1f thru 0x01f820 (0xfd02 bytes) 1711091419.812604 read done 000829[0] 1711091419.814021 write 0x1afa63 thru 0x1b0aa9 (0x1047 bytes) 1711091419.814627 write done 000832[0] 1711091419.824104 trunc from 0x1b0aaa to 0x1d70d9 (0x26630 bytes) 1711091419.830409 truncate done 000833[1] 1711091419.831774 read 0x1a8a84 thru 0x1b8468 (0xf9e5 bytes) 1711091419.853022 read done 000836[0] 1711091419.865157 write 0x15861d thru 0x15c6ca (0x40ae bytes) 1711091419.870774 write done 000838[1] 1711091419.875352 mapwrite 0x00eff5 thru 0x01e389 (0xf395 bytes) 1711091419.877480 mmap done 1711091419.898136 msync done 1711091419.898232 munmap done 000839[0] 1711091419.902370 read 0x1b4479 thru 0x1bbcf9 (0x7881 bytes) 1711091419.909995 read done 000840[1] 1711091419.913486 mapwrite 0x1957cb thru 0x198a6b (0x32a1 bytes) 1711091419.915570 mmap done 1711091419.941249 msync done 1711091419.941340 munmap done 000841[0] 1711091419.941611 mapwrite 0x06cf65 thru 0x074278 (0x7314 bytes) 1711091419.943966 mmap done 1711091420.006430 msync done 1711091420.006511 munmap done 000842[0] 1711091420.010325 mapwrite 0x1709aa thru 0x17ba04 (0xb05b bytes) 1711091420.012037 mmap done 1711091420.037101 msync done 1711091420.037191 munmap done 000844[1] 1711091420.041515 mapread 0x0792eb thru 0x07e1cb (0x4ee1 bytes) 1711091420.043450 mmap done 1711091420.063106 memcpy done 1711091420.063197 munmap done 000847[1] 1711091420.074257 read 0x138370 thru 0x13e2ec (0x5f7d bytes) 1711091420.086261 read done 000848[1] 1711091420.087717 mapread 0x113eb6 thru 0x11c3b9 (0x8504 bytes) 1711091420.087866 mmap done 1711091420.087946 memcpy done 1711091420.088009 munmap done 000849[0] 1711091420.088198 mapread 0x04eacd thru 0x05c74f (0xdc83 bytes) 1711091420.088297 mmap done 1711091420.104644 memcpy done 1711091420.104736 munmap done 000853[0] 1711091420.105781 mapwrite 0x1fa7cf thru 0x1fffff (0x5831 bytes) 1711091420.115848 truncate done 1711091420.116016 mmap done 1711091420.135876 msync done 1711091420.136000 munmap done 000854[0] 1711091420.141604 mapwrite 0x140c2f thru 0x1460d4 (0x54a6 bytes) 1711091420.141835 mmap done 1711091420.165814 msync done 1711091420.165907 munmap done 000856[0] 1711091420.173355 mapread 0x003620 thru 0x010cba (0xd69b bytes) 1711091420.173561 mmap done 1711091420.187905 memcpy done 1711091420.188009 munmap done 000858[0] 1711091420.193718 mapread 0x0ca45f thru 0x0d6a72 (0xc614 bytes) 1711091420.193961 mmap done 1711091420.208135 memcpy done 1711091420.208210 munmap done 000860[0] 1711091420.215844 write 0x1dcebf thru 0x1e7cf8 (0xae3a bytes) 1711091420.216338 write done 000862[1] 1711091420.217001 trunc from 0x200000 to 0x093539 (0x16cac6 bytes) 1711091420.228097 truncate done 000863[1] 1711091420.230023 mapwrite 0x07ebdd thru 0x087f1c (0x9340 bytes) 1711091420.230312 mmap done 1711091420.256410 msync done 1711091420.256502 munmap done 000867[0] 1711091420.265288 mapwrite 0x0b8d0d thru 0x0c304c (0xa340 bytes) 1711091420.273711 truncate done 1711091420.273950 mmap done 1711091420.301046 msync done 1711091420.301123 munmap done 000868[1] 1711091420.306313 mapwrite 0x0a830d thru 0x0acf3c (0x4c30 bytes) 1711091420.308264 mmap done 1711091420.326455 msync done 1711091420.326527 munmap done 000869[1] 1711091420.331251 mapread 0x00cc02 thru 0x014692 (0x7a91 bytes) 1711091420.333236 mmap done 1711091420.342286 memcpy done 1711091420.342345 munmap done 000870[1] 1711091420.345918 write 0x0f4945 thru 0x0f7b80 (0x323c bytes) 1711091420.346299 write done 000871[0] 1711091420.349975 mapwrite 0x0a28c8 thru 0x0b09ef (0xe128 bytes) 1711091420.351957 mmap done 1711091420.387443 msync done 1711091420.387508 munmap done 000872[1] 1711091420.391380 trunc from 0x0f7b81 to 0x0cbe76 (0x2bd0a bytes) 1711091420.398861 truncate done 000874[1] 1711091420.405470 mapwrite 0x0e5e5b thru 0x0e818b (0x2331 bytes) 1711091420.409001 truncate done 1711091420.409163 mmap done 1711091420.426724 msync done 1711091420.426806 munmap done 000878[0] 1711091420.441168 mapread 0x0b53f8 thru 0x0c1257 (0xbe60 bytes) 1711091420.442964 mmap done 1711091420.458981 memcpy done 1711091420.459055 munmap done 000882[0] 1711091420.473150 read 0x054fa3 thru 0x05d9c5 (0x8a23 bytes) 1711091420.479847 read done 000884[1] 1711091420.481439 read 0x0e2a93 thru 0x0e818b (0x56f9 bytes) 1711091420.488332 read done 000885 1711091420.492285 [0]close/open 1711091420.493389 close done 1711091420.496551 open done truncating to largest ever: 0x1fca47 000887[0] 1711091420.505324 trunc from 0x0e818c to 0x1fca46 (0x1148bb bytes) 1711091420.514544 truncate done 000888[1] 1711091420.519298 read 0x1847b5 thru 0x187b36 (0x3382 bytes) 1711091420.527198 read done 000889[0] 1711091420.530491 trunc from 0x1fca47 to 0x03a9f7 (0x1c204f bytes) 1711091420.535550 truncate done 000891[1] 1711091420.541040 mapwrite 0x0c78be thru 0x0cfafd (0x8240 bytes) 1711091420.548100 truncate done 1711091420.548269 mmap done 1711091420.565637 msync done 1711091420.565746 munmap done 000897[1] 1711091420.582180 write 0x1e459b thru 0x1e98cb (0x5331 bytes) 1711091420.582899 write done 000903[1] 1711091420.593508 read 0x111e00 thru 0x12080f (0xea10 bytes) 1711091420.598432 read done 000905[0] 1711091420.598992 mapwrite 0x1cb33f thru 0x1d6c58 (0xb91a bytes) 1711091420.600650 mmap done 1711091420.628364 msync done 1711091420.628476 munmap done 000908[1] 1711091420.639351 read 0x1cb8f7 thru 0x1d65f3 (0xacfd bytes) 1711091420.651866 read done 000910 1711091420.657529 [1]close/open 1711091420.659152 close done 1711091420.663244 open done 000911[1] 1711091420.668754 write 0x02eb3b thru 0x03a2f0 (0xb7b6 bytes) 1711091420.669189 write done 000914[0] 1711091420.679856 trunc from 0x1e98cc to 0x0099f3 (0x1dfed8 bytes) 1711091420.690541 truncate done 000915[0] 1711091420.691662 write 0x1dad49 thru 0x1e31ee (0x84a6 bytes) 1711091420.692464 write done 000918[0] 1711091420.700107 write 0x190cee thru 0x194cd3 (0x3fe6 bytes) 1711091420.702232 write done 000919[1] 1711091420.702550 mapread 0x18f396 thru 0x1980ac (0x8d17 bytes) 1711091420.704364 mmap done 1711091420.713002 memcpy done 1711091420.713098 munmap done 000920[1] 1711091420.717406 trunc from 0x1e31ef to 0x19fc56 (0x43598 bytes) 1711091420.726870 truncate done 000923[0] 1711091420.738448 mapwrite 0x00eb03 thru 0x0160e8 (0x75e6 bytes) 1711091420.741320 mmap done 1711091420.811479 msync done 1711091420.811577 munmap done 000925[1] 1711091420.819706 write 0x08845b thru 0x092c6e (0xa814 bytes) 1711091420.825889 write done 000926[1] 1711091420.826144 read 0x0ffa8c thru 0x104e7f (0x53f4 bytes) 1711091420.828044 read done 000928[0] 1711091420.836023 mapwrite 0x119731 thru 0x11b7c3 (0x2093 bytes) 1711091420.837845 mmap done 1711091420.859616 msync done 1711091420.859711 munmap done 000930[0] 1711091420.868435 trunc from 0x19fc57 to 0x1880b4 (0x17ba2 bytes) 1711091420.878463 truncate done 000931[1] 1711091420.884697 mapread 0x0abb05 thru 0x0b0ca3 (0x519f bytes) 1711091420.886606 mmap done 1711091420.911036 memcpy done 1711091420.911145 munmap done 000934 1711091420.917404 [0]close/open 1711091420.918736 close done 1711091420.922310 open done 000937[0] 1711091420.930111 read 0x13c7d6 thru 0x145862 (0x908d bytes) 1711091420.932624 read done 000939[1] 1711091420.936740 mapwrite 0x0bb6b6 thru 0x0bf50b (0x3e56 bytes) 1711091420.939164 mmap done 1711091420.981489 msync done 1711091420.981558 munmap done 000941[0] 1711091420.990784 write 0x0bd956 thru 0x0c2c70 (0x531b bytes) 1711091420.995787 write done 000943[0] 1711091421.004063 read 0x127788 thru 0x130775 (0x8fee bytes) 1711091421.012055 read done 000944[1] 1711091421.016479 mapread 0x128a69 thru 0x12ca41 (0x3fd9 bytes) 1711091421.018798 mmap done 1711091421.024745 memcpy done 1711091421.024859 munmap done 000945[0] 1711091421.029188 write 0x1c07e9 thru 0x1c1cb9 (0x14d1 bytes) 1711091421.031837 write done 000946[0] 1711091421.035337 write 0x04305a thru 0x04b3af (0x8356 bytes) 1711091421.035779 write done 000948[1] 1711091421.040223 write 0x02e71b thru 0x0385b6 (0x9e9c bytes) 1711091421.049864 write done 000950[1] 1711091421.058503 trunc from 0x1c1cba to 0x0b56ce (0x10c5eb bytes) 1711091421.066088 truncate done 000953[0] 1711091421.072358 mapwrite 0x1f51e6 thru 0x1f70a7 (0x1ec2 bytes) 1711091421.083898 truncate done 1711091421.084124 mmap done 1711091421.116317 msync done 1711091421.116381 munmap done 000960[0] 1711091421.136198 write 0x050559 thru 0x0549f8 (0x44a0 bytes) 1711091421.139167 write done 000961[0] 1711091421.143991 write 0x0a70bf thru 0x0b6e96 (0xfdd8 bytes) 1711091421.147538 write done 000962[0] 1711091421.151751 mapwrite 0x0228c4 thru 0x03137f (0xeabc bytes) 1711091421.152138 mmap done 1711091421.189369 msync done 1711091421.189469 munmap done 000963[0] 1711091421.189869 mapwrite 0x15a695 thru 0x15b9ad (0x1319 bytes) 1711091421.190096 mmap done 1711091421.207482 msync done 1711091421.207549 munmap done 000964[1] 1711091421.211492 write 0x18b002 thru 0x190970 (0x596f bytes) 1711091421.218261 write done 000967[0] 1711091421.232434 mapwrite 0x029414 thru 0x036b4c (0xd739 bytes) 1711091421.234311 mmap done 1711091421.252060 msync done 1711091421.252146 munmap done 000970[0] 1711091421.262799 read 0x094896 thru 0x0a27b1 (0xdf1c bytes) 1711091421.268737 read done 000971[0] 1711091421.272958 write 0x193213 thru 0x195f20 (0x2d0e bytes) 1711091421.286234 write done 000975[1] 1711091421.301342 mapwrite 0x123278 thru 0x1297b4 (0x653d bytes) 1711091421.303711 mmap done 1711091421.337943 msync done 1711091421.338006 munmap done 000977[0] 1711091421.346024 write 0x078886 thru 0x086b84 (0xe2ff bytes) 1711091421.346720 write done 000980[0] 1711091421.357526 trunc from 0x1f70a8 to 0x07aca1 (0x17c406 bytes) 1711091421.366107 truncate done 000983[0] 1711091421.373355 mapwrite 0x141a87 thru 0x14ef47 (0xd4c1 bytes) 1711091421.378109 truncate done 1711091421.378303 mmap done 1711091421.422379 msync done 1711091421.422464 munmap done 000985[0] 1711091421.424497 read 0x0eb70e thru 0x0f9fa2 (0xe895 bytes) 1711091421.429430 read done 000990[0] 1711091421.439022 mapwrite 0x1f2c4a thru 0x1f37ad (0xb64 bytes) 1711091421.443538 truncate done 1711091421.443716 mmap done 1711091421.468699 msync done 1711091421.468759 munmap done 000991[0] 1711091421.475860 trunc from 0x1f37ae to 0x1d47e5 (0x1efc8 bytes) 1711091421.480525 truncate done 000993[1] 1711091421.489996 write 0x0dfa63 thru 0x0e227b (0x2819 bytes) 1711091421.496194 write done 000996[0] 1711091421.509696 mapread 0x1abeff thru 0x1afa92 (0x3b94 bytes) 1711091421.511605 mmap done 1711091421.511706 memcpy done 1711091421.511822 munmap done 000997[1] 1711091421.516345 write 0x02b87c thru 0x032815 (0x6f9a bytes) 1711091421.519441 write done 000999[1] 1711091421.527754 mapread 0x061cb6 thru 0x06890f (0x6c5a bytes) 1711091421.529654 mmap done 1711091421.534087 memcpy done 1711091421.534155 munmap done 001000[0] 1711091421.538653 read 0x067f6c thru 0x069ee6 (0x1f7b bytes) 1711091421.555443 read done All operations completed A-OK! PASS fsx (10s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 03:10:24 (1711091424) excepting tests: 42a 42c 42b 118c 118d 407 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 51b === sanity: start setup 03:10:26 (1711091426) === Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg448-client.virtnet /mnt/lustre2 opts: oleg448-client.virtnet: executing check_config_client /mnt/lustre oleg448-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg448-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a6dc000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a6dc000.idle_timeout=debug disable quota as required oleg448-server: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 03:10:33 (1711091433) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f14657] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36a: MDS utime check (mknod, utime) ======= 03:10:35 (1711091435) utime: good mknod times 1711091434 <= 1711091435 <= 1711091435 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36b: OST utime check (open, utime) ======== 03:10:38 (1711091438) utime: good utime mtimes 100000, atime 200000 PASS 36b (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 03:10:41 (1711091441) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1711091440 <= 1711091441 <= 1711091441 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 03:10:44 (1711091444) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36e: utime on non-owned file (should return error) ========================================================== 03:10:47 (1711091447) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 03:10:50 (1711091450) fail_loc=0x80000214 Fri Mar 22 03:10:51 EDT 2024 1711091451 Fri Mar 22 03:10:52 EDT 2024 1711091452 PASS 36f (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36g: FMD cache expiry =============================================================================== 03:10:54 (1711091454) FMD max age: 30s FMD before: 6 FMD after: 0 PASS 36g (45s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 03:11:40 (1711091500) fail_loc=0x80000227 Fri Mar 22 03:11:41 EDT 2024 1711091501 Fri Mar 22 03:11:42 EDT 2024 1711091502 PASS 36h (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36i: change mtime on striped directory ==== 03:11:44 (1711091504) SKIP: sanity test_36i needs >= 2 MDTs SKIP 36i (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39a: mtime changed on create ============== 03:11:47 (1711091507) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 03:11:52 (1711091512) repeat after cancel_lru_locks PASS 39b (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39c: mtime change on rename ===================================================================================== 03:11:56 (1711091516) repeat after cancel_lru_locks PASS 39c (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39d: create, utime, stat ======================================================================================== 03:12:01 (1711091521) repeat after cancel_lru_locks PASS 39d (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39e: create, stat, utime, stat ================================================================================== 03:12:04 (1711091524) repeat after cancel_lru_locks PASS 39e (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 03:12:06 (1711091526) repeat after cancel_lru_locks PASS 39f (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39g: write, chmod, stat ========================================================================================= 03:12:11 (1711091531) repeat after cancel_lru_locks PASS 39g (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39h: write, utime within one second, stat ======================================================================= 03:12:16 (1711091536) repeat after cancel_lru_locks PASS 39h (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39i: write, rename, stat ======================================================================================== 03:12:20 (1711091540) repeat after cancel_lru_locks PASS 39i (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39j: write, rename, close, stat ================================================================================= 03:12:24 (1711091544) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14657 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS 39j (5s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39k: write, utime, close, stat ================================================================================== 03:12:31 (1711091551) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14657 repeat after cancel_lru_locks PASS 39k (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39l: directory atime update ===================================================================================== 03:12:35 (1711091555) PASS 39l (9s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39m: test atime and mtime before 1970 ===== 03:12:45 (1711091565) repeat after cancel_lru_locks PASS 39m (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39n: check that O_NOATIME is honored ====== 03:12:50 (1711091570) 1+0 records in 1+0 records out PASS 39n (12s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39o: directory cached attributes updated after create ========================================================== 03:13:04 (1711091584) a b PASS 39o (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39p: remote directory cached attributes updated after create ================================================================== 03:13:07 (1711091587) SKIP: sanity test_39p needs >= 2 MDTs SKIP 39p (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39r: lazy atime update on OST ============= 03:13:09 (1711091589) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39q: close won't zero out atime =========== 03:13:11 (1711091591) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.14657 PASS 39q (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39s: relatime is supported ================ 03:13:14 (1711091594) 192.168.204.148@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg448-client.virtnet /mnt/lustre (opts:) Starting client: oleg448-client.virtnet: -o relatime oleg448-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg448-client.virtnet /mnt/lustre (opts:) Starting client: oleg448-client.virtnet: -o user_xattr,flock oleg448-server@tcp:/lustre /mnt/lustre PASS 39s (7s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 03:13:23 (1711091603) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00213094 s, 1.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 41: test small file write + fstat =============================================================================== 03:13:26 (1711091606) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 03:13:30 (1711091610) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.0206605 s, 5.0 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6016 2201088 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7530496 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 03:13:33 (1711091613) total: 1000 open/close in 1.92 seconds: 522.13 ops/second total: 934 open/close in 2.22 seconds: 420.54 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 11.5155 s, 42.5 MB/s osc.lustre-OST0000-osc-ffff8800a9fb4800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800a9fb4800.cur_grant_bytes=490340352 osc.lustre-OST0000-osc-ffff8800a9fb4800.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff8800a9fb4800.cur_grant_bytes=490471424 osc.lustre-OST0000-osc-ffff8800a9fb4800.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800a9fb4800.rpc_stats= snapshot_time: 1711091660.765574540 secs.nsecs start_time: 1711091658.941381477 secs.nsecs elapsed_time: 1.824193063 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 33 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 33 100 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 33 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6656 2201984 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 446464 3322880 12% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 450560 7088128 6% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (57s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 03:14:32 (1711091672) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5690: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 03:14:36 (1711091676) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4661: 10750 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 03:14:40 (1711091680) truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4661: 11488 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43c: md5sum of copy into lustre =========== 03:14:44 (1711091684) bash: OK PASS 43c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 46: dirtying a previously written page ========================================================================== 03:14:47 (1711091687) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00254844 s, 1.6 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00110472 s, 3.7 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00111686 s, 3.7 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 56r: check lfs find -size works =========== 03:14:50 (1711091690) PASS 56r (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 03:14:54 (1711091694) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff8800a9fb4800.max_cached_mb= users: 5 max_cached_mb: 1865 used_mb: 49 unused_mb: 1816 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff8800a9fb4800.read_ahead_stats= snapshot_time 1711091711.570848205 secs.nsecs start_time 1711091706.370990724 secs.nsecs elapsed_time 5.199857481 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (20s) debug_raw_pointers=1 debug_raw_pointers=1 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 119a: Short directIO read must return actual read amount ========================================================== 03:15:15 (1711091715) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 03:15:18 (1711091718) PASS 131a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131b: test append writev ================== 03:15:21 (1711091721) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131c: test read/write on file w/o objects ========================================================== 03:15:25 (1711091725) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131d: test short read ===================== 03:15:28 (1711091728) PASS 131d (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131e: test read hitting hole ============== 03:15:31 (1711091731) PASS 131e (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150a: truncate/append tests =============== 03:15:34 (1711091734) 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000326171 s, 18.7 MB/s Stopping client oleg448-client.virtnet /mnt/lustre (opts:) Starting client: oleg448-client.virtnet: -o user_xattr,flock oleg448-server@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.204.148@tcp:/lustre 7542784 8192 7528448 1% /mnt/lustre sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete PASS 150a (22s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 03:15:57 (1711091757) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 03:16:00 (1711091760) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (0s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150c: Verify fallocate Size and Blocks ==== 03:16:02 (1711091762) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 03:16:04 (1711091764) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150f: Verify fallocate punch functionality ========================================================== 03:16:07 (1711091767) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (0s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150g: Verify fallocate punch on large range ========================================================== 03:16:09 (1711091769) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (0s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 03:16:11 (1711091771) oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000233125 s, 26.1 MB/s oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 PASS 155a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 03:16:16 (1711091776) oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000231997 s, 26.3 MB/s oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 PASS 155b (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 03:16:21 (1711091781) oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00026249 s, 23.2 MB/s oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 PASS 155c (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 03:16:25 (1711091785) oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg448-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000316167 s, 19.3 MB/s oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 oleg448-server: error: set_param: setting : Invalid argument pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 PASS 155d (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 207a: can refresh layout at glimpse ======= 03:16:30 (1711091790) 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.00356546 s, 2.3 MB/s fail_loc=0x170 PASS 207a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 207b: can refresh layout at open ========== 03:16:33 (1711091793) 8+0 records in 8+0 records out 32768 bytes (33 kB) copied, 0.00539312 s, 6.1 MB/s fail_loc=0x171 checksum is bb7df04e1b0a2570657527a7e108ae23 /mnt/lustre/f207b.sanity PASS 207b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 241a: bio vs dio ========================== 03:16:36 (1711091796) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00311683 s, 13.1 MB/s -rw-r--r-- 1 root root 40960 Mar 22 03:16 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff880080af3800.lock_unused_count=2 PASS 241a (17s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 241b: dio vs dio ========================== 03:16:55 (1711091815) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00285992 s, 14.3 MB/s -rw-r--r-- 1 root root 40960 Mar 22 03:16 /mnt/lustre/f241b.sanity PASS 241b (8s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 251a: Handling short read and write correctly ========================================================== 03:17:05 (1711091825) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 251b: short read restore offset correctly ========================================================== 03:17:09 (1711091829) 4+0 records in 4+0 records out 4096 bytes (4.1 kB) copied, 0.00214698 s, 1.9 MB/s fail_loc=0x1431 fail_val=5 PASS 251b (7s) debug_raw_pointers=1 debug_raw_pointers=1 == sanity test complete, duration 412 sec ================ 03:17:16 (1711091836) === sanity: start cleanup 03:17:17 (1711091837) === Starting client oleg448-client.virtnet: -o user_xattr,flock oleg448-server@tcp:/lustre /mnt/lustre2 Started clients oleg448-client.virtnet: 192.168.204.148@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg448-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 03:17:17 (1711091837) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (414s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 03:17:20 (1711091840) excepting tests: 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 03:17:22 (1711091842) === Starting client oleg448-client.virtnet: -o user_xattr,flock oleg448-server@tcp:/lustre /mnt/lustre2 Started clients oleg448-client.virtnet: 192.168.204.148@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg448-client.virtnet: executing check_config_client /mnt/lustre oleg448-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg448-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff880080af3800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b60b5000.idle_timeout=debug osc.lustre-OST0001-osc-ffff880080af3800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b60b5000.idle_timeout=debug disable quota as required oleg448-server: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 03:17:28 (1711091848) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102316 s, 102 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f9012] debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 03:17:29 (1711091849) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 03:17:32 (1711091852) -rw-r--r-- 1 root root 0 Mar 22 03:17 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 03:17:35 (1711091855) -rw-r--r-- 1 root root 0 Mar 22 03:17 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 03:17:37 (1711091857) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 03:17:40 (1711091860) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2e: check chmod on root is propagated to others ========================================================== 03:17:43 (1711091863) total 620 -rwxrwxrwx 1 root root 0 Mar 22 03:17 f2a -rwxrwxrwx 1 root root 0 Mar 22 03:17 f2b -rw-r--r-- 1 root root 1918950 Mar 22 03:10 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Mar 22 03:10 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 76862 Mar 22 03:10 ffsx.sanity-dom.fsxlog total 620 -rwxrwxrwx 1 root root 0 Mar 22 03:17 f2a -rwxrwxrwx 1 root root 0 Mar 22 03:17 f2b -rw-r--r-- 1 root root 1918950 Mar 22 03:10 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Mar 22 03:10 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 76862 Mar 22 03:10 ffsx.sanity-dom.fsxlog running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00121603 s, 421 kB/s PASS 2e (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 03:17:46 (1711091866) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2g: check blocks update on sync write ==== 03:17:48 (1711091868) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0731586 s, 28.7 MB/s /mnt/lustre/f2g.sanityn has 4109 blocks /mnt/lustre2/f2g.sanityn has 4109 blocks PASS 2g (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 4: fstat validation on multiple mount points ==================================================================== 03:17:51 (1711091871) PASS 4 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 03:17:55 (1711091875) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 6: remove of open file on other node ============================================================================ 03:17:58 (1711091878) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 7: remove of open directory on other node ======================================================================= 03:18:01 (1711091881) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 8: remove of open special file on other node ==================================================================== 03:18:03 (1711091883) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 03:18:07 (1711091887) PASS 9a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 9b: append to striped sparse file ======== 03:18:10 (1711091890) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109894 s, 95.4 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.033661 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 03:18:13 (1711091893) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00126292 s, 0.8 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00216532 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0021094 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00218093 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00247409 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00240281 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00201089 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00215361 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0022032 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00214131 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00211484 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0021418 s, 0.5 kB/s PASS 10a (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 03:18:16 (1711091896) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00137956 s, 2.2 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00636596 s, 643 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000179338 s, 17.1 MB/s PASS 10b (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 11: execution of file opened for write should return error ============================================================== 03:18:19 (1711091899) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.9012 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 03:18:22 (1711091902) warning: '-runtime' deprecated, use '-t runtime' instead - link 3130 (time 1711091912.71 total 10.00 last 312.98) - link 7739 (time 1711091922.72 total 20.00 last 460.88) - link 10000 (time 1711091927.49 total 24.77 last 473.99) - link 14809 (time 1711091937.49 total 34.77 last 480.84) - link 19413 (time 1711091947.49 total 44.77 last 460.39) - link 23606 (time 1711091957.49 total 54.77 last 419.25) - link 27726 (time 1711091967.49 total 64.78 last 411.94) - link 30000 (time 1711091973.23 total 70.51 last 396.22) - link 33915 (time 1711091983.23 total 80.52 last 391.39) - link 37974 (time 1711091993.23 total 90.52 last 405.84) - link 40000 (time 1711091998.20 total 95.48 last 408.11) total: 41661 link in 100.00 seconds: 416.61 ops/second using seed 3821123566 running for 100 seconds - stat 3351 (time 1711091914 ; total 11 ; last 11) - stat 10000 (time 1711091921 ; total 18 ; last 7) - stat 19915 (time 1711091932 ; total 29 ; last 11) - stat 20000 (time 1711091932 ; total 29 ; last 0) - stat 30000 (time 1711091942 ; total 39 ; last 10) - stat 39333 (time 1711091953 ; total 50 ; last 11) - stat 40000 (time 1711091953 ; total 50 ; last 0) - stat 46754 (time 1711091964 ; total 61 ; last 11) - stat 50000 (time 1711091968 ; total 65 ; last 4) - stat 56092 (time 1711091979 ; total 76 ; last 11) - stat 60000 (time 1711091984 ; total 81 ; last 5) - stat 67292 (time 1711091995 ; total 92 ; last 11) - stat 70000 (time 1711091998 ; total 95 ; last 3) total: 72923 stats in 100 seconds: 729.229980 stats/second - unlinked 0 (time 1711091953 ; total 0 ; last 0) - unlinked 10000 (time 1711091999 ; total 46 ; last 46) - unlinked 20000 (time 1711092021 ; total 68 ; last 22) - unlinked 30000 (time 1711092044 ; total 91 ; last 23) - unlinked 40000 (time 1711092066 ; total 113 ; last 22) unlink(/mnt/lustre2/lockdir/lockfile41661) error: No such file or directory total: 41660 unlinks in 117 seconds: 356.068390 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (23861) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (23864) - No such process PASS 12 (169s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 03:21:12 (1711092072) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.9012 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4661: 24743 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 03:21:15 (1711092075) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4661: 25482 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 03:21:18 (1711092078) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 26218 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 03:21:21 (1711092081) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 26957 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14d: chmod of executing file is still possible ================================================================== 03:21:24 (1711092084) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 27696 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 17: resource creation/LVB creation race ========================================================================= 03:21:27 (1711092087) fail_loc=0x8000030a PASS 17 (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 19: test concurrent uncached read races ========================================================================= 03:21:33 (1711092093) oleg448-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 20: test extra readahead page left in cache ============================================================== 03:21:35 (1711092095) PASS 20 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 23: others should see updated atime while another read============================================================== 03:21:38 (1711092098) now is 1711092099 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.9012 new atime is 1711092160 PASS 23 (63s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 27: align non-overlapping extent locks from request ============================================================= 03:22:42 (1711092162) 4+0 records in 4+0 records out 16793600 bytes (17 MB) copied, 0.129541 s, 130 MB/s dd 1 started dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB) copied, 0.156498 s, 101 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB) copied, 0.00365264 s, 2.2 MB/s dd 3 finished PASS 27 (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39a: file mtime does not change after rename ========================================================== 03:22:48 (1711092168) repeat after cancel_lru_locks PASS 39a (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 03:22:51 (1711092171) repeat after cancel_lru_locks PASS 39b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39c: check truncate mtime update ================================================================================ 03:22:55 (1711092175) repeat after cancel_lru_locks PASS 39c (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39d: sync write should update mtime ====== 03:22:59 (1711092179) fail_loc=0x411 fail_loc=0 PASS 39d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 51a: layout lock: refresh layout should work ========================================================== 03:23:02 (1711092182) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00311003 s, 51.1 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3445: kill: (3332) - No such process PASS 51a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 03:23:07 (1711092187) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00480071 s, 213 kB/s PASS 51c (5s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 03:23:14 (1711092194) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00836867 s, 125 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 107a: Basic grouplock conflict =========== 03:23:18 (1711092198) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0952735 s, 110 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x280000400:0x3db:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.9012 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.9012 First grouplock blocks second one PASS 107a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 03:23:23 (1711092203) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0698996 s, 150 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x240000400:0x3dd:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.9012 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (7s) debug_raw_pointers=1 debug_raw_pointers=1 cleanup: ====================================================== == sanityn test complete, duration 371 sec =============== 03:23:31 (1711092211) === sanityn: start cleanup 03:23:32 (1711092212) === Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg448-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 03:23:32 (1711092212) === PASS sanityn (373s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-dom test complete, duration 837 sec ============ 03:23:33 (1711092213) === sanity-dom: start cleanup 03:23:34 (1711092214) === Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 03:23:34 (1711092214) ===