-----============= acceptance-small: sanity-dom ============----- Tue Aug 27 11:42:25 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: === sanity-dom: start setup 11:42:29 (1724773349) === Starting client oleg409-client.virtnet: -o user_xattr,flock 192.168.204.109@tcp:/lustre /mnt/lustre2 Started clients oleg409-client.virtnet: 192.168.204.109@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg409-client.virtnet: executing check_config_client /mnt/lustre oleg409-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg409-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a95e6800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012db76800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a95e6800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012db76800.idle_timeout=debug disable quota as required oleg409-server: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 11:42:36 (1724773356) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7006] 192.168.204.109@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 == sanity-dom test 1: write a file on one mount, truncate on the other, write again ========================================================== 11:42:36 (1724773356) 1+0 records in 1+0 records out 7168 bytes (7.2 kB) copied, 0.00214197 s, 3.3 MB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00361641 s, 849 kB/s /mnt/lustre2/f1.sanity-dom has type file OK /mnt/lustre2/f1.sanity-dom has size 6144 OK PASS 1 (2s) == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 11:42:38 (1724773358) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245257 s, 42.8 MB/s 1+0 records in 1+0 records out 234852 bytes (235 kB) copied, 0.00487129 s, 48.2 MB/s 0+1 records in 0+1 records out 234852 bytes (235 kB) copied, 0.0233815 s, 10.0 MB/s /mnt/lustre/f2.sanity-dom_left has type file OK /mnt/lustre/f2.sanity-dom_left has size 234852 OK PASS 2 (2s) == sanity-dom test 3: Truncate over DoM size on different nodes ========================================================== 11:42:41 (1724773361) 1+0 records in 1+0 records out 1048476 bytes (1.0 MB) copied, 0.0187566 s, 55.9 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0198929 s, 206 kB/s /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049276 OK /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049076 OK /mnt/lustre/f3.sanity-dom has type file OK /mnt/lustre/f3.sanity-dom has size 1049076 OK PASS 3 (3s) == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 11:42:43 (1724773363) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0227686 s, 92.1 MB/s fail_loc=0x80000808 PASS 4 (3s) == sanity-dom test 5: DoM truncate deadlock ============== 11:42:46 (1724773366) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00381849 s, 1.1 MB/s multiop /mnt/lustre/f5.sanity-dom vO_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7006 multiop /mnt/lustre/f5.sanity-dom vO_Tc TMPPIPE=/tmp/multiop_open_wait_pipe.7006 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f5.sanity-dom user.job="dd.0" fail_loc=0x80001415 fail_val=5 PASS 5 (3s) == sanity-dom test 6: Race two writes, check file size === 11:42:49 (1724773369) /mnt/lustre2/f6.sanity-dom has size 500 OK PASS 6 (3s) == sanity-dom test 7: Stale pages after read-on-open ===== 11:42:52 (1724773372) 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00202809 s, 493 kB/s 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00204587 s, 489 kB/s PASS 7 (1s) == sanity-dom test fsx: Dual-mount fsx with DoM files ==== 11:42:53 (1724773373) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 3374 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003[1] 1724773374.398764 write 0x1fed4d thru 0x1ff60d (0x8c1 bytes) 1724773374.404404 write done 000005[1] 1724773374.420908 mapread 0x03b417 thru 0x04b2a2 (0xfe8c bytes) 1724773374.425272 mmap done 1724773374.440901 memcpy done 1724773374.441060 munmap done 000007[0] 1724773374.446878 write 0x1b826f thru 0x1c7569 (0xf2fb bytes) 1724773374.456206 write done 000009[1] 1724773374.461175 mapwrite 0x15dd97 thru 0x15ebdd (0xe47 bytes) 1724773374.463271 mmap done 1724773374.496753 msync done 1724773374.496812 munmap done truncating to largest ever: 0x57545 000010[0] 1724773374.497220 trunc from 0x1ff60e to 0x057544 (0x1a80c9 bytes) 1724773374.507804 truncate done 000014[0] 1724773374.527995 mapread 0x003431 thru 0x01227b (0xee4b bytes) 1724773374.528189 mmap done 1724773374.537869 memcpy done 1724773374.537974 munmap done 000021[0] 1724773374.554896 mapwrite 0x1860d3 thru 0x18cb5e (0x6a8c bytes) 1724773374.560509 truncate done 1724773374.560659 mmap done 1724773374.592109 msync done 1724773374.592158 munmap done 000024[1] 1724773374.604297 mapread 0x070488 thru 0x0803e0 (0xff59 bytes) 1724773374.606802 mmap done 1724773374.692783 memcpy done 1724773374.692879 munmap done 000025[1] 1724773374.694207 mapread 0x08c209 thru 0x094af9 (0x88f1 bytes) 1724773374.696390 mmap done 1724773374.728809 memcpy done 1724773374.728874 munmap done 000027[1] 1724773374.736777 write 0x0950d7 thru 0x09c252 (0x717c bytes) 1724773374.740318 write done 000028[1] 1724773374.744481 read 0x0153b8 thru 0x0173cf (0x2018 bytes) 1724773374.746220 read done 000029[0] 1724773374.751755 mapwrite 0x16196f thru 0x163d65 (0x23f7 bytes) 1724773374.754608 mmap done 1724773374.770624 msync done 1724773374.770686 munmap done truncating to largest ever: 0xcd7b7 000030[1] 1724773374.774822 trunc from 0x18cb5f to 0x0cd7b6 (0xbf3a8 bytes) 1724773374.782872 truncate done 000037[1] 1724773374.813558 write 0x1dfa88 thru 0x1e7ed8 (0x8451 bytes) 1724773374.815327 write done 000043[0] 1724773374.827638 mapread 0x0fa18c thru 0x0fda7b (0x38f0 bytes) 1724773374.832544 mmap done 1724773374.862967 memcpy done 1724773374.863024 munmap done truncating to largest ever: 0x12b4e5 000044[1] 1724773374.864742 trunc from 0x1e7ed9 to 0x12b4e4 (0xbc9f4 bytes) 1724773374.875785 truncate done 000046[1] 1724773374.877902 trunc from 0x12b4e5 to 0x0336c9 (0xf7e1b bytes) 1724773374.882076 truncate done 000047[0] 1724773374.884023 read 0x024737 thru 0x027fcf (0x3899 bytes) 1724773374.891260 read done 000048[0] 1724773374.893155 mapread 0x0065d8 thru 0x0089fa (0x2423 bytes) 1724773374.897037 mmap done 1724773374.905326 memcpy done 1724773374.905389 munmap done 000051[1] 1724773374.925485 mapread 0x0042a6 thru 0x00619c (0x1ef7 bytes) 1724773374.925781 mmap done 1724773374.935230 memcpy done 1724773374.935324 munmap done 000056[0] 1724773374.940882 write 0x056909 thru 0x05cf84 (0x667c bytes) 1724773374.946287 write done 000058[0] 1724773374.956350 mapread 0x04809f thru 0x04fb1a (0x7a7c bytes) 1724773374.958120 mmap done 1724773374.962510 memcpy done 1724773374.962598 munmap done 000060[0] 1724773374.970598 read 0x04224e thru 0x04e25e (0xc011 bytes) 1724773374.970717 read done 000061[1] 1724773374.974173 mapwrite 0x0ee3c2 thru 0x0f3ef4 (0x5b33 bytes) 1724773374.984649 truncate done 1724773374.984810 mmap done 1724773375.008526 msync done 1724773375.008620 munmap done 000064[1] 1724773375.015411 write 0x1db88e thru 0x1df838 (0x3fab bytes) 1724773375.016028 write done 000068[0] 1724773375.023474 mapwrite 0x16db68 thru 0x1709ed (0x2e86 bytes) 1724773375.026629 mmap done 1724773375.057790 msync done 1724773375.057858 munmap done 000071[0] 1724773375.069837 mapread 0x1b9480 thru 0x1c67ec (0xd36d bytes) 1724773375.071686 mmap done 1724773375.086579 memcpy done 1724773375.086635 munmap done 000072[1] 1724773375.090052 read 0x0fb6de thru 0x10935a (0xdc7d bytes) 1724773375.112222 read done 000073[0] 1724773375.117625 trunc from 0x1df839 to 0x0e7865 (0xf7fd3 bytes) 1724773375.131151 truncate done 000075[1] 1724773375.141985 write 0x05302f thru 0x05ab0b (0x7add bytes) 1724773375.149290 write done 000080[1] 1724773375.172852 mapread 0x0addee thru 0x0bd4e7 (0xf6fa bytes) 1724773375.175030 mmap done 1724773375.196800 memcpy done 1724773375.196908 munmap done 000081[0] 1724773375.201963 read 0x04be6a thru 0x0516e2 (0x5879 bytes) 1724773375.219403 read done 000082[0] 1724773375.226782 write 0x1d819d thru 0x1d972f (0x1593 bytes) 1724773375.227307 write done 000084[1] 1724773375.236770 mapread 0x067c7a thru 0x06ea36 (0x6dbd bytes) 1724773375.240690 mmap done 1724773375.254870 memcpy done 1724773375.254948 munmap done 000086[1] 1724773375.255519 mapwrite 0x100f67 thru 0x1082b6 (0x7350 bytes) 1724773375.258797 mmap done 1724773375.297322 msync done 1724773375.297387 munmap done 000087[0] 1724773375.297739 read 0x1c0d76 thru 0x1ca699 (0x9924 bytes) 1724773375.315198 read done truncating to largest ever: 0x185d5a 000093[0] 1724773375.318159 trunc from 0x1d9730 to 0x185d59 (0x539d6 bytes) 1724773375.329891 truncate done 000094[0] 1724773375.331321 write 0x0ef355 thru 0x0f2d88 (0x3a34 bytes) 1724773375.333780 write done 000095[0] 1724773375.334099 mapread 0x0e0417 thru 0x0e307f (0x2c69 bytes) 1724773375.334265 mmap done 1724773375.341063 memcpy done 1724773375.341105 munmap done 000097[1] 1724773375.341663 write 0x07c244 thru 0x07e811 (0x25ce bytes) 1724773375.347650 write done 000099[0] 1724773375.355674 mapread 0x00ffaa thru 0x014ec0 (0x4f17 bytes) 1724773375.357356 mmap done 1724773375.368671 memcpy done 1724773375.368750 munmap done 000103[0] 1724773375.380696 mapread 0x15bf7d thru 0x1684dc (0xc560 bytes) 1724773375.380898 mmap done 1724773375.398800 memcpy done 1724773375.398856 munmap done 000104[0] 1724773375.402551 mapwrite 0x0c3540 thru 0x0d1315 (0xddd6 bytes) 1724773375.402857 mmap done 1724773375.443737 msync done 1724773375.444301 munmap done 000107[1] 1724773375.451109 write 0x002915 thru 0x00816b (0x5857 bytes) 1724773375.457252 write done 000109[1] 1724773375.466069 read 0x161f52 thru 0x16a246 (0x82f5 bytes) 1724773375.479872 read done 000112[0] 1724773375.484515 read 0x01f91c thru 0x02cb45 (0xd22a bytes) 1724773375.501810 read done 000113[0] 1724773375.502458 mapwrite 0x1541bb thru 0x15ff32 (0xbd78 bytes) 1724773375.502806 mmap done 1724773375.562194 msync done 1724773375.562267 munmap done 000115[0] 1724773375.568139 mapwrite 0x18f158 thru 0x198ddf (0x9c88 bytes) 1724773375.580714 truncate done 1724773375.580896 mmap done 1724773375.615477 msync done 1724773375.615544 munmap done 000117[0] 1724773375.617646 read 0x09272b thru 0x095670 (0x2f46 bytes) 1724773375.631029 read done 000118[0] 1724773375.637723 trunc from 0x198de0 to 0x0a1d45 (0xf709a bytes) 1724773375.643488 truncate done 000119[0] 1724773375.645400 trunc from 0x0a1d46 to 0x03b03b (0x66d0a bytes) 1724773375.648830 truncate done 000121[1] 1724773375.650759 mapread 0x038588 thru 0x03b03b (0x2ab4 bytes) 1724773375.653524 mmap done 1724773375.665316 memcpy done 1724773375.665503 munmap done 000122[0] 1724773375.667190 trunc from 0x03b03c to 0x160e71 (0x125e36 bytes) 1724773375.674212 truncate done 000125[1] 1724773375.684161 read 0x121686 thru 0x1284aa (0x6e25 bytes) 1724773375.704275 read done 000127[1] 1724773375.711334 read 0x047069 thru 0x04b60e (0x45a6 bytes) 1724773375.725046 read done 000130[1] 1724773375.727707 mapwrite 0x139f20 thru 0x1448d2 (0xa9b3 bytes) 1724773375.727997 mmap done 1724773375.780599 msync done 1724773375.780688 munmap done 000131[1] 1724773375.781065 mapread 0x11612a thru 0x12134b (0xb222 bytes) 1724773375.781222 mmap done 1724773375.797987 memcpy done 1724773375.798053 munmap done truncating to largest ever: 0x1d7330 000134[0] 1724773375.813885 trunc from 0x160e72 to 0x1d732f (0x764be bytes) 1724773375.830078 truncate done 000137[0] 1724773375.841613 trunc from 0x1d7330 to 0x0f081f (0xe6b10 bytes) 1724773375.849756 truncate done 000139[1] 1724773375.852027 trunc from 0x0f0820 to 0x039336 (0xb74e9 bytes) 1724773375.866302 truncate done 000142[0] 1724773375.877459 trunc from 0x039337 to 0x10150d (0xc81d7 bytes) 1724773375.898128 truncate done 000145[0] 1724773375.922488 read 0x093c8c thru 0x09f9af (0xbd24 bytes) 1724773375.932992 read done 000146[0] 1724773375.934856 mapread 0x0d2bce thru 0x0e0aa5 (0xded8 bytes) 1724773375.935038 mmap done 1724773375.935133 memcpy done 1724773375.935200 munmap done 000147[0] 1724773375.935488 write 0x115837 thru 0x11f229 (0x99f3 bytes) 1724773375.936077 write done 000148[0] 1724773375.936349 write 0x0cc6f7 thru 0x0ce80d (0x2117 bytes) 1724773375.936594 write done 000149[1] 1724773375.942543 mapwrite 0x16b212 thru 0x1795da (0xe3c9 bytes) 1724773375.960083 truncate done 1724773375.960256 mmap done 1724773376.004795 msync done 1724773376.004864 munmap done 000151[0] 1724773376.008234 mapwrite 0x0976c3 thru 0x098258 (0xb96 bytes) 1724773376.011461 mmap done 1724773376.042726 msync done 1724773376.042869 munmap done 000153[0] 1724773376.058598 trunc from 0x1795db to 0x102971 (0x76c69 bytes) 1724773376.069964 truncate done 000154[1] 1724773376.077590 read 0x00b593 thru 0x00e491 (0x2eff bytes) 1724773376.091454 read done 000155[0] 1724773376.094204 trunc from 0x102972 to 0x03bc67 (0xc6d0a bytes) 1724773376.103202 truncate done 000156[0] 1724773376.111294 trunc from 0x03bc68 to 0x014d6a (0x26efd bytes) 1724773376.118559 truncate done 000158[1] 1724773376.128585 trunc from 0x014d6b to 0x13dce7 (0x128f7d bytes) 1724773376.141153 truncate done 000160[0] 1724773376.151140 read 0x0830ea thru 0x09165b (0xe572 bytes) 1724773376.196038 read done 000165[1] 1724773376.216442 write 0x1bcbf6 thru 0x1ca17a (0xd585 bytes) 1724773376.217301 write done 000169[1] 1724773376.230746 read 0x11f8b7 thru 0x125e4b (0x6595 bytes) 1724773376.240485 read done 000170[0] 1724773376.245075 trunc from 0x1ca17b to 0x0db12b (0xef04f bytes) 1724773376.264028 truncate done 000171[1] 1724773376.271410 write 0x1dbab5 thru 0x1e03f8 (0x4944 bytes) 1724773376.275870 write done 000172[0] 1724773376.284233 mapwrite 0x115b45 thru 0x12264d (0xcb09 bytes) 1724773376.286703 mmap done 1724773376.360303 msync done 1724773376.360414 munmap done 000173[0] 1724773376.370056 trunc from 0x1e03f9 to 0x1c70fa (0x192fe bytes) 1724773376.378983 truncate done 000174[1] 1724773376.381054 write 0x01eb53 thru 0x0232d8 (0x4786 bytes) 1724773376.389327 write done 000175[0] 1724773376.394750 mapread 0x1a0b43 thru 0x1a9803 (0x8cc1 bytes) 1724773376.398818 mmap done 1724773376.398969 memcpy done 1724773376.399081 munmap done 000176[1] 1724773376.409217 trunc from 0x1c70fb to 0x0188d8 (0x1ae822 bytes) 1724773376.421456 truncate done 000178[1] 1724773376.432441 mapread 0x0177d5 thru 0x0188d8 (0x1104 bytes) 1724773376.432645 mmap done 1724773376.436700 memcpy done 1724773376.436812 munmap done 000179[1] 1724773376.437322 mapwrite 0x084e2c thru 0x088e85 (0x405a bytes) 1724773376.444897 truncate done 1724773376.445085 mmap done 1724773376.484773 msync done 1724773376.484982 munmap done 000183[1] 1724773376.500457 read 0x065598 thru 0x06e559 (0x8fc2 bytes) 1724773376.510330 read done 000185[1] 1724773376.521175 read 0x023b69 thru 0x025034 (0x14cc bytes) 1724773376.521357 read done 000189[0] 1724773376.548688 mapread 0x0353b9 thru 0x043a28 (0xe670 bytes) 1724773376.551515 mmap done 1724773376.585415 memcpy done 1724773376.585529 munmap done 000190[1] 1724773376.593863 read 0x02927c thru 0x02ae65 (0x1bea bytes) 1724773376.605472 read done 000191[0] 1724773376.615502 write 0x18708f thru 0x190ca1 (0x9c13 bytes) 1724773376.622908 write done 000192[1] 1724773376.623564 mapread 0x0eb331 thru 0x0f048b (0x515b bytes) 1724773376.627627 mmap done 1724773376.664326 memcpy done 1724773376.664491 munmap done 000193[0] 1724773376.664850 mapread 0x0dca46 thru 0x0debe4 (0x219f bytes) 1724773376.665039 mmap done 1724773376.673761 memcpy done 1724773376.674048 munmap done 000195[0] 1724773376.674572 read 0x0380cc thru 0x047ef2 (0xfe27 bytes) 1724773376.686809 read done 000197[1] 1724773376.695333 mapwrite 0x0e5ba7 thru 0x0f54ea (0xf944 bytes) 1724773376.700214 mmap done 1724773376.960014 msync done 1724773376.960197 munmap done 000198[1] 1724773376.969164 read 0x0a130e thru 0x0a2506 (0x11f9 bytes) 1724773376.969270 read done 000202[1] 1724773377.005379 write 0x0f8c7a thru 0x0fc372 (0x36f9 bytes) 1724773377.005927 write done 000203[1] 1724773377.012021 trunc from 0x190ca2 to 0x15571a (0x3b587 bytes) 1724773377.026272 truncate done 000207[1] 1724773377.046497 read 0x0781c8 thru 0x082cbd (0xaaf6 bytes) 1724773377.058254 read done 000210[1] 1724773377.079290 write 0x0a4b29 thru 0x0aa18e (0x5666 bytes) 1724773377.079723 write done 000212[1] 1724773377.080303 mapread 0x00bda0 thru 0x013303 (0x7564 bytes) 1724773377.080474 mmap done 1724773377.080555 memcpy done 1724773377.080645 munmap done 000215[0] 1724773377.093660 write 0x0ec286 thru 0x0ed400 (0x117b bytes) 1724773377.106874 write done 000216[0] 1724773377.113307 trunc from 0x15571b to 0x15d157 (0x7a3d bytes) 1724773377.124657 truncate done 000220[1] 1724773377.149993 write 0x167c6c thru 0x168da6 (0x113b bytes) 1724773377.154336 write done 000222[0] 1724773377.165785 trunc from 0x168da7 to 0x1a34b5 (0x3a70f bytes) 1724773377.175084 truncate done 000224[0] 1724773377.183459 trunc from 0x1a34b6 to 0x0aeb82 (0xf4933 bytes) 1724773377.190245 truncate done 000225[1] 1724773377.192558 read 0x08f9c0 thru 0x094f87 (0x55c8 bytes) 1724773377.207684 read done 000227[0] 1724773377.218076 read 0x073625 thru 0x07dcc0 (0xa69c bytes) 1724773377.227993 read done 000228[0] 1724773377.228342 write 0x1367a6 thru 0x144050 (0xd8ab bytes) 1724773377.229108 write done 000230[1] 1724773377.234743 write 0x0b4220 thru 0x0c39b9 (0xf79a bytes) 1724773377.240963 write done 000231[0] 1724773377.250763 mapread 0x0ebabb thru 0x0f88ba (0xce00 bytes) 1724773377.253776 mmap done 1724773377.267497 memcpy done 1724773377.267604 munmap done 000232[1] 1724773377.267962 mapwrite 0x0c78ea thru 0x0d2acf (0xb1e6 bytes) 1724773377.271299 mmap done 1724773377.434781 msync done 1724773377.434935 munmap done 000234[1] 1724773377.451758 read 0x0d24d9 thru 0x0db0aa (0x8bd2 bytes) 1724773377.478940 read done 000235[1] 1724773377.487810 read 0x0934f7 thru 0x09b392 (0x7e9c bytes) 1724773377.488169 read done 000237[0] 1724773377.502561 write 0x0e3425 thru 0x0e988c (0x6468 bytes) 1724773377.513262 write done 000238[0] 1724773377.513670 read 0x05875d thru 0x0659af (0xd253 bytes) 1724773377.527469 read done 000239[0] 1724773377.537999 trunc from 0x144051 to 0x08b243 (0xb8e0d bytes) 1724773377.545768 truncate done 000241[1] 1724773377.558291 trunc from 0x08b244 to 0x0701f4 (0x1b04f bytes) 1724773377.574096 truncate done 000243[0] 1724773377.576513 trunc from 0x0701f5 to 0x08c873 (0x1c67f bytes) 1724773377.591218 truncate done 000244[1] 1724773377.593247 mapread 0x085696 thru 0x0862ca (0xc35 bytes) 1724773377.596944 mmap done 1724773377.611503 memcpy done 1724773377.611594 munmap done 000246[0] 1724773377.615433 write 0x1691eb thru 0x175c7f (0xca95 bytes) 1724773377.616294 write done 000247[0] 1724773377.627690 mapread 0x0b5fe8 thru 0x0b7a45 (0x1a5e bytes) 1724773377.627946 mmap done 1724773377.641036 memcpy done 1724773377.641273 munmap done 000249[0] 1724773377.642036 trunc from 0x175c80 to 0x0570da (0x11eba5 bytes) 1724773377.655327 truncate done 000250[1] 1724773377.657514 read 0x00f135 thru 0x0102b4 (0x1180 bytes) 1724773377.670433 read done 000251[1] 1724773377.682843 write 0x14b2ce thru 0x14b327 (0x5a bytes) 1724773377.689189 write done 000252[1] 1724773377.696044 mapwrite 0x13ca1b thru 0x146538 (0x9b1e bytes) 1724773377.696324 mmap done 1724773377.755108 msync done 1724773377.755321 munmap done 000255[0] 1724773377.790185 trunc from 0x14b328 to 0x033fc0 (0x117367 bytes) 1724773377.811248 truncate done 000257[1] 1724773377.826552 read 0x01f1a3 thru 0x02ac31 (0xba8f bytes) 1724773377.837014 read done 000260[1] 1724773377.848494 trunc from 0x033fc1 to 0x0a6530 (0x72570 bytes) 1724773377.864632 truncate done 000261[1] 1724773377.866885 mapread 0x01af49 thru 0x0245c2 (0x967a bytes) 1724773377.867139 mmap done 1724773377.904288 memcpy done 1724773377.904494 munmap done 000263[1] 1724773377.924717 trunc from 0x0a6531 to 0x0b5e9b (0xf96b bytes) 1724773377.931587 truncate done 000265[1] 1724773377.957431 mapread 0x060de1 thru 0x0640f1 (0x3311 bytes) 1724773377.957629 mmap done 1724773377.957690 memcpy done 1724773377.957755 munmap done 000267[1] 1724773377.973057 mapwrite 0x1f37ef thru 0x1fffff (0xc811 bytes) 1724773377.980499 truncate done 1724773377.980681 mmap done 1724773378.040944 msync done 1724773378.041133 munmap done 000269[0] 1724773378.051878 trunc from 0x200000 to 0x16e4ae (0x91b51 bytes) 1724773378.071534 truncate done 000270[1] 1724773378.083513 mapwrite 0x02a48c thru 0x039875 (0xf3ea bytes) 1724773378.090396 mmap done 1724773378.159308 msync done 1724773378.159406 munmap done 000272[1] 1724773378.181630 mapread 0x164f53 thru 0x16c014 (0x70c2 bytes) 1724773378.187534 mmap done 1724773378.231325 memcpy done 1724773378.232459 munmap done 000274[1] 1724773378.244974 trunc from 0x16e4af to 0x1b7dae (0x49900 bytes) 1724773378.264655 truncate done 000277[0] 1724773378.295648 trunc from 0x1b7daf to 0x0ec523 (0xcb88b bytes) 1724773378.310389 truncate done 000278[1] 1724773378.325762 trunc from 0x0ec524 to 0x1caaab (0xde588 bytes) 1724773378.346637 truncate done 000279[1] 1724773378.349749 trunc from 0x1caaac to 0x07acbf (0x14fdec bytes) 1724773378.355388 truncate done 000280[0] 1724773378.357768 read 0x005abd thru 0x00d5bd (0x7b01 bytes) 1724773378.372415 read done 000282[0] 1724773378.374658 trunc from 0x07acc0 to 0x14e7f0 (0xd3b31 bytes) 1724773378.387718 truncate done 000283[1] 1724773378.390147 write 0x108dae thru 0x114da6 (0xbff9 bytes) 1724773378.398700 write done 000284[0] 1724773378.409313 read 0x02ccb5 thru 0x03468c (0x79d8 bytes) 1724773378.417466 read done 000288[1] 1724773378.454341 mapwrite 0x01a6a9 thru 0x01a8b5 (0x20d bytes) 1724773378.460250 mmap done 1724773378.499742 msync done 1724773378.500173 munmap done 000292[0] 1724773378.512342 write 0x16fb44 thru 0x1704ac (0x969 bytes) 1724773378.524235 write done 000295[0] 1724773378.561551 mapwrite 0x0d2ad9 thru 0x0dc432 (0x995a bytes) 1724773378.570460 mmap done 1724773378.617591 msync done 1724773378.617720 munmap done 000296[1] 1724773378.625202 mapwrite 0x1247f1 thru 0x12a99a (0x61aa bytes) 1724773378.628345 mmap done 1724773378.691209 msync done 1724773378.691293 munmap done 000298[0] 1724773378.712838 trunc from 0x1704ad to 0x0bb449 (0xb5063 bytes) 1724773378.728628 truncate done 000299[0] 1724773378.732509 read 0x09ce34 thru 0x09e3db (0x15a8 bytes) 1724773378.733145 read done 000302[0] 1724773378.746074 mapwrite 0x0eba7c thru 0x0fafd6 (0xf55b bytes) 1724773378.754543 truncate done 1724773378.754727 mmap done 1724773378.786541 msync done 1724773378.786641 munmap done 000303[0] 1724773378.796215 mapwrite 0x13ea9b thru 0x1456d0 (0x6c36 bytes) 1724773378.808103 truncate done 1724773378.808284 mmap done 1724773378.852206 msync done 1724773378.852486 munmap done 000304[0] 1724773378.856842 trunc from 0x1456d1 to 0x16ba4f (0x2637f bytes) 1724773378.865033 truncate done 000310[1] 1724773378.902505 mapwrite 0x0e4cca thru 0x0ed9ab (0x8ce2 bytes) 1724773378.907196 mmap done 1724773378.962264 msync done 1724773378.962474 munmap done 000313[1] 1724773378.983280 trunc from 0x16ba50 to 0x008708 (0x163347 bytes) 1724773378.998755 truncate done 000314[0] 1724773379.000858 mapwrite 0x1d3448 thru 0x1d48bc (0x1475 bytes) 1724773379.013687 truncate done 1724773379.013900 mmap done 1724773379.069369 msync done 1724773379.069617 munmap done 000316[1] 1724773379.090511 write 0x098383 thru 0x09b9e0 (0x365e bytes) 1724773379.096845 write done 000318[1] 1724773379.118615 mapread 0x062fb5 thru 0x070af2 (0xdb3e bytes) 1724773379.123210 mmap done 1724773379.164244 memcpy done 1724773379.164426 munmap done 000320[1] 1724773379.184396 write 0x08f6fa thru 0x098944 (0x924b bytes) 1724773379.188565 write done 000322[0] 1724773379.203648 mapread 0x14cb20 thru 0x154624 (0x7b05 bytes) 1724773379.206739 mmap done 1724773379.206830 memcpy done 1724773379.206866 munmap done 000323[1] 1724773379.216002 trunc from 0x1d48bd to 0x1d204c (0x2870 bytes) 1724773379.228018 truncate done 000324[1] 1724773379.229685 mapread 0x1c4b0b thru 0x1d0b19 (0xc00f bytes) 1724773379.229883 mmap done 1724773379.273015 memcpy done 1724773379.273206 munmap done 000325[0] 1724773379.286573 mapread 0x0e7315 thru 0x0f5726 (0xe412 bytes) 1724773379.293069 mmap done 1724773379.411287 memcpy done 1724773379.411549 munmap done 000326[0] 1724773379.423834 mapwrite 0x074204 thru 0x081842 (0xd63f bytes) 1724773379.427266 mmap done 1724773379.510799 msync done 1724773379.511264 munmap done 000329[1] 1724773379.539739 mapread 0x08532c thru 0x088c0f (0x38e4 bytes) 1724773379.547610 mmap done 1724773379.564753 memcpy done 1724773379.564849 munmap done 000330[1] 1724773379.565203 trunc from 0x1d204d to 0x1d66a6 (0x465a bytes) 1724773379.580209 truncate done 000331[0] 1724773379.584213 write 0x1f3b11 thru 0x1f777f (0x3c6f bytes) 1724773379.593636 write done 000335[0] 1724773379.622275 mapread 0x1949e8 thru 0x19eb85 (0xa19e bytes) 1724773379.625998 mmap done 1724773379.658590 memcpy done 1724773379.658801 munmap done 000338[0] 1724773379.686862 read 0x047774 thru 0x04f5f5 (0x7e82 bytes) 1724773379.704470 read done 000341[1] 1724773379.705166 trunc from 0x1f7780 to 0x12dfd8 (0xc97a7 bytes) 1724773379.727680 truncate done 000342[1] 1724773379.737315 mapwrite 0x01378d thru 0x0215c1 (0xde35 bytes) 1724773379.737654 mmap done 1724773379.803194 msync done 1724773379.803430 munmap done 000343[1] 1724773379.816706 write 0x09f978 thru 0x0a58a1 (0x5f2a bytes) 1724773379.822584 write done 000344[0] 1724773379.824987 write 0x1a4de2 thru 0x1a937d (0x459c bytes) 1724773379.828806 write done 000345[1] 1724773379.836289 read 0x074485 thru 0x074dfc (0x978 bytes) 1724773379.847312 read done 000347[0] 1724773379.872025 trunc from 0x1a937e to 0x0514b2 (0x157ecb bytes) 1724773379.892294 truncate done 000351[1] 1724773379.913221 read 0x008269 thru 0x017ea3 (0xfc3b bytes) 1724773379.929873 read done 000352[1] 1724773379.940319 write 0x08be6e thru 0x090dba (0x4f4d bytes) 1724773379.942670 write done 000353[1] 1724773379.948244 trunc from 0x090dbb to 0x08dcd5 (0x30e5 bytes) 1724773379.960004 truncate done 000357[1] 1724773379.977469 write 0x0ebcd2 thru 0x0f522d (0x955c bytes) 1724773379.978132 write done 000358[0] 1724773379.978401 mapread 0x06ba9c thru 0x0724f1 (0x6a56 bytes) 1724773379.985072 mmap done 1724773380.024641 memcpy done 1724773380.024838 munmap done 000359[0] 1724773380.027123 mapread 0x03db8b thru 0x0474d5 (0x994b bytes) 1724773380.030831 mmap done 1724773380.054181 memcpy done 1724773380.054250 munmap done 000362[1] 1724773380.069962 write 0x1052a3 thru 0x10c82b (0x7589 bytes) 1724773380.070651 write done 000363[0] 1724773380.076770 mapwrite 0x17c9b7 thru 0x1808e4 (0x3f2e bytes) 1724773380.095477 truncate done 1724773380.095936 mmap done 1724773380.158593 msync done 1724773380.158646 munmap done 000366[0] 1724773380.171135 trunc from 0x1808e5 to 0x0bb732 (0xc51b2 bytes) 1724773380.180858 truncate done 000368[0] 1724773380.199625 mapread 0x01b0c9 thru 0x01f003 (0x3f3b bytes) 1724773380.199835 mmap done 1724773380.208714 memcpy done 1724773380.208801 munmap done 000369[0] 1724773380.217263 read 0x00acd5 thru 0x0119a7 (0x6cd3 bytes) 1724773380.227346 read done 000373[0] 1724773380.237704 mapwrite 0x03ff54 thru 0x04856e (0x861b bytes) 1724773380.238125 mmap done 1724773380.260726 msync done 1724773380.260796 munmap done 000375[0] 1724773380.268880 mapwrite 0x1ffdb6 thru 0x1ffdf1 (0x3c bytes) 1724773380.274770 truncate done 1724773380.274958 mmap done 1724773380.319872 msync done 1724773380.320285 munmap done 000376[0] 1724773380.331700 mapread 0x164518 thru 0x16d66b (0x9154 bytes) 1724773380.332490 mmap done 1724773380.332803 memcpy done 1724773380.332838 munmap done 000377[1] 1724773380.346109 read 0x1bbc7d thru 0x1bdefd (0x2281 bytes) 1724773380.363463 read done 000387[0] 1724773380.437337 mapread 0x0cf43c thru 0x0d28ef (0x34b4 bytes) 1724773380.437542 mmap done 1724773380.437600 memcpy done 1724773380.437729 munmap done 000390[1] 1724773380.449883 write 0x141ba0 thru 0x14e6f9 (0xcb5a bytes) 1724773380.460512 write done 000391[1] 1724773380.474747 read 0x108c2a thru 0x115d82 (0xd159 bytes) 1724773380.506746 read done 000393[1] 1724773380.531131 mapwrite 0x02f17a thru 0x03e1c9 (0xf050 bytes) 1724773380.539221 mmap done 1724773380.600099 msync done 1724773380.600172 munmap done 000395[0] 1724773380.614367 mapread 0x1d995b thru 0x1dd9a8 (0x404e bytes) 1724773380.620024 mmap done 1724773380.647955 memcpy done 1724773380.648408 munmap done 000397[0] 1724773380.652564 mapread 0x159073 thru 0x162bf0 (0x9b7e bytes) 1724773380.655338 mmap done 1724773380.680543 memcpy done 1724773380.680627 munmap done 000398[0] 1724773380.681086 mapwrite 0x1565e8 thru 0x161ec4 (0xb8dd bytes) 1724773380.688671 mmap done 1724773380.740015 msync done 1724773380.740204 munmap done 000405[1] 1724773380.790899 read 0x18b75a thru 0x18f91f (0x41c6 bytes) 1724773380.814207 read done 000408[0] 1724773380.830008 mapread 0x01ec6d thru 0x028411 (0x97a5 bytes) 1724773380.834369 mmap done 1724773380.873819 memcpy done 1724773380.874228 munmap done 000410[1] 1724773380.878992 trunc from 0x1ffdf2 to 0x052788 (0x1ad669 bytes) 1724773380.901236 truncate done 000411[1] 1724773380.912431 read 0x031c19 thru 0x0345cf (0x29b7 bytes) 1724773380.918325 read done 000412[1] 1724773380.920145 mapwrite 0x0a482e thru 0x0aeec5 (0xa698 bytes) 1724773380.925789 truncate done 1724773380.925981 mmap done 1724773380.971773 msync done 1724773380.971943 munmap done 000414[0] 1724773380.983655 mapwrite 0x0b39a7 thru 0x0bb2a4 (0x78fe bytes) 1724773381.000233 truncate done 1724773381.000398 mmap done 1724773381.038556 msync done 1724773381.038779 munmap done 000416[1] 1724773381.051359 write 0x1b9113 thru 0x1c8bfe (0xfaec bytes) 1724773381.055256 write done 000418[0] 1724773381.067388 mapread 0x0eca0e thru 0x0f252c (0x5b1f bytes) 1724773381.070488 mmap done 1724773381.108803 memcpy done 1724773381.109067 munmap done 000419[1] 1724773381.113967 mapwrite 0x00415e thru 0x00f92e (0xb7d1 bytes) 1724773381.116363 mmap done 1724773381.166285 msync done 1724773381.166374 munmap done 000420[1] 1724773381.174622 write 0x1d3fe0 thru 0x1e157a (0xd59b bytes) 1724773381.175495 write done 000423[0] 1724773381.184507 trunc from 0x1e157b to 0x088d22 (0x158858 bytes) 1724773381.205154 truncate done 000424[1] 1724773381.208182 mapwrite 0x1432c5 thru 0x146d31 (0x3a6d bytes) 1724773381.224351 truncate done 1724773381.224551 mmap done 1724773381.287760 msync done 1724773381.287832 munmap done 000427[1] 1724773381.314288 mapread 0x0dd2d5 thru 0x0eaa7e (0xd7aa bytes) 1724773381.314870 mmap done 1724773381.343906 memcpy done 1724773381.344119 munmap done 000436[0] 1724773381.404520 read 0x134e9c thru 0x144906 (0xfa6b bytes) 1724773381.449105 read done truncating to largest ever: 0x1d7b07 000437[0] 1724773381.458320 trunc from 0x146d32 to 0x1d7b06 (0x90dd5 bytes) 1724773381.475052 truncate done 000439[1] 1724773381.485232 trunc from 0x1d7b07 to 0x17ac63 (0x5cea3 bytes) 1724773381.495823 truncate done 000440[1] 1724773381.498262 mapwrite 0x17418d thru 0x1748b9 (0x72d bytes) 1724773381.498477 mmap done 1724773381.527120 msync done 1724773381.527279 munmap done 000442[1] 1724773381.536403 write 0x1c7af1 thru 0x1d210e (0xa61e bytes) 1724773381.537455 write done 000444[0] 1724773381.545524 read 0x00445a thru 0x008883 (0x442a bytes) 1724773381.560878 read done 000451[1] 1724773381.589647 mapread 0x16dbc6 thru 0x17959a (0xb9d5 bytes) 1724773381.589869 mmap done 1724773381.613860 memcpy done 1724773381.614077 munmap done 000452[0] 1724773381.619887 read 0x1af89e thru 0x1b8290 (0x89f3 bytes) 1724773381.647971 read done 000453[0] 1724773381.651485 mapread 0x02e875 thru 0x03cdb1 (0xe53d bytes) 1724773381.651680 mmap done 1724773381.651782 memcpy done 1724773381.652313 munmap done 000455[1] 1724773381.652843 mapwrite 0x13dda6 thru 0x13e9ec (0xc47 bytes) 1724773381.653022 mmap done 1724773381.692741 msync done 1724773381.693028 munmap done 000456[1] 1724773381.704206 read 0x0ed029 thru 0x0f8934 (0xb90c bytes) 1724773381.735483 read done 000457[1] 1724773381.746989 write 0x0e8b32 thru 0x0f2244 (0x9713 bytes) 1724773381.758007 write done 000458[1] 1724773381.767685 read 0x056427 thru 0x062471 (0xc04b bytes) 1724773381.779905 read done 000461[0] 1724773381.802328 mapread 0x02dbc4 thru 0x039ea3 (0xc2e0 bytes) 1724773381.807969 mmap done 1724773381.854275 memcpy done 1724773381.854532 munmap done 000464[1] 1724773381.883548 write 0x19c941 thru 0x19f147 (0x2807 bytes) 1724773381.884050 write done 000465[0] 1724773381.891375 mapread 0x0d1c44 thru 0x0dea01 (0xcdbe bytes) 1724773381.894563 mmap done 1724773381.939726 memcpy done 1724773381.940304 munmap done 000466[1] 1724773381.947327 mapwrite 0x15915e thru 0x164486 (0xb329 bytes) 1724773381.949056 mmap done 1724773381.975229 msync done 1724773381.975590 munmap done 000467[0] 1724773381.975901 mapread 0x0d63d8 thru 0x0dc3e7 (0x6010 bytes) 1724773381.981736 mmap done 1724773381.981823 memcpy done 1724773381.981908 munmap done 000469[1] 1724773382.002692 trunc from 0x1d210f to 0x1b23a0 (0x1fd6e bytes) 1724773382.014563 truncate done 000471[1] 1724773382.018735 mapwrite 0x131638 thru 0x140f0a (0xf8d3 bytes) 1724773382.019036 mmap done 1724773382.069136 msync done 1724773382.069237 munmap done 000472[0] 1724773382.076449 write 0x14acb0 thru 0x152b9f (0x7ef0 bytes) 1724773382.084950 write done 000475[1] 1724773382.101245 write 0x12f234 thru 0x135e0b (0x6bd8 bytes) 1724773382.113184 write done 000482[1] 1724773382.144869 write 0x112b39 thru 0x11a1c8 (0x7690 bytes) 1724773382.151348 write done 000483[0] 1724773382.158953 read 0x06962d thru 0x0720dc (0x8ab0 bytes) 1724773382.181668 read done 000484[0] 1724773382.194129 mapwrite 0x10f89e thru 0x11477c (0x4edf bytes) 1724773382.198468 mmap done 1724773382.237309 msync done 1724773382.237698 munmap done 000485[1] 1724773382.238064 mapwrite 0x020212 thru 0x02e948 (0xe737 bytes) 1724773382.241469 mmap done 1724773382.306336 msync done 1724773382.306578 munmap done 000486[1] 1724773382.317720 read 0x0e76ce thru 0x0ec359 (0x4c8c bytes) 1724773382.333459 read done 000490[0] 1724773382.365942 write 0x170c18 thru 0x17a259 (0x9642 bytes) 1724773382.366373 write done 000491[1] 1724773382.372691 mapread 0x1701d8 thru 0x175b3c (0x5965 bytes) 1724773382.375715 mmap done 1724773382.392381 memcpy done 1724773382.392436 munmap done 000492[1] 1724773382.402197 trunc from 0x1b23a1 to 0x133b44 (0x7e85c bytes) 1724773382.418505 truncate done 000499[0] 1724773382.457831 write 0x08df84 thru 0x096450 (0x84cd bytes) 1724773382.472652 write done 000500[1] 1724773382.478841 mapread 0x0c77cc thru 0x0cb494 (0x3cc9 bytes) 1724773382.483549 mmap done 1724773382.499882 memcpy done 1724773382.500004 munmap done 000502[1] 1724773382.500531 read 0x02c2ae thru 0x02e49a (0x21ed bytes) 1724773382.512806 read done 000504[1] 1724773382.523970 mapwrite 0x14b41d thru 0x152586 (0x716a bytes) 1724773382.537095 truncate done 1724773382.537293 mmap done 1724773382.604991 msync done 1724773382.605059 munmap done 000506[0] 1724773382.619369 write 0x1eda57 thru 0x1fce15 (0xf3bf bytes) 1724773382.626461 write done 000507[1] 1724773382.634378 write 0x05bfef thru 0x06652c (0xa53e bytes) 1724773382.644512 write done 000508[1] 1724773382.654685 trunc from 0x1fce16 to 0x0e15c6 (0x11b84f bytes) 1724773382.669769 truncate done 000509[1] 1724773382.679097 read 0x0601af thru 0x060b9d (0x9ef bytes) 1724773382.679202 read done 000516[1] 1724773382.696548 read 0x058380 thru 0x061da2 (0x9a23 bytes) 1724773382.706797 read done 000520[1] 1724773382.714028 read 0x07547e thru 0x076727 (0x12aa bytes) 1724773382.714134 read done 000523[0] 1724773382.736683 write 0x1ead6e thru 0x1f9bcd (0xee60 bytes) 1724773382.742323 write done 000524[0] 1724773382.748907 mapread 0x01392f thru 0x0211e8 (0xd8ba bytes) 1724773382.752890 mmap done 1724773382.791043 memcpy done 1724773382.791198 munmap done 000525[0] 1724773382.791588 mapwrite 0x068521 thru 0x06c3e1 (0x3ec1 bytes) 1724773382.791746 mmap done 1724773382.823589 msync done 1724773382.823947 munmap done truncating to largest ever: 0x1e7f7a 000526[1] 1724773382.824258 trunc from 0x1f9bce to 0x1e7f79 (0x11c54 bytes) 1724773382.844666 truncate done 000529[0] 1724773382.864077 read 0x178423 thru 0x17aeb4 (0x2a92 bytes) 1724773382.879829 read done 000531[1] 1724773382.888872 read 0x1acd5b thru 0x1b7c7f (0xaf25 bytes) 1724773382.901855 read done 000532[0] 1724773382.906586 trunc from 0x1e7f7a to 0x139dcf (0xae1aa bytes) 1724773382.919789 truncate done 000533[1] 1724773382.921851 mapwrite 0x1ddad3 thru 0x1e12d8 (0x3806 bytes) 1724773382.936501 truncate done 1724773382.936730 mmap done 1724773382.972178 msync done 1724773382.972267 munmap done 000534[0] 1724773382.974477 mapwrite 0x1ad317 thru 0x1ae6b4 (0x139e bytes) 1724773382.977581 mmap done 1724773383.007371 msync done 1724773383.007546 munmap done 000536[0] 1724773383.023329 mapread 0x1c7b8f thru 0x1cbb6e (0x3fe0 bytes) 1724773383.026446 mmap done 1724773383.034787 memcpy done 1724773383.034861 munmap done 000537[0] 1724773383.040255 trunc from 0x1e12d9 to 0x10ebfb (0xd26dd bytes) 1724773383.048215 truncate done 000538[0] 1724773383.055553 trunc from 0x10ebfc to 0x0beeb7 (0x4fd44 bytes) 1724773383.060151 truncate done 000542[1] 1724773383.068268 trunc from 0x0beeb8 to 0x105b6e (0x46cb7 bytes) 1724773383.079983 truncate done 000544[1] 1724773383.087941 write 0x1a4c85 thru 0x1b08d6 (0xbc52 bytes) 1724773383.088681 write done 000546[0] 1724773383.089354 read 0x0c1827 thru 0x0c6223 (0x49fd bytes) 1724773383.115727 read done 000548[0] 1724773383.124337 write 0x1b27ee thru 0x1b6bb7 (0x43ca bytes) 1724773383.131401 write done 000550[0] 1724773383.139020 read 0x19f0dc thru 0x1a2a71 (0x3996 bytes) 1724773383.149395 read done 000551[1] 1724773383.149717 mapread 0x0a261c thru 0x0a91f2 (0x6bd7 bytes) 1724773383.153717 mmap done 1724773383.168979 memcpy done 1724773383.169071 munmap done 000552[1] 1724773383.173722 read 0x049d14 thru 0x0542fd (0xa5ea bytes) 1724773383.182769 read done 000556[0] 1724773383.200212 trunc from 0x1b6bb8 to 0x05ae73 (0x15bd44 bytes) 1724773383.214165 truncate done 000558[1] 1724773383.222251 mapread 0x0526e1 thru 0x05ae73 (0x8793 bytes) 1724773383.225529 mmap done 1724773383.241765 memcpy done 1724773383.241988 munmap done 000559[1] 1724773383.246938 mapread 0x039013 thru 0x03b9ae (0x299c bytes) 1724773383.249555 mmap done 1724773383.253670 memcpy done 1724773383.253724 munmap done truncating to largest ever: 0x1fe62d 000560[1] 1724773383.255056 trunc from 0x05ae74 to 0x1fe62c (0x1a37b9 bytes) 1724773383.264950 truncate done 000562[1] 1724773383.273105 mapwrite 0x15c481 thru 0x1609cf (0x454f bytes) 1724773383.273366 mmap done 1724773383.321213 msync done 1724773383.321306 munmap done 000565[0] 1724773383.331781 write 0x1852fa thru 0x18b155 (0x5e5c bytes) 1724773383.340156 write done 000568[0] 1724773383.351200 mapwrite 0x0c9c84 thru 0x0d3c05 (0x9f82 bytes) 1724773383.353214 mmap done 1724773383.390311 msync done 1724773383.390431 munmap done 000570[1] 1724773383.390973 mapwrite 0x064167 thru 0x07229f (0xe139 bytes) 1724773383.394675 mmap done 1724773383.442792 msync done 1724773383.442889 munmap done 000572[0] 1724773383.458769 mapwrite 0x1da339 thru 0x1e294a (0x8612 bytes) 1724773383.461939 mmap done 1724773383.485850 msync done 1724773383.485941 munmap done 000575[1] 1724773383.503757 mapread 0x123fe5 thru 0x12750f (0x352b bytes) 1724773383.506954 mmap done 1724773383.520754 memcpy done 1724773383.520859 munmap done 000576[1] 1724773383.528593 write 0x050b0a thru 0x05ccba (0xc1b1 bytes) 1724773383.532667 write done 000577[1] 1724773383.533043 read 0x1dd13e thru 0x1e0ad2 (0x3995 bytes) 1724773383.547640 read done 000578[1] 1724773383.547987 write 0x031dc3 thru 0x037fc7 (0x6205 bytes) 1724773383.548285 write done 000581[0] 1724773383.565649 write 0x072991 thru 0x07f959 (0xcfc9 bytes) 1724773383.576853 write done 000584[0] 1724773383.589523 write 0x174710 thru 0x179200 (0x4af1 bytes) 1724773383.596051 write done 000586[1] 1724773383.596539 write 0x0b11cb thru 0x0b853c (0x7372 bytes) 1724773383.604668 write done 000587[1] 1724773383.609162 read 0x18980a thru 0x18c6fd (0x2ef4 bytes) 1724773383.630527 read done 000589[0] 1724773383.631142 mapwrite 0x117d47 thru 0x11e2aa (0x6564 bytes) 1724773383.634180 mmap done 1724773383.673314 msync done 1724773383.673389 munmap done 000590[0] 1724773383.679730 read 0x1d5171 thru 0x1d7d90 (0x2c20 bytes) 1724773383.683902 read done 000597[1] 1724773383.716144 mapwrite 0x09ba08 thru 0x09efea (0x35e3 bytes) 1724773383.717969 mmap done 1724773383.732662 msync done 1724773383.732782 munmap done 000598[1] 1724773383.738041 mapwrite 0x0b207a thru 0x0b20e1 (0x68 bytes) 1724773383.740837 mmap done 1724773383.752385 msync done 1724773383.752444 munmap done 000600[1] 1724773383.763353 write 0x0e8b76 thru 0x0f08bd (0x7d48 bytes) 1724773383.763845 write done 000601[0] 1724773383.770991 read 0x1dc156 thru 0x1e1e88 (0x5d33 bytes) 1724773383.784806 read done 000602[0] 1724773383.791411 trunc from 0x1fe62d to 0x083880 (0x17adac bytes) 1724773383.808326 truncate done 000603[0] 1724773383.810119 mapwrite 0x0f6d30 thru 0x0fc017 (0x52e8 bytes) 1724773383.813156 truncate done 1724773383.813333 mmap done 1724773383.839383 msync done 1724773383.839433 munmap done 000604[1] 1724773383.841619 write 0x06ab88 thru 0x0792eb (0xe764 bytes) 1724773383.848744 write done 000605[1] 1724773383.855717 mapwrite 0x046164 thru 0x052741 (0xc5de bytes) 1724773383.858326 mmap done 1724773383.891670 msync done 1724773383.891759 munmap done 000608[1] 1724773383.907420 trunc from 0x0fc018 to 0x1219e6 (0x259cf bytes) 1724773383.915473 truncate done 000612[1] 1724773383.924322 read 0x081ea8 thru 0x087c5e (0x5db7 bytes) 1724773383.934775 read done 000613[0] 1724773383.935063 trunc from 0x1219e7 to 0x15bbda (0x3a1f4 bytes) 1724773383.948098 truncate done 000616[1] 1724773383.958156 write 0x0d9904 thru 0x0e0301 (0x69fe bytes) 1724773383.965338 write done 000617[0] 1724773383.970896 trunc from 0x15bbdb to 0x1cd374 (0x7179a bytes) 1724773383.982757 truncate done 000619[1] 1724773383.990329 write 0x0515f3 thru 0x05df28 (0xc936 bytes) 1724773383.996648 write done 000620[1] 1724773384.002452 trunc from 0x1cd375 to 0x0b026f (0x11d105 bytes) 1724773384.011302 truncate done 000622[1] 1724773384.020390 mapwrite 0x058afe thru 0x05c752 (0x3c55 bytes) 1724773384.020641 mmap done 1724773384.037863 msync done 1724773384.038088 munmap done 000624[1] 1724773384.045128 write 0x0843d3 thru 0x087fd3 (0x3c01 bytes) 1724773384.048768 write done 000626[0] 1724773384.054156 mapread 0x02e014 thru 0x034cae (0x6c9b bytes) 1724773384.057117 mmap done 1724773384.070021 memcpy done 1724773384.070093 munmap done 000628[1] 1724773384.075070 mapwrite 0x169f07 thru 0x172c16 (0x8d10 bytes) 1724773384.082214 truncate done 1724773384.082428 mmap done 1724773384.113866 msync done 1724773384.114001 munmap done 000630[1] 1724773384.121788 trunc from 0x172c17 to 0x05da1a (0x1151fc bytes) 1724773384.126830 truncate done 000631[0] 1724773384.128950 mapwrite 0x164313 thru 0x16b1ac (0x6e9a bytes) 1724773384.138308 truncate done 1724773384.138444 mmap done 1724773384.168369 msync done 1724773384.168450 munmap done 000634[1] 1724773384.171129 mapread 0x002462 thru 0x012378 (0xff17 bytes) 1724773384.173740 mmap done 1724773384.197036 memcpy done 1724773384.197176 munmap done 000636[0] 1724773384.205513 write 0x16725a thru 0x173ad6 (0xc87d bytes) 1724773384.206141 write done 000643[1] 1724773384.222833 write 0x19707e thru 0x1a565e (0xe5e1 bytes) 1724773384.231731 write done 000644[1] 1724773384.237301 read 0x0e64b8 thru 0x0f40c6 (0xdc0f bytes) 1724773384.246571 read done 000646[1] 1724773384.251083 write 0x03c703 thru 0x0494e3 (0xcde1 bytes) 1724773384.258887 write done 000647[0] 1724773384.263980 trunc from 0x1a565f to 0x1abbbc (0x655e bytes) 1724773384.280899 truncate done 000650[1] 1724773384.290595 mapread 0x001746 thru 0x00bf3c (0xa7f7 bytes) 1724773384.293041 mmap done 1724773384.315967 memcpy done 1724773384.316035 munmap done 000652[0] 1724773384.318351 write 0x0bbce4 thru 0x0c3894 (0x7bb1 bytes) 1724773384.329894 write done 000653[1] 1724773384.337604 write 0x1221dc thru 0x123fc4 (0x1de9 bytes) 1724773384.346433 write done 000658[1] 1724773384.383908 mapwrite 0x0264d6 thru 0x031357 (0xae82 bytes) 1724773384.388693 mmap done 1724773384.448578 msync done 1724773384.448739 munmap done 000660[1] 1724773384.454261 mapread 0x006939 thru 0x011de4 (0xb4ac bytes) 1724773384.454426 mmap done 1724773384.477261 memcpy done 1724773384.477518 munmap done 000662[1] 1724773384.478087 mapwrite 0x001341 thru 0x009452 (0x8112 bytes) 1724773384.478292 mmap done 1724773384.508291 msync done 1724773384.508356 munmap done 000664[0] 1724773384.515765 mapread 0x0b616c thru 0x0b8675 (0x250a bytes) 1724773384.518881 mmap done 1724773384.528226 memcpy done 1724773384.528359 munmap done 000665[0] 1724773384.531455 write 0x19f51b thru 0x19fb2f (0x615 bytes) 1724773384.539933 write done 000666[0] 1724773384.540286 write 0x1306ee thru 0x13d699 (0xcfac bytes) 1724773384.544689 write done 000668[0] 1724773384.545268 mapread 0x018820 thru 0x01d26b (0x4a4c bytes) 1724773384.545437 mmap done 1724773384.561672 memcpy done 1724773384.561781 munmap done 000670[0] 1724773384.568176 read 0x151f73 thru 0x15ce80 (0xaf0e bytes) 1724773384.578330 read done 000671[0] 1724773384.583533 trunc from 0x1abbbd to 0x166137 (0x45a85 bytes) 1724773384.592820 truncate done 000675[1] 1724773384.610147 mapwrite 0x029209 thru 0x02a1ae (0xfa6 bytes) 1724773384.613566 mmap done 1724773384.648235 msync done 1724773384.648315 munmap done 000676[1] 1724773384.658502 trunc from 0x166138 to 0x05a51f (0x10bc18 bytes) 1724773384.675710 truncate done 000678[0] 1724773384.689653 read 0x016151 thru 0x016c38 (0xae8 bytes) 1724773384.697307 read done 000681[1] 1724773384.700039 write 0x0ef70a thru 0x0f915d (0x9a54 bytes) 1724773384.705184 write done 000682[1] 1724773384.705530 mapwrite 0x1f3fa9 thru 0x1fffff (0xc057 bytes) 1724773384.711615 truncate done 1724773384.711783 mmap done 1724773384.751576 msync done 1724773384.751681 munmap done 000683[1] 1724773384.758987 trunc from 0x200000 to 0x0e7a18 (0x1185e7 bytes) 1724773384.765681 truncate done 000684[1] 1724773384.774986 write 0x120dcd thru 0x12ff2d (0xf161 bytes) 1724773384.775800 write done 000687[1] 1724773384.778766 mapwrite 0x1d31a3 thru 0x1d76b2 (0x4510 bytes) 1724773384.785801 truncate done 1724773384.786042 mmap done 1724773384.826789 msync done 1724773384.826845 munmap done 000691[0] 1724773384.834578 mapread 0x0a7094 thru 0x0b1cd1 (0xac3e bytes) 1724773384.837089 mmap done 1724773384.850399 memcpy done 1724773384.850523 munmap done 000692[0] 1724773384.857965 write 0x1e1f3e thru 0x1f00a8 (0xe16b bytes) 1724773384.862317 write done 000693[0] 1724773384.862639 trunc from 0x1f00a9 to 0x1745d3 (0x7bad5 bytes) 1724773384.872453 truncate done 000694[0] 1724773384.874481 mapread 0x0f877f thru 0x101784 (0x9006 bytes) 1724773384.875205 mmap done 1724773384.883889 memcpy done 1724773384.883973 munmap done 000695[1] 1724773384.884293 write 0x1d7694 thru 0x1db5f5 (0x3f62 bytes) 1724773384.890534 write done 000704[1] 1724773384.945840 mapread 0x000359 thru 0x0018dd (0x1585 bytes) 1724773384.947681 mmap done 1724773384.952276 memcpy done 1724773384.952402 munmap done 000708[0] 1724773384.964807 mapwrite 0x10983f thru 0x109eb4 (0x676 bytes) 1724773384.966624 mmap done 1724773384.997422 msync done 1724773384.997616 munmap done 000709[1] 1724773384.997976 mapwrite 0x193499 thru 0x19a7d1 (0x7339 bytes) 1724773385.001817 mmap done 1724773385.041730 msync done 1724773385.041831 munmap done 000712[1] 1724773385.058169 mapread 0x07beac thru 0x0832bb (0x7410 bytes) 1724773385.058387 mmap done 1724773385.073666 memcpy done 1724773385.073778 munmap done 000713[1] 1724773385.077808 mapwrite 0x03b168 thru 0x04578d (0xa626 bytes) 1724773385.078110 mmap done 1724773385.107584 msync done 1724773385.107671 munmap done 000714[1] 1724773385.111665 write 0x1ed162 thru 0x1f3b6c (0x6a0b bytes) 1724773385.112293 write done 000715[0] 1724773385.116683 read 0x1c4e3e thru 0x1c7925 (0x2ae8 bytes) 1724773385.130551 read done 000716[1] 1724773385.132266 trunc from 0x1f3b6d to 0x1995ef (0x5a57d bytes) 1724773385.140590 truncate done 000718[0] 1724773385.147610 mapread 0x0f93f1 thru 0x10424d (0xae5d bytes) 1724773385.150160 mmap done 1724773385.198249 memcpy done 1724773385.198347 munmap done 000719[0] 1724773385.200191 trunc from 0x1995f0 to 0x0746a4 (0x124f4b bytes) 1724773385.211431 truncate done 000721[0] 1724773385.217976 mapread 0x06f35d thru 0x0746a4 (0x5348 bytes) 1724773385.218206 mmap done 1724773385.226630 memcpy done 1724773385.226693 munmap done 000722[0] 1724773385.231484 mapread 0x016954 thru 0x01c2f6 (0x59a3 bytes) 1724773385.231688 mmap done 1724773385.241606 memcpy done 1724773385.241650 munmap done 000724[1] 1724773385.252587 mapwrite 0x1479f6 thru 0x14f6bb (0x7cc6 bytes) 1724773385.263080 truncate done 1724773385.263267 mmap done 1724773385.309463 msync done 1724773385.309521 munmap done 000728[1] 1724773385.330403 write 0x0e7e5d thru 0x0f0f64 (0x9108 bytes) 1724773385.334894 write done 000732[0] 1724773385.342213 write 0x144d5a thru 0x153a3d (0xece4 bytes) 1724773385.348299 write done 000733[1] 1724773385.354123 mapread 0x0dea76 thru 0x0e4906 (0x5e91 bytes) 1724773385.357348 mmap done 1724773385.370052 memcpy done 1724773385.370146 munmap done 000737[0] 1724773385.396378 write 0x03bf4f thru 0x047635 (0xb6e7 bytes) 1724773385.409815 write done 000738[1] 1724773385.417997 mapread 0x0376a2 thru 0x03d487 (0x5de6 bytes) 1724773385.421616 mmap done 1724773385.442359 memcpy done 1724773385.442546 munmap done 000739[1] 1724773385.444554 mapwrite 0x193fbe thru 0x1a3772 (0xf7b5 bytes) 1724773385.458446 truncate done 1724773385.458624 mmap done 1724773385.512843 msync done 1724773385.512935 munmap done 000744[0] 1724773385.522626 read 0x0eef12 thru 0x0f71ea (0x82d9 bytes) 1724773385.548259 read done 000746[1] 1724773385.549808 write 0x194994 thru 0x19c4b5 (0x7b22 bytes) 1724773385.550315 write done 000748[1] 1724773385.555243 mapread 0x081685 thru 0x090409 (0xed85 bytes) 1724773385.555425 mmap done 1724773385.586703 memcpy done 1724773385.586826 munmap done 000750[1] 1724773385.592683 trunc from 0x1a3773 to 0x0b5790 (0xedfe2 bytes) 1724773385.604149 truncate done 000751[1] 1724773385.612540 trunc from 0x0b5791 to 0x0c8bcd (0x1343d bytes) 1724773385.619865 truncate done 000752[0] 1724773385.622351 read 0x05bc75 thru 0x064791 (0x8b1d bytes) 1724773385.635250 read done 000754[0] 1724773385.646519 trunc from 0x0c8bce to 0x11bc81 (0x530b4 bytes) 1724773385.657035 truncate done 000756[1] 1724773385.666539 mapwrite 0x030ad0 thru 0x036503 (0x5a34 bytes) 1724773385.669291 mmap done 1724773385.705033 msync done 1724773385.705175 munmap done 000758[0] 1724773385.716776 mapread 0x06a807 thru 0x078d71 (0xe56b bytes) 1724773385.719498 mmap done 1724773385.741903 memcpy done 1724773385.742054 munmap done 000760[0] 1724773385.747454 mapwrite 0x0dbe08 thru 0x0e3ee3 (0x80dc bytes) 1724773385.747708 mmap done 1724773385.796731 msync done 1724773385.796954 munmap done 000767[1] 1724773385.813103 write 0x1c616e thru 0x1ca380 (0x4213 bytes) 1724773385.816443 write done 000768[0] 1724773385.819952 read 0x192778 thru 0x19bc31 (0x94ba bytes) 1724773385.837329 read done 000769[1] 1724773385.837681 mapread 0x147a41 thru 0x14e455 (0x6a15 bytes) 1724773385.839898 mmap done 1724773385.849814 memcpy done 1724773385.849977 munmap done 000770[1] 1724773385.850349 mapread 0x17885e thru 0x17c010 (0x37b3 bytes) 1724773385.853025 mmap done 1724773385.860951 memcpy done 1724773385.861016 munmap done 000773[1] 1724773385.866901 trunc from 0x1ca381 to 0x1b5aec (0x14894 bytes) 1724773385.878631 truncate done 000774[1] 1724773385.880234 read 0x15cb5e thru 0x15e438 (0x18db bytes) 1724773385.892685 read done 000775[0] 1724773385.899033 write 0x1d6b6e thru 0x1d9cf9 (0x318c bytes) 1724773385.902506 write done 000778[0] 1724773385.916875 mapwrite 0x0af9a6 thru 0x0b8a5d (0x90b8 bytes) 1724773385.919180 mmap done 1724773385.953703 msync done 1724773385.953765 munmap done 000779[0] 1724773385.959212 mapread 0x12ff31 thru 0x13f52d (0xf5fd bytes) 1724773385.959436 mmap done 1724773385.982029 memcpy done 1724773385.982087 munmap done 000780[0] 1724773385.982313 mapread 0x081817 thru 0x08d71a (0xbf04 bytes) 1724773385.982448 mmap done 1724773386.000133 memcpy done 1724773386.000198 munmap done 000781[1] 1724773386.005483 mapwrite 0x1065d7 thru 0x111fe1 (0xba0b bytes) 1724773386.007980 mmap done 1724773386.055975 msync done 1724773386.056045 munmap done 000782[1] 1724773386.060189 mapwrite 0x179329 thru 0x187aad (0xe785 bytes) 1724773386.061936 mmap done 1724773386.091931 msync done 1724773386.092003 munmap done 000785[0] 1724773386.106971 mapwrite 0x14d184 thru 0x1544d4 (0x7351 bytes) 1724773386.109195 mmap done 1724773386.142458 msync done 1724773386.142559 munmap done 000789[0] 1724773386.163206 mapread 0x0b7400 thru 0x0c0fec (0x9bed bytes) 1724773386.163510 mmap done 1724773386.177984 memcpy done 1724773386.178108 munmap done 000792[0] 1724773386.178965 write 0x03128c thru 0x03fbcc (0xe941 bytes) 1724773386.183872 write done 000794[0] 1724773386.196804 mapwrite 0x11df7b thru 0x123236 (0x52bc bytes) 1724773386.197069 mmap done 1724773386.232300 msync done 1724773386.232360 munmap done 000795[1] 1724773386.239391 trunc from 0x1d9cfa to 0x147af6 (0x92203 bytes) 1724773386.252649 truncate done 000798[1] 1724773386.266732 read 0x122514 thru 0x128b3e (0x662b bytes) 1724773386.275910 read done 000801[1] 1724773386.293984 read 0x01e4bb thru 0x0208fd (0x2443 bytes) 1724773386.294103 read done 000803[0] 1724773386.294654 read 0x02cd7b thru 0x03684c (0x9ad2 bytes) 1724773386.313028 read done 000805[1] 1724773386.323094 mapread 0x02c812 thru 0x039a10 (0xd1ff bytes) 1724773386.323309 mmap done 1724773386.334796 memcpy done 1724773386.334898 munmap done 000806[1] 1724773386.341726 read 0x09c1c1 thru 0x0a0c3c (0x4a7c bytes) 1724773386.341852 read done 000809[0] 1724773386.342590 write 0x1eccf1 thru 0x1fcadd (0xfded bytes) 1724773386.348160 write done 000812[0] 1724773386.357243 mapread 0x06dc42 thru 0x07ab56 (0xcf15 bytes) 1724773386.357396 mmap done 1724773386.357483 memcpy done 1724773386.357524 munmap done 000814[1] 1724773386.362158 mapwrite 0x0cfccf thru 0x0d9171 (0x94a3 bytes) 1724773386.364235 mmap done 1724773386.410601 msync done 1724773386.410672 munmap done 000816[1] 1724773386.422474 trunc from 0x1fcade to 0x0d235f (0x12a77e bytes) 1724773386.433696 truncate done 000817[0] 1724773386.435578 mapread 0x0a56c6 thru 0x0b1c76 (0xc5b1 bytes) 1724773386.438696 mmap done 1724773386.462299 memcpy done 1724773386.462385 munmap done 000820[1] 1724773386.474896 mapread 0x0b22eb thru 0x0ba0be (0x7dd4 bytes) 1724773386.475115 mmap done 1724773386.488693 memcpy done 1724773386.488787 munmap done 000822[1] 1724773386.500273 mapwrite 0x0a4c44 thru 0x0ac798 (0x7b55 bytes) 1724773386.500559 mmap done 1724773386.532806 msync done 1724773386.532942 munmap done 000823[1] 1724773386.533333 mapread 0x02678b thru 0x02975d (0x2fd3 bytes) 1724773386.533523 mmap done 1724773386.540442 memcpy done 1724773386.540529 munmap done 000824[1] 1724773386.540829 write 0x1cb183 thru 0x1d331f (0x819d bytes) 1724773386.541506 write done 000826[1] 1724773386.541905 trunc from 0x1d3320 to 0x081f55 (0x1513ca bytes) 1724773386.547891 truncate done 000827[1] 1724773386.549866 write 0x07ee06 thru 0x08d8c6 (0xeac1 bytes) 1724773386.553900 write done 000828[1] 1724773386.563172 mapread 0x04056d thru 0x048106 (0x7b9a bytes) 1724773386.563398 mmap done 1724773386.585483 memcpy done 1724773386.585699 munmap done 000830[1] 1724773386.600988 write 0x0b7c77 thru 0x0bfd37 (0x80c1 bytes) 1724773386.601541 write done 000831[0] 1724773386.606509 mapread 0x039163 thru 0x0459e6 (0xc884 bytes) 1724773386.608940 mmap done 1724773386.629657 memcpy done 1724773386.629754 munmap done 000833[1] 1724773386.637886 mapread 0x07fc7a thru 0x0847a8 (0x4b2f bytes) 1724773386.638947 mmap done 1724773386.647561 memcpy done 1724773386.647613 munmap done 000835[1] 1724773386.653655 mapwrite 0x12a150 thru 0x132d28 (0x8bd9 bytes) 1724773386.661804 truncate done 1724773386.662047 mmap done 1724773386.703412 msync done 1724773386.703520 munmap done 000836[0] 1724773386.705684 read 0x01e49b thru 0x024ece (0x6a34 bytes) 1724773386.721744 read done 000838[0] 1724773386.735852 mapwrite 0x16b49b thru 0x16ea3d (0x35a3 bytes) 1724773386.749932 truncate done 1724773386.750103 mmap done 1724773386.771938 msync done 1724773386.771997 munmap done 000840[1] 1724773386.784187 write 0x117c37 thru 0x11f775 (0x7b3f bytes) 1724773386.793728 write done 000844[0] 1724773386.818825 write 0x0fb0dc thru 0x0fe2a8 (0x31cd bytes) 1724773386.819199 write done 000846[0] 1724773386.832106 mapwrite 0x187dcb thru 0x1953ac (0xd5e2 bytes) 1724773386.847300 truncate done 1724773386.847660 mmap done 1724773386.873614 msync done 1724773386.873685 munmap done 000847[1] 1724773386.875873 read 0x151e93 thru 0x158ae7 (0x6c55 bytes) 1724773386.893396 read done 000848[1] 1724773386.901559 mapwrite 0x16ff0e thru 0x17125d (0x1350 bytes) 1724773386.905195 mmap done 1724773386.925215 msync done 1724773386.925295 munmap done 000852[0] 1724773386.944904 mapread 0x18a760 thru 0x1953ac (0xac4d bytes) 1724773386.947614 mmap done 1724773386.974837 memcpy done 1724773386.975034 munmap done 000857[0] 1724773386.983158 read 0x1498f5 thru 0x154099 (0xa7a5 bytes) 1724773386.992098 read done 000858[1] 1724773386.993134 write 0x11f05a thru 0x12558e (0x6535 bytes) 1724773387.000996 write done 000860[1] 1724773387.011073 read 0x157130 thru 0x15c50a (0x53db bytes) 1724773387.019715 read done 000861[1] 1724773387.025401 mapwrite 0x181a79 thru 0x18e19f (0xc727 bytes) 1724773387.028133 mmap done 1724773387.073101 msync done 1724773387.073258 munmap done 000862[1] 1724773387.080576 mapwrite 0x15825c thru 0x15b03a (0x2ddf bytes) 1724773387.083741 mmap done 1724773387.105079 msync done 1724773387.105226 munmap done 000868[1] 1724773387.149594 read 0x134bf4 thru 0x1378ad (0x2cba bytes) 1724773387.157764 read done 000869[0] 1724773387.166049 mapwrite 0x0c990e thru 0x0d97e7 (0xfeda bytes) 1724773387.169932 mmap done 1724773387.191491 msync done 1724773387.191707 munmap done 000873[0] 1724773387.219392 mapwrite 0x0e3085 thru 0x0e5818 (0x2794 bytes) 1724773387.222889 mmap done 1724773387.239068 msync done 1724773387.239181 munmap done 000875[1] 1724773387.249719 mapread 0x02786a thru 0x030d0a (0x94a1 bytes) 1724773387.251864 mmap done 1724773387.267345 memcpy done 1724773387.267676 munmap done 000876[1] 1724773387.273371 trunc from 0x1953ad to 0x02d3d5 (0x167fd7 bytes) 1724773387.282823 truncate done 000878[1] 1724773387.294580 write 0x1d4010 thru 0x1da195 (0x6186 bytes) 1724773387.295531 write done 000879[0] 1724773387.297377 read 0x0fa122 thru 0x0fd3fd (0x32dc bytes) 1724773387.317973 read done 000880[0] 1724773387.324482 mapwrite 0x1316f3 thru 0x134145 (0x2a53 bytes) 1724773387.327569 mmap done 1724773387.361381 msync done 1724773387.361438 munmap done 000882[1] 1724773387.362027 mapread 0x0f1a5d thru 0x0f7778 (0x5d1c bytes) 1724773387.364362 mmap done 1724773387.388487 memcpy done 1724773387.388535 munmap done 000883[0] 1724773387.392647 mapwrite 0x1495cd thru 0x1535af (0x9fe3 bytes) 1724773387.392898 mmap done 1724773387.411802 msync done 1724773387.411945 munmap done 000884[1] 1724773387.417134 mapread 0x0ba5f6 thru 0x0c76bb (0xd0c6 bytes) 1724773387.419550 mmap done 1724773387.490353 memcpy done 1724773387.490486 munmap done 000886[0] 1724773387.502407 mapread 0x186339 thru 0x18ea26 (0x86ee bytes) 1724773387.502586 mmap done 1724773387.502668 memcpy done 1724773387.502728 munmap done 000887[1] 1724773387.508091 write 0x1842e2 thru 0x191b08 (0xd827 bytes) 1724773387.518908 write done 000889[1] 1724773387.531219 trunc from 0x1da196 to 0x033842 (0x1a6953 bytes) 1724773387.541770 truncate done 000892[1] 1724773387.544703 mapwrite 0x0055da thru 0x00c1d3 (0x6bfa bytes) 1724773387.544945 mmap done 1724773387.586826 msync done 1724773387.586975 munmap done 000893[0] 1724773387.596799 read 0x0319e7 thru 0x033842 (0x1e5c bytes) 1724773387.603664 read done 000894[0] 1724773387.608891 trunc from 0x033843 to 0x0ad1f0 (0x799ae bytes) 1724773387.617638 truncate done 000895[0] 1724773387.620058 read 0x05e395 thru 0x064c7f (0x68eb bytes) 1724773387.628291 read done 000896[0] 1724773387.635960 trunc from 0x0ad1f1 to 0x072b69 (0x3a687 bytes) 1724773387.642200 truncate done 000897[1] 1724773387.643830 trunc from 0x072b6a to 0x0e0e5b (0x6e2f2 bytes) 1724773387.654245 truncate done 000909[0] 1724773387.697660 mapread 0x060fea thru 0x06ff21 (0xef38 bytes) 1724773387.700656 mmap done 1724773387.737373 memcpy done 1724773387.737469 munmap done 000911[1] 1724773387.747637 mapread 0x09729b thru 0x0a3580 (0xc2e6 bytes) 1724773387.749124 mmap done 1724773387.767874 memcpy done 1724773387.767977 munmap done 000912[0] 1724773387.774099 read 0x043cd3 thru 0x046bea (0x2f18 bytes) 1724773387.782722 read done 000913[0] 1724773387.783107 mapwrite 0x125fb9 thru 0x130f60 (0xafa8 bytes) 1724773387.799939 truncate done 1724773387.800103 mmap done 1724773387.840891 msync done 1724773387.841037 munmap done 000916[0] 1724773387.851781 trunc from 0x130f61 to 0x14e927 (0x1d9c7 bytes) 1724773387.857097 truncate done 000919[1] 1724773387.875493 write 0x005354 thru 0x006870 (0x151d bytes) 1724773387.883300 write done 000920[1] 1724773387.889659 mapwrite 0x09a042 thru 0x0a2a01 (0x89c0 bytes) 1724773387.893354 mmap done 1724773387.942413 msync done 1724773387.942525 munmap done 000921[0] 1724773387.950023 mapread 0x045d47 thru 0x04e99e (0x8c58 bytes) 1724773387.953246 mmap done 1724773387.976805 memcpy done 1724773387.977209 munmap done 000922[1] 1724773387.977528 mapwrite 0x09c4a0 thru 0x0a450a (0x806b bytes) 1724773387.981007 mmap done 1724773388.024349 msync done 1724773388.024423 munmap done 000924[1] 1724773388.042278 write 0x0b5c44 thru 0x0c3a02 (0xddbf bytes) 1724773388.048601 write done 000926[1] 1724773388.067444 mapread 0x104261 thru 0x110e84 (0xcc24 bytes) 1724773388.070766 mmap done 1724773388.104732 memcpy done 1724773388.104795 munmap done 000933[0] 1724773388.128320 mapwrite 0x0398ae thru 0x04750d (0xdc60 bytes) 1724773388.133065 mmap done 1724773388.202166 msync done 1724773388.202349 munmap done 000938[0] 1724773388.226131 write 0x0a3348 thru 0x0aa1c7 (0x6e80 bytes) 1724773388.230888 write done 000940[1] 1724773388.236650 trunc from 0x14e928 to 0x013aea (0x13ae3d bytes) 1724773388.257822 truncate done 000941[0] 1724773388.265491 mapread 0x010192 thru 0x013aea (0x3959 bytes) 1724773388.269062 mmap done 1724773388.280751 memcpy done 1724773388.280977 munmap done 000942[1] 1724773388.286036 mapread 0x00306d thru 0x00cace (0x9a62 bytes) 1724773388.287950 mmap done 1724773388.304788 memcpy done 1724773388.304856 munmap done 000944[0] 1724773388.318339 mapwrite 0x1efcd6 thru 0x1f4ae5 (0x4e10 bytes) 1724773388.332444 truncate done 1724773388.332830 mmap done 1724773388.386587 msync done 1724773388.386755 munmap done 000949[0] 1724773388.416226 trunc from 0x1f4ae6 to 0x075caa (0x17ee3b bytes) 1724773388.421880 truncate done 000950[0] 1724773388.423524 write 0x1ce1d1 thru 0x1d012c (0x1f5c bytes) 1724773388.424121 write done 000951[1] 1724773388.424405 mapwrite 0x1d24de thru 0x1de811 (0xc334 bytes) 1724773388.444893 truncate done 1724773388.445097 mmap done 1724773388.521385 msync done 1724773388.521669 munmap done 000952[1] 1724773388.535399 mapread 0x166982 thru 0x168e12 (0x2491 bytes) 1724773388.535873 mmap done 1724773388.547307 memcpy done 1724773388.547503 munmap done 000955[1] 1724773388.558702 mapread 0x0584eb thru 0x061aa1 (0x95b7 bytes) 1724773388.559154 mmap done 1724773388.584446 memcpy done 1724773388.584701 munmap done 000958[0] 1724773388.600811 mapwrite 0x0cd325 thru 0x0d44ac (0x7188 bytes) 1724773388.605122 mmap done 1724773388.712390 msync done 1724773388.712579 munmap done 000961[1] 1724773388.744823 read 0x029592 thru 0x02e79c (0x520b bytes) 1724773388.766151 read done 000962[0] 1724773388.775284 write 0x0134fc thru 0x0203fb (0xcf00 bytes) 1724773388.784864 write done 000963[1] 1724773388.789569 mapwrite 0x084448 thru 0x09368d (0xf246 bytes) 1724773388.792321 mmap done 1724773388.860074 msync done 1724773388.860147 munmap done 000964[1] 1724773388.867398 trunc from 0x1de812 to 0x0641b3 (0x17a65e bytes) 1724773388.876366 truncate done 000965[1] 1724773388.878705 write 0x00aa1c thru 0x00e268 (0x384d bytes) 1724773388.881689 write done 000966[0] 1724773388.881893 mapwrite 0x0674cc thru 0x071faa (0xaadf bytes) 1724773388.896381 truncate done 1724773388.896564 mmap done 1724773388.947396 msync done 1724773388.947476 munmap done 000967[1] 1724773388.962283 read 0x05cc27 thru 0x067fee (0xb3c8 bytes) 1724773388.974219 read done 000969[1] 1724773388.983295 mapwrite 0x02e5e4 thru 0x036ebb (0x88d8 bytes) 1724773388.986311 mmap done 1724773389.040060 msync done 1724773389.040124 munmap done 000970[0] 1724773389.047220 read 0x01719e thru 0x01c2be (0x5121 bytes) 1724773389.058567 read done 000971[0] 1724773389.058853 trunc from 0x071fab to 0x1eb6d5 (0x17972b bytes) 1724773389.067313 truncate done 000973[0] 1724773389.070456 mapread 0x18ef6a thru 0x19ab1c (0xbbb3 bytes) 1724773389.070639 mmap done 1724773389.083996 memcpy done 1724773389.084120 munmap done 000975[1] 1724773389.084688 read 0x059e1c thru 0x0623c1 (0x85a6 bytes) 1724773389.094687 read done 000976[1] 1724773389.096390 trunc from 0x1eb6d6 to 0x07713a (0x17459b bytes) 1724773389.108476 truncate done 000977[1] 1724773389.110138 read 0x0426c1 thru 0x04322b (0xb6b bytes) 1724773389.115893 read done 000982[1] 1724773389.129841 read 0x006644 thru 0x00acda (0x4697 bytes) 1724773389.129991 read done 000983[0] 1724773389.130271 write 0x1ab4a1 thru 0x1b5bc6 (0xa726 bytes) 1724773389.134814 write done 000985[1] 1724773389.146871 read 0x12a4a1 thru 0x13311f (0x8c7f bytes) 1724773389.168827 read done 000987[0] 1724773389.180855 mapread 0x174bf6 thru 0x178e6e (0x4279 bytes) 1724773389.183786 mmap done 1724773389.193654 memcpy done 1724773389.193755 munmap done 000990[0] 1724773389.211863 trunc from 0x1b5bc7 to 0x0592c2 (0x15c904 bytes) 1724773389.225104 truncate done 000993[0] 1724773389.234099 mapread 0x04a071 thru 0x057691 (0xd621 bytes) 1724773389.234312 mmap done 1724773389.259012 memcpy done 1724773389.259117 munmap done 000996[1] 1724773389.281848 write 0x169a1d thru 0x175a5a (0xc03e bytes) 1724773389.287142 write done 000998[1] 1724773389.302647 mapread 0x06c3f4 thru 0x06e0da (0x1ce7 bytes) 1724773389.308023 mmap done 1724773389.319230 memcpy done 1724773389.319386 munmap done 000999[1] 1724773389.319681 write 0x0a90ed thru 0x0b5e0f (0xcd23 bytes) 1724773389.325345 write done All operations completed A-OK! PASS fsx (17s) == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 11:43:10 (1724773390) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 excepting tests: 42a 42c 42b 118c 118d 407 56x 56xa 56xb 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 11:43:16 (1724773396) === Stopping clients: oleg409-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg409-client.virtnet /mnt/lustre2 opts: oleg409-client.virtnet: executing check_config_client /mnt/lustre oleg409-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg409-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012db76800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012db76800.idle_timeout=debug disable quota as required oleg409-server: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 11:43:23 (1724773403) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f14153] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 11:43:24 (1724773404) utime: good mknod times 1724773403 <= 1724773404 <= 1724773404 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (2s) == sanity test 36b: OST utime check (open, utime) ======== 11:43:26 (1724773406) utime: good utime mtimes 100000, atime 200000 PASS 36b (1s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 11:43:27 (1724773407) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1724773407 <= 1724773408 <= 1724773408 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (2s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 11:43:29 (1724773409) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (2s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 11:43:31 (1724773411) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (2s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 11:43:33 (1724773413) fail_loc=0x80000214 Tue Aug 27 11:43:33 EDT 2024 1724773413 Tue Aug 27 11:43:34 EDT 2024 1724773414 PASS 36f (2s) == sanity test 36g: FMD cache expiry =============================================================================== 11:43:35 (1724773415) FMD max age: 30s FMD before: 7 FMD after: 0 PASS 36g (45s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 11:44:20 (1724773460) fail_loc=0x80000227 Tue Aug 27 11:44:21 EDT 2024 1724773461 Tue Aug 27 11:44:22 EDT 2024 1724773462 PASS 36h (3s) == sanity test 36i: change mtime on striped directory ==== 11:44:23 (1724773463) SKIP: sanity test_36i needs >= 2 MDTs SKIP 36i (1s) == sanity test 39a: mtime changed on create ============== 11:44:24 (1724773464) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (4s) == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 11:44:28 (1724773468) repeat after cancel_lru_locks PASS 39b (3s) == sanity test 39c: mtime change on rename ===================================================================================== 11:44:31 (1724773471) repeat after cancel_lru_locks PASS 39c (4s) == sanity test 39d: create, utime, stat ======================================================================================== 11:44:35 (1724773475) repeat after cancel_lru_locks PASS 39d (1s) == sanity test 39e: create, stat, utime, stat ================================================================================== 11:44:36 (1724773476) repeat after cancel_lru_locks PASS 39e (2s) == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 11:44:38 (1724773478) repeat after cancel_lru_locks PASS 39f (4s) == sanity test 39g: write, chmod, stat ========================================================================================= 11:44:42 (1724773482) repeat after cancel_lru_locks PASS 39g (4s) == sanity test 39h: write, utime within one second, stat ======================================================================= 11:44:46 (1724773486) repeat after cancel_lru_locks PASS 39h (2s) == sanity test 39i: write, rename, stat ======================================================================================== 11:44:49 (1724773489) repeat after cancel_lru_locks PASS 39i (2s) == sanity test 39j: write, rename, close, stat ================================================================================= 11:44:51 (1724773491) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14153 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (6s) == sanity test 39k: write, utime, close, stat ================================================================================== 11:44:57 (1724773497) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14153 repeat after cancel_lru_locks PASS 39k (4s) == sanity test 39l: directory atime update ===================================================================================== 11:45:01 (1724773501) PASS 39l (9s) == sanity test 39m: test atime and mtime before 1970 ===== 11:45:10 (1724773510) repeat after cancel_lru_locks PASS 39m (3s) == sanity test 39n: check that O_NOATIME is honored ====== 11:45:14 (1724773514) 1+0 records in 1+0 records out PASS 39n (13s) == sanity test 39o: directory cached attributes updated after create ========================================================== 11:45:26 (1724773526) a b PASS 39o (2s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 11:45:28 (1724773528) SKIP: sanity test_39p needs >= 2 MDTs SKIP 39p (1s) == sanity test 39r: lazy atime update on OST ============= 11:45:29 (1724773529) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) == sanity test 39q: close won't zero out atime =========== 11:45:30 (1724773530) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.14153 PASS 39q (1s) == sanity test 39s: relatime is supported ================ 11:45:31 (1724773531) 192.168.204.109@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg409-client.virtnet /mnt/lustre (opts:) Starting client: oleg409-client.virtnet: -o relatime 192.168.204.109@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg409-client.virtnet /mnt/lustre (opts:) Starting client: oleg409-client.virtnet: -o user_xattr,flock 192.168.204.109@tcp:/lustre /mnt/lustre PASS 39s (8s) == sanity test 39u: stat race ============================ 11:45:39 (1724773539) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339381 s, 30.9 MB/s fail_loc=0x80001434 PASS 39u (15s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 11:45:54 (1724773554) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00540981 s, 757 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (2s) == sanity test 41: test small file write + fstat =============================================================================== 11:45:56 (1724773556) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (3s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 11:45:59 (1724773559) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.0263017 s, 3.9 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6784 2200320 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7530496 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (2s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 11:46:01 (1724773561) total: 1000 open/close in 3.33 seconds: 300.66 ops/second total: 934 open/close in 4.24 seconds: 220.05 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 13.4071 s, 36.5 MB/s osc.lustre-OST0000-osc-ffff8800b583c800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800b583c800.cur_grant_bytes=490340352 osc.lustre-OST0000-osc-ffff8800b583c800.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff8800b583c800.cur_grant_bytes=489422848 osc.lustre-OST0000-osc-ffff8800b583c800.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800b583c800.rpc_stats= snapshot_time: 1724773621.485370433 secs.nsecs start_time: 1724773618.462033591 secs.nsecs elapsed_time: 3.023336842 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 33 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 33 100 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 33 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 7424 2201216 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 301056 3468288 8% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 305152 7233536 5% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (75s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 11:47:16 (1724773636) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5832: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (3s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 11:47:19 (1724773639) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4819: 7409 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (3s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 11:47:22 (1724773642) truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4819: 8039 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (2s) == sanity test 43c: md5sum of copy into lustre =========== 11:47:24 (1724773644) bash: OK PASS 43c (2s) == sanity test 46: dirtying a previously written page ========================================================================== 11:47:26 (1724773646) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00423043 s, 968 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.001303 s, 3.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00116676 s, 3.5 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (2s) == sanity test 56r: check lfs find -size works =========== 11:47:28 (1724773648) PASS 56r (3s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 11:47:32 (1724773652) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff8800b583c800.max_cached_mb= users: 5 max_cached_mb: 1865 used_mb: 49 unused_mb: 1816 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff8800b583c800.read_ahead_stats= snapshot_time 1724773675.633181096 secs.nsecs start_time 1724773668.109004697 secs.nsecs elapsed_time 7.524176399 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (27s) resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119a: Short directIO read must return actual read amount ========================================================== 11:48:00 (1724773680) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (2s) == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 11:48:02 (1724773682) PASS 131a (2s) == sanity test 131b: test append writev ================== 11:48:04 (1724773684) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (2s) == sanity test 131c: test read/write on file w/o objects ========================================================== 11:48:06 (1724773686) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (2s) == sanity test 131d: test short read ===================== 11:48:08 (1724773688) PASS 131d (2s) == sanity test 131e: test read hitting hole ============== 11:48:10 (1724773690) PASS 131e (2s) == sanity test 150a: truncate/append tests =============== 11:48:12 (1724773692) 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000270164 s, 22.6 MB/s Stopping client oleg409-client.virtnet /mnt/lustre (opts:) Starting client: oleg409-client.virtnet: -o user_xattr,flock 192.168.204.109@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.204.109@tcp:/lustre 7542784 8192 7528448 1% /mnt/lustre sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete PASS 150a (18s) == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 11:48:30 (1724773710) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (1s) == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 11:48:31 (1724773711) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (1s) == sanity test 150c: Verify fallocate Size and Blocks ==== 11:48:32 (1724773712) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (1s) == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 11:48:33 (1724773713) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (1s) == sanity test 150f: Verify fallocate punch functionality ========================================================== 11:48:34 (1724773714) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (0s) == sanity test 150g: Verify fallocate punch on large range ========================================================== 11:48:34 (1724773714) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (1s) == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 11:48:35 (1724773715) oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000321655 s, 19.0 MB/s oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 PASS 155a (4s) == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 11:48:39 (1724773719) oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00025752 s, 23.7 MB/s oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 PASS 155b (4s) == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 11:48:43 (1724773723) oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00030359 s, 20.1 MB/s oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 PASS 155c (3s) == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 11:48:46 (1724773726) oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 oleg409-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg409-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000810182 s, 7.5 MB/s oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 oleg409-server: error: set_param: setting : Invalid argument pdsh@oleg409-client: oleg409-server: ssh exited with exit code 22 PASS 155d (4s) == sanity test 207a: can refresh layout at glimpse ======= 11:48:50 (1724773730) 4+0 records in 4+0 records out 16384 bytes (16 kB) copied, 0.0053251 s, 3.1 MB/s fail_loc=0x170 PASS 207a (2s) == sanity test 207b: can refresh layout at open ========== 11:48:52 (1724773732) 9+0 records in 9+0 records out 36864 bytes (37 kB) copied, 0.00786795 s, 4.7 MB/s fail_loc=0x171 checksum is 18747fcb2508eeec79415b32f63f3654 /mnt/lustre/f207b.sanity PASS 207b (2s) == sanity test 241a: bio vs dio ========================== 11:48:54 (1724773734) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.0036729 s, 11.2 MB/s -rw-r--r-- 1 root root 40960 Aug 27 11:48 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88012bff1800.lock_unused_count=2 PASS 241a (18s) == sanity test 241b: dio vs dio ========================== 11:49:12 (1724773752) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00424236 s, 9.7 MB/s -rw-r--r-- 1 root root 40960 Aug 27 11:49 /mnt/lustre/f241b.sanity PASS 241b (10s) == sanity test 251a: Handling short read and write correctly ========================================================== 11:49:22 (1724773762) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (2s) == sanity test 251b: short read restore offset correctly ========================================================== 11:49:24 (1724773764) 4+0 records in 4+0 records out 4096 bytes (4.1 kB) copied, 0.00250331 s, 1.6 MB/s fail_loc=0x1431 fail_val=5 PASS 251b (7s) == sanity test complete, duration 383 sec ================ 11:49:33 (1724773773) === sanity: start cleanup 11:49:33 (1724773773) === Starting client oleg409-client.virtnet: -o user_xattr,flock 192.168.204.109@tcp:/lustre /mnt/lustre2 Started clients oleg409-client.virtnet: 192.168.204.109@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Stopping clients: oleg409-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg409-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 11:49:34 (1724773774) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (385s) == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 11:49:35 (1724773775) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 excepting tests: 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 11:49:40 (1724773780) === Starting client oleg409-client.virtnet: -o user_xattr,flock 192.168.204.109@tcp:/lustre /mnt/lustre2 Started clients oleg409-client.virtnet: 192.168.204.109@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg409-client.virtnet: executing check_config_client /mnt/lustre oleg409-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg409-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012bff1800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8801373d2800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012bff1800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8801373d2800.idle_timeout=debug disable quota as required oleg409-server: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 11:49:47 (1724773787) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119467 s, 87.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f2532] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 11:49:47 (1724773787) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 11:49:49 (1724773789) -rw-r--r-- 1 root root 0 Aug 27 11:49 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 11:49:51 (1724773791) -rw-r--r-- 1 root root 0 Aug 27 11:49 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 11:49:53 (1724773793) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (1s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 11:49:54 (1724773794) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 11:49:56 (1724773796) total 400 -rwxrwxrwx 1 root root 0 Aug 27 11:49 f2a -rwxrwxrwx 1 root root 0 Aug 27 11:49 f2b -rw-r--r-- 1 root root 1530459 Aug 27 11:43 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Aug 27 11:42 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71287 Aug 27 11:43 ffsx.sanity-dom.fsxlog total 400 -rwxrwxrwx 1 root root 0 Aug 27 11:49 f2a -rwxrwxrwx 1 root root 0 Aug 27 11:49 f2b -rw-r--r-- 1 root root 1530459 Aug 27 11:43 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Aug 27 11:42 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71287 Aug 27 11:43 ffsx.sanity-dom.fsxlog running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00180656 s, 283 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 11:49:58 (1724773798) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (0s) == sanityn test 2g: check blocks update on sync write ==== 11:49:58 (1724773798) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0717623 s, 29.2 MB/s /mnt/lustre/f2g.sanityn has 4113 blocks /mnt/lustre2/f2g.sanityn has 4113 blocks PASS 2g (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 11:50:00 (1724773800) PASS 4 (2s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 11:50:02 (1724773802) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 11:50:04 (1724773804) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (2s) == sanityn test 7: remove of open directory on other node ======================================================================= 11:50:06 (1724773806) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (1s) == sanityn test 8: remove of open special file on other node ==================================================================== 11:50:07 (1724773807) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 11:50:09 (1724773809) PASS 9a (2s) == sanityn test 9b: append to striped sparse file ======== 11:50:11 (1724773811) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017596 s, 59.6 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.00995651 s, 0.3 kB/s Data read (expecting 'foo'): foo PASS 9b (1s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 11:50:12 (1724773812) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00237785 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00262334 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00334613 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00417851 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00247366 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00241577 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00219394 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00186973 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00245679 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00285918 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0030927 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00266492 s, 0.4 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 11:50:14 (1724773814) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00188414 s, 1.6 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00799111 s, 513 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000228337 s, 13.5 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 11:50:16 (1724773816) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.2532 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (1s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 11:50:17 (1724773817) warning: '-runtime' deprecated, use '-t runtime' instead - link 2415 (time 1724773828.29 total 10.00 last 241.40) - link 5732 (time 1724773838.29 total 20.01 last 331.65) - link 8831 (time 1724773848.29 total 30.01 last 309.88) - link 10000 (time 1724773852.17 total 33.89 last 300.95) - link 13517 (time 1724773862.18 total 43.89 last 351.65) - link 16988 (time 1724773872.18 total 53.90 last 346.96) - link 19725 (time 1724773882.18 total 63.90 last 273.65) - link 22704 (time 1724773892.18 total 73.90 last 297.81) - link 25513 (time 1724773902.18 total 83.90 last 280.88) - link 28598 (time 1724773912.19 total 93.90 last 308.44) - link 30000 (time 1724773917.25 total 98.97 last 276.77) total: 30275 link in 100.00 seconds: 302.74 ops/second using seed 3558944755 running for 100 seconds - stat 2832 (time 1724773830 ; total 11 ; last 11) - stat 10000 (time 1724773839 ; total 20 ; last 9) - stat 17321 (time 1724773850 ; total 31 ; last 11) - stat 20000 (time 1724773854 ; total 35 ; last 4) - stat 28554 (time 1724773865 ; total 46 ; last 11) - stat 30000 (time 1724773866 ; total 47 ; last 1) - stat 35058 (time 1724773877 ; total 58 ; last 11) - stat 39432 (time 1724773888 ; total 69 ; last 11) - stat 40000 (time 1724773889 ; total 70 ; last 1) - stat 44303 (time 1724773900 ; total 81 ; last 11) - stat 49179 (time 1724773911 ; total 92 ; last 11) - stat 50000 (time 1724773912 ; total 93 ; last 1) total: 53343 stats in 100 seconds: 533.429993 stats/second - unlinked 0 (time 1724773869 ; total 0 ; last 0) - unlinked 10000 (time 1724773927 ; total 58 ; last 58) - unlinked 20000 (time 1724773959 ; total 90 ; last 32) - unlinked 30000 (time 1724773989 ; total 120 ; last 30) unlink(/mnt/lustre2/lockdir/lockfile30275) error: No such file or directory total: 30274 unlinks in 120 seconds: 252.283340 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (15504) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (15507) - No such process PASS 12 (174s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 11:53:11 (1724773991) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.2532 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4819: 16294 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (1s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 11:53:12 (1724773992) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4819: 16924 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 11:53:14 (1724773994) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 17553 Terminated $DIR1/$tdir/sleep 60 PASS 14b (1s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 11:53:15 (1724773995) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 18184 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 11:53:17 (1724773997) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 18814 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 11:53:19 (1724773999) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 19: test concurrent uncached read races ========================================================================= 11:53:23 (1724774003) oleg409-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) == sanityn test 20: test extra readahead page left in cache ============================================================== 11:53:24 (1724774004) PASS 20 (1s) == sanityn test 23: others should see updated atime while another read============================================================== 11:53:25 (1724774005) now is 1724774006 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.2532 new atime is 1724774067 PASS 23 (63s) == sanityn test 27: align non-overlapping extent locks from request ============================================================= 11:54:28 (1724774068) 4+0 records in 4+0 records out 16793600 bytes (17 MB) copied, 0.13331 s, 126 MB/s dd 1 started dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB) copied, 0.261074 s, 60.2 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB) copied, 0.00433655 s, 1.9 MB/s dd 3 finished PASS 27 (4s) == sanityn test 39a: file mtime does not change after rename ========================================================== 11:54:32 (1724774072) repeat after cancel_lru_locks PASS 39a (2s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 11:54:34 (1724774074) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 11:54:37 (1724774077) repeat after cancel_lru_locks PASS 39c (2s) == sanityn test 39d: sync write should update mtime ====== 11:54:39 (1724774079) fail_loc=0x411 fail_loc=0 PASS 39d (2s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 11:54:41 (1724774081) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00557533 s, 28.5 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3514: kill: (25778) - No such process PASS 51a (4s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 11:54:45 (1724774085) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00322355 s, 318 kB/s PASS 51c (6s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 11:54:51 (1724774091) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00846458 s, 124 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 107a: Basic grouplock conflict =========== 11:54:54 (1724774094) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0771203 s, 136 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x280000400:0x3db:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.2532 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.2532 First grouplock blocks second one PASS 107a (4s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 11:54:58 (1724774098) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0944926 s, 111 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x240000400:0x3dd:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.2532 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) cleanup: ====================================================== == sanityn test complete, duration 330 sec =============== 11:55:06 (1724774106) === sanityn: start cleanup 11:55:07 (1724774107) === Stopping clients: oleg409-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg409-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 11:55:07 (1724774107) === PASS sanityn (333s) == sanity-dom test complete, duration 763 sec ============ 11:55:08 (1724774108) === sanity-dom: start cleanup 11:55:09 (1724774109) === Stopping clients: oleg409-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 11:55:09 (1724774109) ===