-----============= acceptance-small: sanity-dom ============----- Fri Dec 20 01:18:22 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg202-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanity-dom.*ex: No such file or directory excepting tests: === sanity-dom: start setup 01:18:31 (1734675511) === Starting client oleg202-client.virtnet: -o user_xattr,flock 192.168.202.102@tcp:/lustre /mnt/lustre2 Started clients oleg202-client.virtnet: 192.168.202.102@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg202-client.virtnet: executing check_config_client /mnt/lustre oleg202-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg202-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6cf9800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012a422800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6cf9800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a422800.idle_timeout=debug disable quota as required oleg202-server: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 01:18:44 (1734675524) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7014] 192.168.202.102@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 == sanity-dom test 1: write a file on one mount, truncate on the other, write again ========================================================== 01:18:45 (1734675525) 1+0 records in 1+0 records out 7168 bytes (7.2 kB) copied, 0.00481888 s, 1.5 MB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00847263 s, 363 kB/s /mnt/lustre2/f1.sanity-dom has type file OK /mnt/lustre2/f1.sanity-dom has size 6144 OK PASS 1 (2s) == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 01:18:47 (1734675527) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137944 s, 76.0 MB/s 1+0 records in 1+0 records out 234852 bytes (235 kB) copied, 0.00204212 s, 115 MB/s 0+1 records in 0+1 records out 234852 bytes (235 kB) copied, 0.0162574 s, 14.4 MB/s /mnt/lustre/f2.sanity-dom_left has type file OK /mnt/lustre/f2.sanity-dom_left has size 234852 OK PASS 2 (3s) == sanity-dom test 3: Truncate over DoM size on different nodes ========================================================== 01:18:50 (1734675530) 1+0 records in 1+0 records out 1048476 bytes (1.0 MB) copied, 0.0168153 s, 62.4 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00740616 s, 553 kB/s /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049276 OK /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049076 OK /mnt/lustre/f3.sanity-dom has type file OK /mnt/lustre/f3.sanity-dom has size 1049076 OK PASS 3 (2s) == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 01:18:52 (1734675532) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0522515 s, 40.1 MB/s fail_loc=0x80000808 PASS 4 (5s) == sanity-dom test 5: DoM truncate deadlock ============== 01:18:57 (1734675537) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00828671 s, 494 kB/s multiop /mnt/lustre/f5.sanity-dom vO_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7014 multiop /mnt/lustre/f5.sanity-dom vO_Tc TMPPIPE=/tmp/multiop_open_wait_pipe.7014 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f5.sanity-dom user.job="dd.0" fail_loc=0x80001415 fail_val=5 PASS 5 (5s) == sanity-dom test 6: Race two writes, check file size === 01:19:02 (1734675542) /mnt/lustre2/f6.sanity-dom has size 500 OK PASS 6 (3s) == sanity-dom test 7: Stale pages after read-on-open ===== 01:19:05 (1734675545) 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00248127 s, 403 kB/s 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00320633 s, 312 kB/s PASS 7 (2s) == sanity-dom test fsx: Dual-mount fsx with DoM files ==== 01:19:07 (1734675547) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 5547 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003[0] 1734675548.085537 mapwrite 0x1e79be thru 0x1f6b28 (0xf16b bytes) 1734675548.098858 truncate done 1734675548.099849 mmap done 1734675548.160262 msync done 1734675548.160383 munmap done 000007[0] 1734675548.174683 write 0x092499 thru 0x092ba7 (0x70f bytes) 1734675548.178730 write done 000010[1] 1734675548.208721 write 0x0e1081 thru 0x0effa5 (0xef25 bytes) 1734675548.224522 write done truncating to largest ever: 0xcc40e 000011[0] 1734675548.233221 trunc from 0x1f6b29 to 0x0cc40d (0x12a71b bytes) 1734675548.257068 truncate done 000013[0] 1734675548.282411 mapread 0x0c3977 thru 0x0cc40d (0x8a97 bytes) 1734675548.282670 mmap done 1734675548.290991 memcpy done 1734675548.291366 munmap done truncating to largest ever: 0x1f02e0 000014[1] 1734675548.299200 trunc from 0x0cc40e to 0x1f02df (0x123ed2 bytes) 1734675548.311087 truncate done 000017[1] 1734675548.329985 read 0x1c08d1 thru 0x1cd537 (0xcc67 bytes) 1734675548.334151 read done 000018[0] 1734675548.342627 mapread 0x1a606c thru 0x1ab652 (0x55e7 bytes) 1734675548.346074 mmap done 1734675548.365380 memcpy done 1734675548.365580 munmap done 000022[0] 1734675548.382645 mapwrite 0x15d3e4 thru 0x16336d (0x5f8a bytes) 1734675548.387846 mmap done 1734675548.451958 msync done 1734675548.452217 munmap done 000023[1] 1734675548.463688 trunc from 0x1f02e0 to 0x0a6e2b (0x1494b4 bytes) 1734675548.475552 truncate done 000026[1] 1734675548.488954 write 0x0e53fb thru 0x0e97d0 (0x43d6 bytes) 1734675548.489436 write done 000027[0] 1734675548.501971 read 0x04aa38 thru 0x04c8f1 (0x1eba bytes) 1734675548.511654 read done 000029[1] 1734675548.526048 mapread 0x0d4055 thru 0x0d9fc1 (0x5f6d bytes) 1734675548.527034 mmap done 1734675548.535444 memcpy done 1734675548.535716 munmap done 000034[1] 1734675548.574126 write 0x1a8eea thru 0x1b5891 (0xc9a8 bytes) 1734675548.575088 write done 000035[0] 1734675548.575546 trunc from 0x1b5892 to 0x1b7038 (0x17a7 bytes) 1734675548.604888 truncate done 000036[1] 1734675548.607597 read 0x0b0162 thru 0x0b73bd (0x725c bytes) 1734675548.627696 read done 000037[1] 1734675548.635267 read 0x123a1d thru 0x12568c (0x1c70 bytes) 1734675548.658111 read done 000038[1] 1734675548.659999 write 0x0b15c2 thru 0x0b93af (0x7dee bytes) 1734675548.670452 write done 000039[1] 1734675548.671434 trunc from 0x1b7039 to 0x0e2b7d (0xd44bb bytes) 1734675548.688300 truncate done 000040[0] 1734675548.704893 mapread 0x0bfa58 thru 0x0ce19c (0xe745 bytes) 1734675548.708878 mmap done 1734675548.729249 memcpy done 1734675548.729450 munmap done 000044[1] 1734675548.758681 write 0x036ae3 thru 0x03e462 (0x7980 bytes) 1734675548.769866 write done 000052[1] 1734675548.808542 mapwrite 0x0a1ca6 thru 0x0afbd9 (0xdf34 bytes) 1734675548.808842 mmap done 1734675548.869551 msync done 1734675548.869696 munmap done 000053[1] 1734675548.870076 mapwrite 0x018d66 thru 0x01db35 (0x4dd0 bytes) 1734675548.870310 mmap done 1734675548.912666 msync done 1734675548.912735 munmap done 000054[1] 1734675548.920314 mapread 0x076fd5 thru 0x07f186 (0x81b2 bytes) 1734675548.920548 mmap done 1734675548.947839 memcpy done 1734675548.947985 munmap done 000057[0] 1734675548.977458 mapread 0x07c259 thru 0x0825b2 (0x635a bytes) 1734675548.981480 mmap done 1734675549.002516 memcpy done 1734675549.002667 munmap done 000058[1] 1734675549.004899 mapread 0x04c3a4 thru 0x04d2da (0xf37 bytes) 1734675549.005065 mmap done 1734675549.008706 memcpy done 1734675549.008759 munmap done 000064[1] 1734675549.010241 mapwrite 0x177c15 thru 0x182646 (0xaa32 bytes) 1734675549.024478 truncate done 1734675549.024680 mmap done 1734675549.091967 msync done 1734675549.092287 munmap done 000065[1] 1734675549.113079 mapwrite 0x158c88 thru 0x16460f (0xb988 bytes) 1734675549.113411 mmap done 1734675549.184081 msync done 1734675549.185028 munmap done 000069[1] 1734675549.214896 mapread 0x143900 thru 0x14d437 (0x9b38 bytes) 1734675549.215080 mmap done 1734675549.241629 memcpy done 1734675549.242033 munmap done 000070[1] 1734675549.242384 mapwrite 0x0a67b3 thru 0x0b539e (0xebec bytes) 1734675549.242643 mmap done 1734675549.308216 msync done 1734675549.308728 munmap done 000071[1] 1734675549.317082 mapwrite 0x02d95b thru 0x036762 (0x8e08 bytes) 1734675549.318724 mmap done 1734675549.380290 msync done 1734675549.381035 munmap done 000072[1] 1734675549.381806 mapread 0x0dc7ce thru 0x0ec5f3 (0xfe26 bytes) 1734675549.382099 mmap done 1734675549.431781 memcpy done 1734675549.432505 munmap done 000074[1] 1734675549.461740 mapread 0x15f48d thru 0x16a106 (0xac7a bytes) 1734675549.461964 mmap done 1734675549.479414 memcpy done 1734675549.479484 munmap done 000079[0] 1734675549.525272 read 0x07761a thru 0x08350f (0xbef6 bytes) 1734675549.549075 read done 000081[0] 1734675549.551651 mapwrite 0x190cd6 thru 0x1965e9 (0x5914 bytes) 1734675549.579651 truncate done 1734675549.579838 mmap done 1734675549.639351 msync done 1734675549.639417 munmap done 000085[1] 1734675549.653374 mapwrite 0x19a28b thru 0x1a5b23 (0xb899 bytes) 1734675549.675728 truncate done 1734675549.675927 mmap done 1734675549.736526 msync done 1734675549.736610 munmap done truncating to largest ever: 0x1f70eb 000086[1] 1734675549.739263 trunc from 0x1a5b24 to 0x1f70ea (0x515c7 bytes) 1734675549.742971 truncate done 000088[1] 1734675549.756699 read 0x1c8c63 thru 0x1d3b96 (0xaf34 bytes) 1734675549.775042 read done 000089[1] 1734675549.783551 mapread 0x0f2957 thru 0x0fadaa (0x8454 bytes) 1734675549.783799 mmap done 1734675549.783879 memcpy done 1734675549.784005 munmap done 000090[0] 1734675549.784308 write 0x0c0668 thru 0x0ce737 (0xe0d0 bytes) 1734675549.794288 write done 000093[0] 1734675549.816205 trunc from 0x1f70eb to 0x0d3544 (0x123ba6 bytes) 1734675549.830965 truncate done 000094[1] 1734675549.845712 trunc from 0x0d3545 to 0x02163d (0xb1f07 bytes) 1734675549.866284 truncate done 000096[0] 1734675549.880935 trunc from 0x02163e to 0x1a4ff0 (0x1839b3 bytes) 1734675549.900348 truncate done 000098[1] 1734675549.915086 write 0x01b322 thru 0x01d512 (0x21f1 bytes) 1734675549.923073 write done 000099[1] 1734675549.939422 write 0x11f80a thru 0x1219ce (0x21c5 bytes) 1734675549.952343 write done 000100[1] 1734675549.960014 mapread 0x0e1820 thru 0x0f10dc (0xf8bd bytes) 1734675549.960256 mmap done 1734675550.010026 memcpy done 1734675550.010159 munmap done 000102[1] 1734675550.026622 mapwrite 0x02bede thru 0x031acd (0x5bf0 bytes) 1734675550.026890 mmap done 1734675550.078015 msync done 1734675550.078124 munmap done 000103[0] 1734675550.085992 mapwrite 0x13467f thru 0x136ffa (0x297c bytes) 1734675550.091015 mmap done 1734675550.145550 msync done 1734675550.145666 munmap done 000104[0] 1734675550.155501 trunc from 0x1a4ff1 to 0x0c9332 (0xdbcbe bytes) 1734675550.170255 truncate done 000110[1] 1734675550.225989 mapread 0x0abdf6 thru 0x0b9289 (0xd494 bytes) 1734675550.230318 mmap done 1734675550.275127 memcpy done 1734675550.276221 munmap done 000118[0] 1734675550.322534 read 0x09d689 thru 0x09e828 (0x11a0 bytes) 1734675550.335244 read done 000119[0] 1734675550.335571 read 0x055699 thru 0x0611dc (0xbb44 bytes) 1734675550.335665 read done 000120[1] 1734675550.341605 mapwrite 0x0472f0 thru 0x04e207 (0x6f18 bytes) 1734675550.344486 mmap done 1734675550.388293 msync done 1734675550.388365 munmap done 000122[1] 1734675550.402780 read 0x0100ac thru 0x010cab (0xc00 bytes) 1734675550.413842 read done 000123[1] 1734675550.419679 write 0x131706 thru 0x13b85c (0xa157 bytes) 1734675550.424660 write done 000124[1] 1734675550.424997 mapread 0x12c7ba thru 0x12cd12 (0x559 bytes) 1734675550.425222 mmap done 1734675550.429432 memcpy done 1734675550.429614 munmap done 000127[1] 1734675550.437883 trunc from 0x13b85d to 0x0ab5d2 (0x9028a bytes) 1734675550.444723 truncate done 000130[1] 1734675550.454641 mapwrite 0x1b59f4 thru 0x1c0488 (0xaa95 bytes) 1734675550.460142 truncate done 1734675550.460325 mmap done 1734675550.510064 msync done 1734675550.510224 munmap done 000137[0] 1734675550.554672 mapwrite 0x02debf thru 0x035370 (0x74b2 bytes) 1734675550.558989 mmap done 1734675550.610093 msync done 1734675550.610382 munmap done 000138[1] 1734675550.621315 mapwrite 0x0ff58a thru 0x104673 (0x50ea bytes) 1734675550.625815 mmap done 1734675550.688372 msync done 1734675550.688616 munmap done 000139[0] 1734675550.688894 mapread 0x08f11f thru 0x094082 (0x4f64 bytes) 1734675550.692204 mmap done 1734675550.716998 memcpy done 1734675550.717336 munmap done 000143[1] 1734675550.735993 trunc from 0x1c0489 to 0x08231d (0x13e16b bytes) 1734675550.747405 truncate done 000144[0] 1734675550.750063 trunc from 0x08231e to 0x0f310b (0x70dee bytes) 1734675550.766488 truncate done 000145[1] 1734675550.768506 write 0x065b42 thru 0x073f6c (0xe42b bytes) 1734675550.781808 write done 000148[0] 1734675550.809242 read 0x051ff1 thru 0x056b17 (0x4b27 bytes) 1734675550.834771 read done 000153[0] 1734675550.876740 mapread 0x09b4c3 thru 0x09f342 (0x3e80 bytes) 1734675550.876972 mmap done 1734675550.877035 memcpy done 1734675550.877325 munmap done 000156[0] 1734675550.886061 read 0x0ee285 thru 0x0f310b (0x4e87 bytes) 1734675550.888698 read done 000157[0] 1734675550.889352 read 0x0bd33f thru 0x0c55e8 (0x82aa bytes) 1734675550.889439 read done 000159[0] 1734675550.899948 trunc from 0x0f310c to 0x1c2ba1 (0xcfa96 bytes) 1734675550.912576 truncate done 000162[0] 1734675550.935317 trunc from 0x1c2ba2 to 0x0fc6fd (0xc64a4 bytes) 1734675550.941268 truncate done 000163[1] 1734675550.953193 read 0x08e427 thru 0x08e82f (0x409 bytes) 1734675550.976335 read done 000166[1] 1734675550.984642 trunc from 0x0fc6fe to 0x061be5 (0x9ab18 bytes) 1734675551.007275 truncate done 000169[1] 1734675551.023994 mapread 0x02e7b6 thru 0x038688 (0x9ed3 bytes) 1734675551.026688 mmap done 1734675551.059128 memcpy done 1734675551.059494 munmap done 000170[1] 1734675551.059888 mapwrite 0x100e9d thru 0x104752 (0x38b6 bytes) 1734675551.071487 truncate done 1734675551.071678 mmap done 1734675551.134672 msync done 1734675551.134766 munmap done 000172[1] 1734675551.154444 read 0x0da48b thru 0x0e45f5 (0xa16b bytes) 1734675551.168002 read done 000173[1] 1734675551.172831 write 0x16e631 thru 0x17c898 (0xe268 bytes) 1734675551.174032 write done 000174[1] 1734675551.186128 mapwrite 0x19e983 thru 0x1ad04c (0xe6ca bytes) 1734675551.192371 truncate done 1734675551.192540 mmap done 1734675551.250355 msync done 1734675551.250439 munmap done 000175[1] 1734675551.254524 mapwrite 0x1416a5 thru 0x14eecd (0xd829 bytes) 1734675551.255279 mmap done 1734675551.294886 msync done 1734675551.294965 munmap done 000177[1] 1734675551.314438 read 0x03c75a thru 0x0449e8 (0x828f bytes) 1734675551.314579 read done 000181[0] 1734675551.342278 read 0x17c109 thru 0x1889b4 (0xc8ac bytes) 1734675551.393787 read done 000184[0] 1734675551.398153 mapread 0x1892a2 thru 0x192b7b (0x98da bytes) 1734675551.403993 mmap done 1734675551.423118 memcpy done 1734675551.423275 munmap done 000186[0] 1734675551.438765 trunc from 0x1ad04d to 0x15d0fe (0x4ff4e bytes) 1734675551.462891 truncate done 000187[0] 1734675551.476245 mapread 0x0c6c43 thru 0x0cb9e1 (0x4d9f bytes) 1734675551.476911 mmap done 1734675551.496476 memcpy done 1734675551.498377 munmap done 000190[1] 1734675551.513427 write 0x14820a thru 0x14bcfb (0x3af2 bytes) 1734675551.521666 write done 000191[1] 1734675551.534674 read 0x104482 thru 0x10a9b5 (0x6534 bytes) 1734675551.556533 read done 000192[0] 1734675551.564435 mapwrite 0x1efcb2 thru 0x1f6454 (0x67a3 bytes) 1734675551.580896 truncate done 1734675551.581070 mmap done 1734675551.620851 msync done 1734675551.621015 munmap done 000194[1] 1734675551.632615 mapwrite 0x19046c thru 0x19493c (0x44d1 bytes) 1734675551.638854 mmap done 1734675551.702472 msync done 1734675551.702528 munmap done 000195[0] 1734675551.715197 read 0x171a86 thru 0x174ff6 (0x3571 bytes) 1734675551.750317 read done 000197[1] 1734675551.760528 mapwrite 0x1daa04 thru 0x1e9661 (0xec5e bytes) 1734675551.768593 mmap done 1734675551.879019 msync done 1734675551.879100 munmap done 000198[0] 1734675551.886840 mapwrite 0x027ad4 thru 0x02fdc3 (0x82f0 bytes) 1734675551.890014 mmap done 1734675551.924356 msync done 1734675551.924424 munmap done 000201[1] 1734675551.958749 read 0x16f435 thru 0x17bd8e (0xc95a bytes) 1734675551.999465 read done 000202[0] 1734675552.011000 write 0x1c0211 thru 0x1c61c6 (0x5fb6 bytes) 1734675552.026214 write done 000206[0] 1734675552.065532 mapread 0x1887a4 thru 0x1961b2 (0xda0f bytes) 1734675552.065711 mmap done 1734675552.107146 memcpy done 1734675552.107300 munmap done 000207[1] 1734675552.107645 mapwrite 0x131035 thru 0x140efd (0xfec9 bytes) 1734675552.112851 mmap done 1734675552.220898 msync done 1734675552.220958 munmap done 000209[0] 1734675552.237128 write 0x0aadbb thru 0x0b4dbc (0xa002 bytes) 1734675552.237697 write done 000211[0] 1734675552.259165 trunc from 0x1f6455 to 0x19a554 (0x5bf00 bytes) 1734675552.275673 truncate done 000212[0] 1734675552.279291 read 0x01db87 thru 0x023a88 (0x5f02 bytes) 1734675552.279423 read done 000216[0] 1734675552.303898 trunc from 0x19a555 to 0x10d8c8 (0x8cc8c bytes) 1734675552.312632 truncate done 000218[1] 1734675552.316562 mapwrite 0x1e851c thru 0x1e9023 (0xb08 bytes) 1734675552.351579 truncate done 1734675552.351755 mmap done 1734675552.438227 msync done 1734675552.438290 munmap done 000220[0] 1734675552.441515 read 0x03c66a thru 0x03cd57 (0x6ee bytes) 1734675552.465468 read done 000221[1] 1734675552.467460 read 0x0ab56d thru 0x0b4377 (0x8e0b bytes) 1734675552.482696 read done 000232[1] 1734675552.550868 trunc from 0x1e9024 to 0x184b1d (0x64506 bytes) 1734675552.571329 truncate done 000234[0] 1734675552.576392 mapread 0x1586bd thru 0x15dec9 (0x580d bytes) 1734675552.583792 mmap done 1734675552.615563 memcpy done 1734675552.616257 munmap done 000236[1] 1734675552.637362 mapread 0x085420 thru 0x08e422 (0x9003 bytes) 1734675552.637611 mmap done 1734675552.671960 memcpy done 1734675552.672331 munmap done 000237[1] 1734675552.679666 trunc from 0x184b1e to 0x13ff7f (0x44b9e bytes) 1734675552.697227 truncate done 000240[0] 1734675552.714266 mapwrite 0x0e6884 thru 0x0e7cf4 (0x1471 bytes) 1734675552.718125 mmap done 1734675552.785941 msync done 1734675552.787424 munmap done 000241[0] 1734675552.797853 mapwrite 0x04cf00 thru 0x04e2af (0x13b0 bytes) 1734675552.804470 mmap done 1734675552.849423 msync done 1734675552.849632 munmap done 000245[1] 1734675552.880380 write 0x093422 thru 0x094270 (0xe4f bytes) 1734675552.894604 write done 000246[1] 1734675552.895528 mapwrite 0x1f5506 thru 0x1f91b9 (0x3cb4 bytes) 1734675552.909098 truncate done 1734675552.909605 mmap done 1734675552.957848 msync done 1734675552.957956 munmap done 000247[0] 1734675552.962288 write 0x1d4afd thru 0x1d8bd5 (0x40d9 bytes) 1734675552.974935 write done 000248[1] 1734675552.984269 read 0x134ae4 thru 0x14310f (0xe62c bytes) 1734675553.027338 read done 000249[1] 1734675553.038586 write 0x15c3ad thru 0x15f359 (0x2fad bytes) 1734675553.051935 write done 000250[1] 1734675553.061869 read 0x08ffbc thru 0x09e16e (0xe1b3 bytes) 1734675553.062641 read done 000252[0] 1734675553.063190 write 0x028958 thru 0x036964 (0xe00d bytes) 1734675553.078076 write done 000253[0] 1734675553.085118 trunc from 0x1f91ba to 0x190258 (0x68f61 bytes) 1734675553.099088 truncate done 000254[0] 1734675553.109921 write 0x05a742 thru 0x05fb99 (0x5458 bytes) 1734675553.118999 write done 000256[1] 1734675553.132158 trunc from 0x190259 to 0x06b1c0 (0x125098 bytes) 1734675553.163788 truncate done 000257[1] 1734675553.175608 mapread 0x018c1c thru 0x020c78 (0x805d bytes) 1734675553.175834 mmap done 1734675553.183849 memcpy done 1734675553.184117 munmap done 000258[0] 1734675553.203797 mapread 0x05b05f thru 0x068c99 (0xdc3b bytes) 1734675553.211434 mmap done 1734675553.262457 memcpy done 1734675553.262736 munmap done 000261[0] 1734675553.277622 write 0x129b55 thru 0x137363 (0xd80f bytes) 1734675553.290068 write done 000262[0] 1734675553.290550 mapwrite 0x0512f3 thru 0x0540ad (0x2dbb bytes) 1734675553.290740 mmap done 1734675553.345006 msync done 1734675553.345435 munmap done 000264[0] 1734675553.346015 mapread 0x02c6d3 thru 0x02f9b7 (0x32e5 bytes) 1734675553.346199 mmap done 1734675553.359136 memcpy done 1734675553.359251 munmap done 000266[0] 1734675553.370128 read 0x04ad30 thru 0x059e31 (0xf102 bytes) 1734675553.391037 read done 000267[1] 1734675553.391569 read 0x0ed5fd thru 0x0f10ae (0x3ab2 bytes) 1734675553.447318 read done 000268[0] 1734675553.450899 trunc from 0x137364 to 0x0e8ff7 (0x4e36c bytes) 1734675553.465975 truncate done 000270[1] 1734675553.488084 read 0x059970 thru 0x0599bc (0x4d bytes) 1734675553.508737 read done 000274[1] 1734675553.546549 read 0x0320df thru 0x039119 (0x703b bytes) 1734675553.546751 read done 000275[0] 1734675553.558741 read 0x0b92d8 thru 0x0bb7ca (0x24f3 bytes) 1734675553.577969 read done 000278[0] 1734675553.597204 write 0x161bd1 thru 0x169a7f (0x7eaf bytes) 1734675553.597865 write done 000279[0] 1734675553.606498 read 0x166b15 thru 0x169a7f (0x2f6b bytes) 1734675553.606622 read done 000280[0] 1734675553.607117 write 0x03a9ca thru 0x03b6bc (0xcf3 bytes) 1734675553.636290 write done 000281[0] 1734675553.636795 write 0x142c12 thru 0x14bd56 (0x9145 bytes) 1734675553.637245 write done 000282[1] 1734675553.637494 read 0x0351ae thru 0x03e0a1 (0x8ef4 bytes) 1734675553.671403 read done 000283 1734675553.673880 [0]close/open 1734675553.676586 close done 1734675553.684521 open done 000285[1] 1734675553.693851 write 0x1a4daa thru 0x1b3d6d (0xefc4 bytes) 1734675553.707795 write done 000287[0] 1734675553.708429 mapread 0x15c59e thru 0x165a79 (0x94dc bytes) 1734675553.713730 mmap done 1734675553.737099 memcpy done 1734675553.737614 munmap done 000289[1] 1734675553.740720 mapwrite 0x0d973c thru 0x0e6d9d (0xd662 bytes) 1734675553.740992 mmap done 1734675553.854746 msync done 1734675553.855911 munmap done 000290[0] 1734675553.857112 mapread 0x0c48f5 thru 0x0c8f53 (0x465f bytes) 1734675553.866473 mmap done 1734675553.878638 memcpy done 1734675553.878774 munmap done 000291[0] 1734675553.882658 mapread 0x01d35e thru 0x021849 (0x44ec bytes) 1734675553.883015 mmap done 1734675553.901354 memcpy done 1734675553.902283 munmap done 000297[0] 1734675553.903857 mapwrite 0x11c176 thru 0x123c46 (0x7ad1 bytes) 1734675553.904082 mmap done 1734675553.960141 msync done 1734675553.960458 munmap done 000302[1] 1734675553.971628 mapread 0x108cec thru 0x114579 (0xb88e bytes) 1734675553.978096 mmap done 1734675554.022565 memcpy done 1734675554.022770 munmap done 000303[1] 1734675554.024754 mapwrite 0x0b9df1 thru 0x0be3ad (0x45bd bytes) 1734675554.025234 mmap done 1734675554.094385 msync done 1734675554.095306 munmap done 000304[1] 1734675554.095702 read 0x06bc0e thru 0x0782ca (0xc6bd bytes) 1734675554.125999 read done 000305[0] 1734675554.140794 read 0x144687 thru 0x148a54 (0x43ce bytes) 1734675554.148593 read done 000306[1] 1734675554.159722 mapread 0x04690b thru 0x04ace4 (0x43da bytes) 1734675554.159953 mmap done 1734675554.160013 memcpy done 1734675554.160161 munmap done 000307[0] 1734675554.161162 read 0x0dc61b thru 0x0e50f9 (0x8adf bytes) 1734675554.197682 read done 000310[0] 1734675554.201915 write 0x134b31 thru 0x143416 (0xe8e6 bytes) 1734675554.219825 write done 000312[0] 1734675554.255618 mapread 0x037b9a thru 0x039b5c (0x1fc3 bytes) 1734675554.255967 mmap done 1734675554.256015 memcpy done 1734675554.258244 munmap done 000313[1] 1734675554.258658 read 0x0f2a69 thru 0x0f6372 (0x390a bytes) 1734675554.302776 read done 000314[0] 1734675554.304007 write 0x142700 thru 0x143f69 (0x186a bytes) 1734675554.304898 write done 000315[1] 1734675554.305554 read 0x0147dc thru 0x01b477 (0x6c9c bytes) 1734675554.305708 read done 000320[0] 1734675554.316224 write 0x15edbc thru 0x16157c (0x27c1 bytes) 1734675554.321661 write done 000321[0] 1734675554.328916 write 0x1a1c4a thru 0x1acd59 (0xb110 bytes) 1734675554.333408 write done 000326[0] 1734675554.334712 read 0x0e8b3a thru 0x0ec053 (0x351a bytes) 1734675554.334934 read done 000327[1] 1734675554.335360 trunc from 0x1b3d6e to 0x1b6aee (0x2d81 bytes) 1734675554.367997 truncate done 000330[0] 1734675554.372105 read 0x1b4ee6 thru 0x1b6aee (0x1c09 bytes) 1734675554.393325 read done 000331[0] 1734675554.406975 trunc from 0x1b6aef to 0x062d0a (0x153de4 bytes) 1734675554.428660 truncate done 000334[0] 1734675554.432133 trunc from 0x062d0b to 0x02f1f6 (0x33b14 bytes) 1734675554.439822 truncate done 000335[1] 1734675554.451821 mapwrite 0x0c1577 thru 0x0d043e (0xeec8 bytes) 1734675554.469377 truncate done 1734675554.469574 mmap done 1734675554.521509 msync done 1734675554.521661 munmap done 000339[1] 1734675554.558889 mapread 0x0788b0 thru 0x087a65 (0xf1b6 bytes) 1734675554.559123 mmap done 1734675554.559267 memcpy done 1734675554.559509 munmap done 000342[0] 1734675554.569734 trunc from 0x0d043f to 0x05b86e (0x74bd0 bytes) 1734675554.598180 truncate done 000343[1] 1734675554.607898 trunc from 0x05b86f to 0x087c6c (0x2c3fe bytes) 1734675554.623359 truncate done 000348[0] 1734675554.651767 trunc from 0x087c6d to 0x087478 (0x7f4 bytes) 1734675554.682358 truncate done 000350[0] 1734675554.716940 trunc from 0x087479 to 0x0efcbb (0x68843 bytes) 1734675554.726320 truncate done 000351[0] 1734675554.730356 read 0x0c4b35 thru 0x0c7914 (0x2de0 bytes) 1734675554.748319 read done 000355[1] 1734675554.768633 mapread 0x075547 thru 0x07c6af (0x7169 bytes) 1734675554.771610 mmap done 1734675554.801739 memcpy done 1734675554.804852 munmap done 000358[1] 1734675554.832249 trunc from 0x0efcbc to 0x14b52b (0x5b870 bytes) 1734675554.845118 truncate done 000359[1] 1734675554.858572 mapwrite 0x1a6753 thru 0x1b4668 (0xdf16 bytes) 1734675554.866391 truncate done 1734675554.866587 mmap done 1734675554.932390 msync done 1734675554.932790 munmap done 000360[1] 1734675554.943955 mapwrite 0x16498e thru 0x16f86a (0xaedd bytes) 1734675554.944655 mmap done 1734675554.979514 msync done 1734675554.979668 munmap done 000361[0] 1734675554.982341 mapread 0x0abd86 thru 0x0ba4c2 (0xe73d bytes) 1734675554.985982 mmap done 1734675555.028802 memcpy done 1734675555.029292 munmap done 000363[0] 1734675555.031457 trunc from 0x1b4669 to 0x14e24d (0x6641b bytes) 1734675555.057491 truncate done 000364[0] 1734675555.069490 write 0x09dd6b thru 0x0acaf2 (0xed88 bytes) 1734675555.078938 write done 000366[0] 1734675555.103629 trunc from 0x14e24e to 0x0971ae (0xb709f bytes) 1734675555.111565 truncate done 000368[1] 1734675555.114197 read 0x06059b thru 0x060c56 (0x6bc bytes) 1734675555.129432 read done 000370[0] 1734675555.144002 mapread 0x076324 thru 0x07df44 (0x7c21 bytes) 1734675555.146557 mmap done 1734675555.165124 memcpy done 1734675555.165351 munmap done 000374[1] 1734675555.188108 trunc from 0x0971af to 0x1494fe (0xb2350 bytes) 1734675555.202943 truncate done 000377[1] 1734675555.213496 trunc from 0x1494ff to 0x0a5b5d (0xa39a1 bytes) 1734675555.221381 truncate done 000378[1] 1734675555.233880 mapwrite 0x1760e7 thru 0x179f8b (0x3ea5 bytes) 1734675555.238970 truncate done 1734675555.239154 mmap done 1734675555.301985 msync done 1734675555.302290 munmap done 000383[0] 1734675555.344479 mapwrite 0x1014dc thru 0x10fdeb (0xe910 bytes) 1734675555.351532 mmap done 1734675555.457367 msync done 1734675555.457492 munmap done 000385[0] 1734675555.472292 mapwrite 0x182072 thru 0x18ec99 (0xcc28 bytes) 1734675555.486017 truncate done 1734675555.486343 mmap done 1734675555.527960 msync done 1734675555.528254 munmap done 000387[0] 1734675555.546956 trunc from 0x18ec9a to 0x17c4aa (0x127ef bytes) 1734675555.554135 truncate done 000389[0] 1734675555.568046 read 0x09fc10 thru 0x0a06d6 (0xac7 bytes) 1734675555.585042 read done 000392[1] 1734675555.607446 mapread 0x06dde9 thru 0x079b23 (0xbd3b bytes) 1734675555.611545 mmap done 1734675555.652792 memcpy done 1734675555.652983 munmap done 000394[0] 1734675555.665881 mapread 0x03402e thru 0x03ee8e (0xae61 bytes) 1734675555.666120 mmap done 1734675555.697381 memcpy done 1734675555.697456 munmap done 000396[0] 1734675555.698027 trunc from 0x17c4ab to 0x04408a (0x138420 bytes) 1734675555.709139 truncate done truncating to largest ever: 0x1fcd1d 000400[1] 1734675555.742018 trunc from 0x04408b to 0x1fcd1c (0x1b8c92 bytes) 1734675555.762566 truncate done 000401[1] 1734675555.764391 write 0x071bcd thru 0x075988 (0x3dbc bytes) 1734675555.770806 write done 000404[0] 1734675555.797244 read 0x01beb9 thru 0x022286 (0x63ce bytes) 1734675555.816128 read done 000408[1] 1734675555.833254 mapwrite 0x091d6b thru 0x0a132d (0xf5c3 bytes) 1734675555.833707 mmap done 1734675555.896318 msync done 1734675555.896531 munmap done 000411[0] 1734675555.897328 mapread 0x132ca6 thru 0x1412a4 (0xe5ff bytes) 1734675555.901657 mmap done 1734675555.945620 memcpy done 1734675555.946754 munmap done 000412[0] 1734675555.954969 trunc from 0x1fcd1d to 0x1647c0 (0x9855c bytes) 1734675555.972401 truncate done 000413[1] 1734675555.981410 trunc from 0x1647c1 to 0x1e56dd (0x80f1d bytes) 1734675555.992136 truncate done 000417[0] 1734675556.004396 trunc from 0x1e56de to 0x1b391f (0x31dbe bytes) 1734675556.020371 truncate done 000418[1] 1734675556.030947 mapread 0x172cb6 thru 0x1781a4 (0x54ef bytes) 1734675556.035917 mmap done 1734675556.062397 memcpy done 1734675556.062676 munmap done 000423[1] 1734675556.101466 mapread 0x14bf87 thru 0x152d0d (0x6d87 bytes) 1734675556.105387 mmap done 1734675556.127412 memcpy done 1734675556.127474 munmap done 000427[0] 1734675556.139862 read 0x0b8115 thru 0x0c68ee (0xe7da bytes) 1734675556.154792 read done 000431[1] 1734675556.156081 mapread 0x03fac5 thru 0x04909e (0x95da bytes) 1734675556.160222 mmap done 1734675556.185843 memcpy done 1734675556.186154 munmap done 000432[0] 1734675556.188023 mapread 0x045569 thru 0x04bb9f (0x6637 bytes) 1734675556.188230 mmap done 1734675556.200841 memcpy done 1734675556.201150 munmap done 000434[0] 1734675556.201671 mapread 0x0a5c00 thru 0x0b01f4 (0xa5f5 bytes) 1734675556.201832 mmap done 1734675556.231455 memcpy done 1734675556.231648 munmap done 000437[0] 1734675556.232586 read 0x07ad69 thru 0x07b82a (0xac2 bytes) 1734675556.245433 read done 000438[1] 1734675556.245835 mapwrite 0x091be3 thru 0x09dd67 (0xc185 bytes) 1734675556.246052 mmap done 1734675556.319878 msync done 1734675556.320910 munmap done 000440[1] 1734675556.338861 trunc from 0x1b3920 to 0x06c6e5 (0x14723a bytes) 1734675556.353598 truncate done 000442[1] 1734675556.374361 trunc from 0x06c6e6 to 0x1ab046 (0x13e961 bytes) 1734675556.379931 truncate done 000447[0] 1734675556.420630 mapwrite 0x1d0aee thru 0x1d0e77 (0x38a bytes) 1734675556.431112 truncate done 1734675556.431309 mmap done 1734675556.487372 msync done 1734675556.487616 munmap done 000448[0] 1734675556.501501 write 0x18f38b thru 0x1965c6 (0x723c bytes) 1734675556.509883 write done 000449[0] 1734675556.519848 read 0x0a5878 thru 0x0b1eaf (0xc638 bytes) 1734675556.550188 read done 000451[1] 1734675556.553908 write 0x11f679 thru 0x122845 (0x31cd bytes) 1734675556.570437 write done 000452[0] 1734675556.579556 mapread 0x0c602f thru 0x0d06a6 (0xa678 bytes) 1734675556.583722 mmap done 1734675556.583840 memcpy done 1734675556.583957 munmap done 000455[0] 1734675556.608444 trunc from 0x1d0e78 to 0x1c032f (0x10b48 bytes) 1734675556.622530 truncate done 000457[0] 1734675556.640363 mapwrite 0x14d58c thru 0x14f539 (0x1fae bytes) 1734675556.640661 mmap done 1734675556.680071 msync done 1734675556.680262 munmap done 000459[0] 1734675556.689284 trunc from 0x1c0330 to 0x1b9342 (0x6fed bytes) 1734675556.695057 truncate done 000461[0] 1734675556.703702 trunc from 0x1b9343 to 0x1585bf (0x60d83 bytes) 1734675556.709518 truncate done 000465[1] 1734675556.732311 mapwrite 0x1adc96 thru 0x1b3131 (0x549c bytes) 1734675556.750772 truncate done 1734675556.750959 mmap done 1734675556.798704 msync done 1734675556.798818 munmap done 000466[0] 1734675556.809158 mapwrite 0x1293c6 thru 0x13431d (0xaf58 bytes) 1734675556.815523 mmap done 1734675556.882063 msync done 1734675556.882532 munmap done 000467[1] 1734675556.895623 read 0x11457b thru 0x119a61 (0x54e7 bytes) 1734675556.926475 read done 000468[0] 1734675556.933213 write 0x0b6777 thru 0x0c3d69 (0xd5f3 bytes) 1734675556.941399 write done 000469[1] 1734675556.941759 mapread 0x17e7d9 thru 0x18944f (0xac77 bytes) 1734675556.946651 mmap done 1734675556.946773 memcpy done 1734675556.946813 munmap done 000470[1] 1734675556.947187 mapwrite 0x19c018 thru 0x1a282e (0x6817 bytes) 1734675556.950967 mmap done 1734675557.023361 msync done 1734675557.023430 munmap done 000472[0] 1734675557.040777 mapwrite 0x0c422c thru 0x0d19aa (0xd77f bytes) 1734675557.045522 mmap done 1734675557.254645 msync done 1734675557.254811 munmap done 000474[0] 1734675557.279470 mapwrite 0x0f0b6f thru 0x0fd331 (0xc7c3 bytes) 1734675557.285378 mmap done 1734675557.480031 msync done 1734675557.480111 munmap done 000479[1] 1734675557.526930 write 0x086064 thru 0x094880 (0xe81d bytes) 1734675557.541369 write done 000482[0] 1734675557.552270 read 0x0c6392 thru 0x0cd8e6 (0x7555 bytes) 1734675557.583004 read done 000484[1] 1734675557.586315 trunc from 0x1b3132 to 0x118c93 (0x9a49e bytes) 1734675557.600339 truncate done 000489[0] 1734675557.624758 mapwrite 0x0ac155 thru 0x0b6772 (0xa61e bytes) 1734675557.629999 mmap done 1734675557.709707 msync done 1734675557.709782 munmap done 000490[0] 1734675557.720806 write 0x1e6760 thru 0x1f66b8 (0xff59 bytes) 1734675557.726910 write done 000491[1] 1734675557.727348 mapread 0x0f5852 thru 0x0f815b (0x290a bytes) 1734675557.731096 mmap done 1734675557.746095 memcpy done 1734675557.746339 munmap done 000492[0] 1734675557.757563 read 0x0960db thru 0x09ae41 (0x4d67 bytes) 1734675557.787532 read done 000493[1] 1734675557.796671 trunc from 0x1f66b9 to 0x02c79f (0x1c9f19 bytes) 1734675557.825478 truncate done 000494[1] 1734675557.836421 mapread 0x010503 thru 0x018df4 (0x88f2 bytes) 1734675557.836666 mmap done 1734675557.857407 memcpy done 1734675557.857757 munmap done 000495[0] 1734675557.867265 trunc from 0x02c7a0 to 0x0ffa1d (0xd327e bytes) 1734675557.890723 truncate done 000498[1] 1734675557.922560 read 0x04c150 thru 0x04ce07 (0xcb8 bytes) 1734675557.943579 read done 000500[0] 1734675557.959479 trunc from 0x0ffa1e to 0x023c10 (0xdbe0d bytes) 1734675557.973569 truncate done 000501[0] 1734675557.984255 read 0x006969 thru 0x00c65d (0x5cf5 bytes) 1734675557.990359 read done 000502[1] 1734675558.000159 write 0x0fe097 thru 0x10603d (0x7fa7 bytes) 1734675558.009680 write done 000504[0] 1734675558.019653 write 0x10d9f0 thru 0x113012 (0x5623 bytes) 1734675558.028685 write done 000506[1] 1734675558.044067 read 0x0ffeda thru 0x1070c0 (0x71e7 bytes) 1734675558.068041 read done 000507[0] 1734675558.075554 trunc from 0x113013 to 0x05f764 (0xb38ae bytes) 1734675558.098999 truncate done 000508[1] 1734675558.102374 mapread 0x0428d9 thru 0x047cb9 (0x53e1 bytes) 1734675558.106430 mmap done 1734675558.128948 memcpy done 1734675558.129081 munmap done 000513[1] 1734675558.163020 mapread 0x042c78 thru 0x044afd (0x1e86 bytes) 1734675558.167302 mmap done 1734675558.167360 memcpy done 1734675558.167599 munmap done 000514[0] 1734675558.178846 read 0x01549d thru 0x015de4 (0x948 bytes) 1734675558.195887 read done 000515[0] 1734675558.212703 write 0x1f8363 thru 0x1fa594 (0x2232 bytes) 1734675558.213650 write done 000517[0] 1734675558.226386 mapwrite 0x166e27 thru 0x16dd1e (0x6ef8 bytes) 1734675558.226639 mmap done 1734675558.311886 msync done 1734675558.312071 munmap done 000518[1] 1734675558.319410 mapread 0x184287 thru 0x187549 (0x32c3 bytes) 1734675558.323929 mmap done 1734675558.344518 memcpy done 1734675558.346010 munmap done 000522[0] 1734675558.351650 write 0x032b3a thru 0x0373b8 (0x487f bytes) 1734675558.365598 write done 000523[1] 1734675558.366817 trunc from 0x1fa595 to 0x1430ae (0xb74e6 bytes) 1734675558.399980 truncate done 000524[1] 1734675558.402386 trunc from 0x1430af to 0x0c117b (0x81f33 bytes) 1734675558.410358 truncate done 000530[0] 1734675558.448105 read 0x037bc5 thru 0x046b84 (0xefc0 bytes) 1734675558.467946 read done 000531[0] 1734675558.475519 mapwrite 0x0e04c5 thru 0x0eda89 (0xd5c5 bytes) 1734675558.497563 truncate done 1734675558.497750 mmap done 1734675558.554933 msync done 1734675558.555105 munmap done 000532[1] 1734675558.575259 mapread 0x0beb39 thru 0x0c797b (0x8e43 bytes) 1734675558.580604 mmap done 1734675558.619085 memcpy done 1734675558.620022 munmap done 000538[1] 1734675558.671956 mapwrite 0x0f025e thru 0x0fe489 (0xe22c bytes) 1734675558.694858 truncate done 1734675558.695032 mmap done 1734675558.756008 msync done 1734675558.756191 munmap done 000540[0] 1734675558.757940 write 0x1600db thru 0x16935d (0x9283 bytes) 1734675558.762779 write done 000541[0] 1734675558.772765 mapwrite 0x0f9200 thru 0x0fff67 (0x6d68 bytes) 1734675558.777337 mmap done 1734675558.808815 msync done 1734675558.809261 munmap done 000544[1] 1734675558.826930 mapwrite 0x030b91 thru 0x0373e5 (0x6855 bytes) 1734675558.834829 mmap done 1734675558.917381 msync done 1734675558.919697 munmap done 000545[0] 1734675558.927432 mapread 0x1049dd thru 0x10b1dd (0x6801 bytes) 1734675558.932650 mmap done 1734675558.932766 memcpy done 1734675558.932796 munmap done 000547[1] 1734675558.950725 mapwrite 0x091a12 thru 0x09e743 (0xcd32 bytes) 1734675558.954642 mmap done 1734675559.045500 msync done 1734675559.045854 munmap done 000548[0] 1734675559.055524 mapread 0x0c8e34 thru 0x0d6cf6 (0xdec3 bytes) 1734675559.061165 mmap done 1734675559.122239 memcpy done 1734675559.122407 munmap done 000549[0] 1734675559.132205 read 0x0f9043 thru 0x0fc804 (0x37c2 bytes) 1734675559.154706 read done 000555[1] 1734675559.189109 write 0x178b2e thru 0x1830f5 (0xa5c8 bytes) 1734675559.204690 write done 000560[0] 1734675559.211924 trunc from 0x1830f6 to 0x1b3a31 (0x3093c bytes) 1734675559.248239 truncate done 000563[0] 1734675559.273018 mapread 0x11ffb3 thru 0x125a02 (0x5a50 bytes) 1734675559.273321 mmap done 1734675559.296626 memcpy done 1734675559.296715 munmap done 000564[1] 1734675559.312532 trunc from 0x1b3a32 to 0x079766 (0x13a2cb bytes) 1734675559.330037 truncate done 000566[1] 1734675559.337705 read 0x030818 thru 0x03e6d9 (0xdec2 bytes) 1734675559.345330 read done 000568[0] 1734675559.352807 read 0x0039ba thru 0x006f82 (0x35c9 bytes) 1734675559.371288 read done 000571[0] 1734675559.396290 write 0x1550df thru 0x15830f (0x3231 bytes) 1734675559.401232 write done 000572[1] 1734675559.409742 mapwrite 0x1a1a7f thru 0x1aeb81 (0xd103 bytes) 1734675559.436123 truncate done 1734675559.436318 mmap done 1734675559.523033 msync done 1734675559.523158 munmap done 000573[1] 1734675559.526820 mapread 0x13403c thru 0x13ee18 (0xaddd bytes) 1734675559.527008 mmap done 1734675559.527088 memcpy done 1734675559.527412 munmap done 000574[1] 1734675559.547204 trunc from 0x1aeb82 to 0x10cc61 (0xa1f20 bytes) 1734675559.558545 truncate done 000575[1] 1734675559.571643 mapread 0x089fd4 thru 0x08a118 (0x145 bytes) 1734675559.571891 mmap done 1734675559.571941 memcpy done 1734675559.572031 munmap done 000578[0] 1734675559.578361 mapwrite 0x025822 thru 0x034f28 (0xf707 bytes) 1734675559.586052 mmap done 1734675559.666554 msync done 1734675559.666717 munmap done 000581[0] 1734675559.704432 mapread 0x07a4df thru 0x07df75 (0x3a97 bytes) 1734675559.713843 mmap done 1734675559.748734 memcpy done 1734675559.749965 munmap done 000583[1] 1734675559.767199 write 0x036e6d thru 0x04295a (0xbaee bytes) 1734675559.778030 write done 000587[1] 1734675559.815668 trunc from 0x10cc62 to 0x15e82a (0x51bc9 bytes) 1734675559.826936 truncate done 000590[1] 1734675559.851350 read 0x100c94 thru 0x109633 (0x89a0 bytes) 1734675559.851544 read done 000591[0] 1734675559.861580 mapwrite 0x16cf1a thru 0x1758fc (0x89e3 bytes) 1734675559.878751 truncate done 1734675559.878930 mmap done 1734675559.944517 msync done 1734675559.945083 munmap done 000595[0] 1734675559.978653 write 0x0c3e2b thru 0x0cdf1a (0xa0f0 bytes) 1734675559.979476 write done 000596[0] 1734675559.979874 trunc from 0x1758fd to 0x138f1f (0x3c9dd bytes) 1734675559.989827 truncate done 000597[1] 1734675560.001750 mapread 0x00628a thru 0x00d8ae (0x7625 bytes) 1734675560.006887 mmap done 1734675560.031926 memcpy done 1734675560.032072 munmap done 000599[1] 1734675560.058897 read 0x1297ec thru 0x138f1f (0xf734 bytes) 1734675560.079426 read done 000601[0] 1734675560.081754 mapwrite 0x196d5d thru 0x19a6d8 (0x397c bytes) 1734675560.109073 truncate done 1734675560.109774 mmap done 1734675560.181520 msync done 1734675560.181596 munmap done 000602[0] 1734675560.194787 write 0x1a32b3 thru 0x1a87e1 (0x552f bytes) 1734675560.195385 write done 000603[0] 1734675560.199694 trunc from 0x1a87e2 to 0x0b8b83 (0xefc5e bytes) 1734675560.212021 truncate done 000605[0] 1734675560.238972 read 0x015d04 thru 0x01e0cc (0x83c9 bytes) 1734675560.250527 read done 000608[0] 1734675560.263554 trunc from 0x0b8b84 to 0x0b217d (0x6a06 bytes) 1734675560.278572 truncate done 000609[0] 1734675560.294345 mapwrite 0x0addc3 thru 0x0baa7a (0xccb8 bytes) 1734675560.309096 truncate done 1734675560.309309 mmap done 1734675560.372528 msync done 1734675560.372716 munmap done 000612[0] 1734675560.407814 trunc from 0x0baa7b to 0x15e9a9 (0xa3f2f bytes) 1734675560.428507 truncate done 000614[1] 1734675560.455691 mapread 0x0868c3 thru 0x089adc (0x321a bytes) 1734675560.459895 mmap done 1734675560.477331 memcpy done 1734675560.478125 munmap done 000620[1] 1734675560.528542 trunc from 0x15e9aa to 0x02e438 (0x130571 bytes) 1734675560.551388 truncate done 000623[1] 1734675560.553897 read 0x02d3c2 thru 0x02e438 (0x1077 bytes) 1734675560.559885 read done 000625[1] 1734675560.560536 mapwrite 0x1a08a9 thru 0x1ae504 (0xdc5c bytes) 1734675560.565759 truncate done 1734675560.565928 mmap done 1734675560.635716 msync done 1734675560.635999 munmap done 000627[0] 1734675560.639028 write 0x0525b9 thru 0x058678 (0x60c0 bytes) 1734675560.649829 write done 000628[1] 1734675560.666455 write 0x1a3129 thru 0x1ab62e (0x8506 bytes) 1734675560.668657 write done 000629[0] 1734675560.682766 write 0x079436 thru 0x07bd61 (0x292c bytes) 1734675560.683229 write done 000632[0] 1734675560.713489 mapwrite 0x0da16b thru 0x0dc612 (0x24a8 bytes) 1734675560.723164 mmap done 1734675560.815914 msync done 1734675560.816266 munmap done 000633[0] 1734675560.824438 read 0x08c779 thru 0x09ad4c (0xe5d4 bytes) 1734675560.837033 read done 000634[0] 1734675560.850990 read 0x166c4c thru 0x16861d (0x19d2 bytes) 1734675560.885914 read done 000635[0] 1734675560.886274 mapread 0x009f11 thru 0x015565 (0xb655 bytes) 1734675560.886422 mmap done 1734675560.886516 memcpy done 1734675560.886612 munmap done 000637[0] 1734675560.893991 write 0x11b4c2 thru 0x11ca1f (0x155e bytes) 1734675560.905326 write done 000638[1] 1734675560.913145 write 0x0e2530 thru 0x0eb582 (0x9053 bytes) 1734675560.919623 write done 000639[1] 1734675560.927130 mapwrite 0x0076be thru 0x010461 (0x8da4 bytes) 1734675560.929992 mmap done 1734675560.996968 msync done 1734675560.997099 munmap done 000640[0] 1734675561.002756 mapwrite 0x1b57a6 thru 0x1b8ba4 (0x33ff bytes) 1734675561.016832 truncate done 1734675561.017009 mmap done 1734675561.057441 msync done 1734675561.057709 munmap done 000644[0] 1734675561.090426 write 0x094208 thru 0x09f251 (0xb04a bytes) 1734675561.096550 write done 000645[1] 1734675561.105864 read 0x052d60 thru 0x05deca (0xb16b bytes) 1734675561.132160 read done 000648[1] 1734675561.146714 write 0x1150ce thru 0x116fea (0x1f1d bytes) 1734675561.163799 write done 000649[1] 1734675561.164240 trunc from 0x1b8ba5 to 0x1e14e2 (0x2893e bytes) 1734675561.183754 truncate done 000652[0] 1734675561.198976 read 0x105f83 thru 0x113613 (0xd691 bytes) 1734675561.244776 read done 000654[1] 1734675561.249142 mapread 0x11e9b3 thru 0x1231c8 (0x4816 bytes) 1734675561.249413 mmap done 1734675561.268031 memcpy done 1734675561.268704 munmap done 000658[1] 1734675561.278610 mapread 0x01687f thru 0x022a7e (0xc200 bytes) 1734675561.278799 mmap done 1734675561.311925 memcpy done 1734675561.312311 munmap done 000659[0] 1734675561.320321 read 0x177bd1 thru 0x1868a2 (0xecd2 bytes) 1734675561.357458 read done 000663[0] 1734675561.376340 mapwrite 0x0d69f9 thru 0x0e409f (0xd6a7 bytes) 1734675561.384401 mmap done 1734675561.439393 msync done 1734675561.439515 munmap done 000664[0] 1734675561.440464 write 0x015b3c thru 0x01fa7d (0x9f42 bytes) 1734675561.441000 write done 000666[1] 1734675561.441547 mapwrite 0x11c633 thru 0x125803 (0x91d1 bytes) 1734675561.450432 mmap done 1734675561.538272 msync done 1734675561.538622 munmap done 000667[1] 1734675561.546989 mapread 0x0947f6 thru 0x09e8c2 (0xa0cd bytes) 1734675561.549673 mmap done 1734675561.586103 memcpy done 1734675561.586548 munmap done 000669[0] 1734675561.596322 mapwrite 0x0e6761 thru 0x0ef8fd (0x919d bytes) 1734675561.600511 mmap done 1734675561.721723 msync done 1734675561.721804 munmap done 000670[1] 1734675561.729780 trunc from 0x1e14e3 to 0x17ebe3 (0x628ff bytes) 1734675561.740999 truncate done 000672[1] 1734675561.743432 mapread 0x153776 thru 0x154aed (0x1378 bytes) 1734675561.743631 mmap done 1734675561.749267 memcpy done 1734675561.749549 munmap done 000673[0] 1734675561.756870 mapwrite 0x1a212b thru 0x1ac0a4 (0x9f7a bytes) 1734675561.770026 truncate done 1734675561.770713 mmap done 1734675561.843982 msync done 1734675561.844152 munmap done 000674[0] 1734675561.855948 mapwrite 0x1d69e3 thru 0x1dd147 (0x6765 bytes) 1734675561.861153 truncate done 1734675561.861299 mmap done 1734675561.913385 msync done 1734675561.913456 munmap done 000676[1] 1734675561.925249 mapread 0x154b45 thru 0x1607fc (0xbcb8 bytes) 1734675561.928490 mmap done 1734675561.957824 memcpy done 1734675561.958037 munmap done 000677[1] 1734675561.965697 mapwrite 0x094f81 thru 0x098293 (0x3313 bytes) 1734675561.971718 mmap done 1734675562.019229 msync done 1734675562.019377 munmap done 000682[0] 1734675562.030686 mapwrite 0x0626d9 thru 0x06ff01 (0xd829 bytes) 1734675562.033590 mmap done 1734675562.082996 msync done 1734675562.083058 munmap done 000684[0] 1734675562.091506 write 0x146813 thru 0x14af1d (0x470b bytes) 1734675562.101320 write done 000686[0] 1734675562.101878 mapwrite 0x186293 thru 0x18df85 (0x7cf3 bytes) 1734675562.102100 mmap done 1734675562.145520 msync done 1734675562.145590 munmap done 000687[1] 1734675562.145924 write 0x1a3f01 thru 0x1ae961 (0xaa61 bytes) 1734675562.159551 write done 000688[1] 1734675562.168121 trunc from 0x1dd148 to 0x021148 (0x1bbfff bytes) 1734675562.186546 truncate done 000689[1] 1734675562.188981 trunc from 0x021149 to 0x1116c1 (0xf0579 bytes) 1734675562.194893 truncate done 000690[1] 1734675562.206757 mapwrite 0x12f855 thru 0x13bfe2 (0xc78e bytes) 1734675562.214550 truncate done 1734675562.214718 mmap done 1734675562.295317 msync done 1734675562.295590 munmap done 000691[0] 1734675562.299080 read 0x0b065e thru 0x0b4563 (0x3f06 bytes) 1734675562.329966 read done 000692[1] 1734675562.339605 read 0x05ed78 thru 0x069597 (0xa820 bytes) 1734675562.350377 read done 000694[1] 1734675562.356995 mapread 0x11f093 thru 0x12ccf1 (0xdc5f bytes) 1734675562.357239 mmap done 1734675562.357338 memcpy done 1734675562.357380 munmap done 000700[0] 1734675562.386779 write 0x168cc1 thru 0x16d521 (0x4861 bytes) 1734675562.393071 write done 000701[1] 1734675562.401138 mapwrite 0x134eab thru 0x1363d1 (0x1527 bytes) 1734675562.404974 mmap done 1734675562.452234 msync done 1734675562.452301 munmap done 000702[1] 1734675562.452689 read 0x005c42 thru 0x00dc4a (0x8009 bytes) 1734675562.452798 read done 000703[0] 1734675562.459016 read 0x060772 thru 0x06689a (0x6129 bytes) 1734675562.480349 read done 000704[1] 1734675562.480728 mapread 0x0b6e8d thru 0x0bf86d (0x89e1 bytes) 1734675562.481141 mmap done 1734675562.481413 memcpy done 1734675562.481772 munmap done 000705[1] 1734675562.482248 write 0x05ddac thru 0x0619cc (0x3c21 bytes) 1734675562.500513 write done 000706[0] 1734675562.500783 read 0x0c7dee thru 0x0d619a (0xe3ad bytes) 1734675562.563268 read done 000708[0] 1734675562.574370 write 0x0eeb0b thru 0x0f44ed (0x59e3 bytes) 1734675562.578654 write done 000709[1] 1734675562.586093 mapread 0x1024cd thru 0x1110f1 (0xec25 bytes) 1734675562.590438 mmap done 1734675562.590582 memcpy done 1734675562.590632 munmap done 000711[1] 1734675562.603280 trunc from 0x16d522 to 0x0fa2df (0x73242 bytes) 1734675562.619852 truncate done 000713[0] 1734675562.637876 mapwrite 0x15d487 thru 0x161558 (0x40d2 bytes) 1734675562.653944 truncate done 1734675562.654231 mmap done 1734675562.731474 msync done 1734675562.731550 munmap done 000714[0] 1734675562.742951 mapread 0x105271 thru 0x107875 (0x2605 bytes) 1734675562.743184 mmap done 1734675562.743246 memcpy done 1734675562.743267 munmap done 000718[0] 1734675562.761642 mapread 0x0e7b7f thru 0x0f5845 (0xdcc7 bytes) 1734675562.762008 mmap done 1734675562.762115 memcpy done 1734675562.762315 munmap done 000724[1] 1734675562.781571 read 0x07906c thru 0x084eeb (0xbe80 bytes) 1734675562.804068 read done 000731[0] 1734675562.840549 trunc from 0x161559 to 0x12befc (0x3565c bytes) 1734675562.856824 truncate done 000733[1] 1734675562.859776 read 0x022129 thru 0x02701d (0x4ef5 bytes) 1734675562.881144 read done 000734[1] 1734675562.883749 mapread 0x120ec5 thru 0x12458d (0x36c9 bytes) 1734675562.888506 mmap done 1734675562.899031 memcpy done 1734675562.899316 munmap done 000735[0] 1734675562.901326 mapread 0x121778 thru 0x12befc (0xa785 bytes) 1734675562.904817 mmap done 1734675562.930273 memcpy done 1734675562.930490 munmap done 000736[1] 1734675562.930951 mapwrite 0x03483d thru 0x0423c4 (0xdb88 bytes) 1734675562.931249 mmap done 1734675563.012397 msync done 1734675563.013056 munmap done 000737[1] 1734675563.013440 read 0x02a01f thru 0x0392e6 (0xf2c8 bytes) 1734675563.026820 read done 000738[1] 1734675563.027254 read 0x0b5f76 thru 0x0bec29 (0x8cb4 bytes) 1734675563.027617 read done 000739[1] 1734675563.035522 mapread 0x037e4b thru 0x04494c (0xcb02 bytes) 1734675563.035749 mmap done 1734675563.035846 memcpy done 1734675563.035910 munmap done 000740[0] 1734675563.036209 write 0x091756 thru 0x098f44 (0x77ef bytes) 1734675563.050128 write done 000742[1] 1734675563.058493 read 0x11c747 thru 0x129c69 (0xd523 bytes) 1734675563.058615 read done 000743[0] 1734675563.058864 mapwrite 0x14d280 thru 0x151c52 (0x49d3 bytes) 1734675563.072311 truncate done 1734675563.072525 mmap done 1734675563.118658 msync done 1734675563.118833 munmap done 000744[0] 1734675563.121290 mapread 0x100511 thru 0x1048f9 (0x43e9 bytes) 1734675563.121580 mmap done 1734675563.133960 memcpy done 1734675563.134088 munmap done 000748[0] 1734675563.155944 trunc from 0x151c53 to 0x0359fd (0x11c255 bytes) 1734675563.163543 truncate done 000750[1] 1734675563.176601 mapread 0x00d232 thru 0x018372 (0xb141 bytes) 1734675563.181526 mmap done 1734675563.191909 memcpy done 1734675563.192224 munmap done 000753[1] 1734675563.195104 mapwrite 0x02ca50 thru 0x02eea4 (0x2455 bytes) 1734675563.199094 mmap done 1734675563.245148 msync done 1734675563.245227 munmap done 000754[1] 1734675563.257880 mapwrite 0x130dec thru 0x13bb33 (0xad48 bytes) 1734675563.267869 truncate done 1734675563.268049 mmap done 1734675563.311840 msync done 1734675563.312016 munmap done 000756[1] 1734675563.336521 write 0x183a6e thru 0x18da48 (0x9fdb bytes) 1734675563.338113 write done 000758[0] 1734675563.350866 mapwrite 0x01073a thru 0x01275b (0x2022 bytes) 1734675563.355715 mmap done 1734675563.401529 msync done 1734675563.401651 munmap done 000759[1] 1734675563.411034 write 0x073e45 thru 0x07d39d (0x9559 bytes) 1734675563.426108 write done 000761[0] 1734675563.445587 mapread 0x15ff8b thru 0x168102 (0x8178 bytes) 1734675563.450093 mmap done 1734675563.472581 memcpy done 1734675563.472892 munmap done 000762[1] 1734675563.481905 write 0x1a675e thru 0x1b4e55 (0xe6f8 bytes) 1734675563.488412 write done 000763[0] 1734675563.495105 mapwrite 0x1dfd70 thru 0x1ed396 (0xd627 bytes) 1734675563.521155 truncate done 1734675563.521669 mmap done 1734675563.593012 msync done 1734675563.594334 munmap done 000764[0] 1734675563.597243 mapread 0x17058c thru 0x17fd16 (0xf78b bytes) 1734675563.597408 mmap done 1734675563.637498 memcpy done 1734675563.637704 munmap done 000765[0] 1734675563.655705 trunc from 0x1ed397 to 0x1b6e01 (0x36595 bytes) 1734675563.666331 truncate done 000772[0] 1734675563.723910 trunc from 0x1b6e02 to 0x1ee91f (0x37b1e bytes) 1734675563.731709 truncate done 000776[1] 1734675563.759962 write 0x09f06b thru 0x0acbc4 (0xdb5a bytes) 1734675563.767322 write done 000778[0] 1734675563.791575 mapread 0x1baea0 thru 0x1c6eb9 (0xc01a bytes) 1734675563.798488 mmap done 1734675563.856880 memcpy done 1734675563.857103 munmap done 000779[0] 1734675563.867056 trunc from 0x1ee920 to 0x195257 (0x596c8 bytes) 1734675563.893410 truncate done 000786[1] 1734675563.932625 mapwrite 0x09d125 thru 0x0acb19 (0xf9f5 bytes) 1734675563.939112 mmap done 1734675564.024321 msync done 1734675564.024473 munmap done 000787[1] 1734675564.032359 mapread 0x087a7d thru 0x088ad7 (0x105b bytes) 1734675564.036019 mmap done 1734675564.041486 memcpy done 1734675564.042063 munmap done 000788[0] 1734675564.051260 trunc from 0x195258 to 0x1ecce1 (0x57a8a bytes) 1734675564.066964 truncate done 000789[0] 1734675564.079525 mapread 0x1332b6 thru 0x13b22b (0x7f76 bytes) 1734675564.080484 mmap done 1734675564.105656 memcpy done 1734675564.105961 munmap done 000790[1] 1734675564.116757 write 0x138ce2 thru 0x144aa3 (0xbdc2 bytes) 1734675564.134574 write done 000791[1] 1734675564.144494 trunc from 0x1ecce2 to 0x1c9501 (0x237e0 bytes) 1734675564.158989 truncate done 000792[0] 1734675564.175224 mapwrite 0x0e75d9 thru 0x0ecbd3 (0x55fb bytes) 1734675564.182804 mmap done 1734675564.289154 msync done 1734675564.289363 munmap done 000793[0] 1734675564.297047 mapread 0x0995f5 thru 0x09e332 (0x4d3e bytes) 1734675564.301932 mmap done 1734675564.322074 memcpy done 1734675564.322466 munmap done 000794[1] 1734675564.333157 write 0x193160 thru 0x197117 (0x3fb8 bytes) 1734675564.333725 write done 000795[1] 1734675564.344015 read 0x02f9bf thru 0x039bcb (0xa20d bytes) 1734675564.371948 read done 000798[0] 1734675564.391728 read 0x1be88b thru 0x1c9501 (0xac77 bytes) 1734675564.426757 read done 000800[1] 1734675564.430812 read 0x18e73d thru 0x193a50 (0x5314 bytes) 1734675564.446565 read done 000802[1] 1734675564.447741 mapread 0x0d228c thru 0x0de2ca (0xc03f bytes) 1734675564.448102 mmap done 1734675564.448216 memcpy done 1734675564.448477 munmap done 000804[1] 1734675564.448933 mapread 0x155104 thru 0x15a243 (0x5140 bytes) 1734675564.449068 mmap done 1734675564.449129 memcpy done 1734675564.449142 munmap done 000806[0] 1734675564.449570 mapwrite 0x0b61db thru 0x0bdc4e (0x7a74 bytes) 1734675564.449788 mmap done 1734675564.525117 msync done 1734675564.525409 munmap done 000808[1] 1734675564.535556 read 0x1a85bc thru 0x1b473a (0xc17f bytes) 1734675564.535877 read done 000813[0] 1734675564.560497 mapread 0x09163e thru 0x095962 (0x4325 bytes) 1734675564.560741 mmap done 1734675564.574869 memcpy done 1734675564.575874 munmap done 000815[0] 1734675564.598567 mapread 0x113bcc thru 0x119d9c (0x61d1 bytes) 1734675564.598868 mmap done 1734675564.598930 memcpy done 1734675564.598989 munmap done 000817[0] 1734675564.619088 write 0x0189bc thru 0x0189d2 (0x17 bytes) 1734675564.625346 write done 000822[0] 1734675564.641347 write 0x0c089c thru 0x0c7621 (0x6d86 bytes) 1734675564.647506 write done 000825[1] 1734675564.659023 mapread 0x15cdde thru 0x166052 (0x9275 bytes) 1734675564.663869 mmap done 1734675564.664164 memcpy done 1734675564.664470 munmap done 000827[0] 1734675564.681905 read 0x12d9da thru 0x12eee4 (0x150b bytes) 1734675564.682024 read done 000828[1] 1734675564.692339 mapread 0x12979b thru 0x12d400 (0x3c66 bytes) 1734675564.696165 mmap done 1734675564.696277 memcpy done 1734675564.697333 munmap done 000830[0] 1734675564.721828 mapwrite 0x116af4 thru 0x12689d (0xfdaa bytes) 1734675564.722223 mmap done 1734675564.818307 msync done 1734675564.818390 munmap done 000833[1] 1734675564.830572 mapread 0x09df4e thru 0x0a0c8a (0x2d3d bytes) 1734675564.838894 mmap done 1734675564.866829 memcpy done 1734675564.867910 munmap done 000834[0] 1734675564.875958 trunc from 0x1c9502 to 0x0257c2 (0x1a3d3f bytes) 1734675564.892642 truncate done 000839[0] 1734675564.926674 trunc from 0x0257c3 to 0x0fbf52 (0xd6790 bytes) 1734675564.944962 truncate done 000841[0] 1734675564.969090 mapwrite 0x160467 thru 0x16b2a8 (0xae42 bytes) 1734675564.976796 truncate done 1734675564.976956 mmap done 1734675565.096493 msync done 1734675565.096953 munmap done 000842[0] 1734675565.101105 mapread 0x04caac thru 0x0516a9 (0x4bfe bytes) 1734675565.102093 mmap done 1734675565.127406 memcpy done 1734675565.127848 munmap done 000845[0] 1734675565.166253 write 0x1e17f6 thru 0x1ecd8c (0xb597 bytes) 1734675565.167007 write done 000846[1] 1734675565.179115 write 0x05bcbf thru 0x067c23 (0xbf65 bytes) 1734675565.202396 write done 000847[0] 1734675565.209878 trunc from 0x1ecd8d to 0x15c542 (0x9084a bytes) 1734675565.232999 truncate done 000848[0] 1734675565.237636 write 0x1e40d7 thru 0x1f0ac1 (0xc9eb bytes) 1734675565.238419 write done 000850[1] 1734675565.291648 read 0x06dca4 thru 0x07a1de (0xc53b bytes) 1734675565.317375 read done 000851[0] 1734675565.320404 read 0x106ff7 thru 0x1114d9 (0xa4e3 bytes) 1734675565.342030 read done 000855[0] 1734675565.362407 mapwrite 0x04d880 thru 0x05cf80 (0xf701 bytes) 1734675565.362756 mmap done 1734675565.460816 msync done 1734675565.461029 munmap done 000857[1] 1734675565.461645 mapwrite 0x011b3c thru 0x020a94 (0xef59 bytes) 1734675565.466733 mmap done 1734675565.552980 msync done 1734675565.554135 munmap done 000858[0] 1734675565.564844 mapread 0x0791e9 thru 0x0815b4 (0x83cc bytes) 1734675565.568871 mmap done 1734675565.601954 memcpy done 1734675565.602429 munmap done 000859[0] 1734675565.602770 trunc from 0x1f0ac2 to 0x105088 (0xeba39 bytes) 1734675565.616447 truncate done 000862[1] 1734675565.632770 trunc from 0x105089 to 0x051513 (0xb3b75 bytes) 1734675565.656056 truncate done 000865[1] 1734675565.686413 mapread 0x038782 thru 0x043880 (0xb0ff bytes) 1734675565.686603 mmap done 1734675565.734140 memcpy done 1734675565.736186 munmap done 000867[1] 1734675565.750920 mapread 0x047830 thru 0x049691 (0x1e62 bytes) 1734675565.751163 mmap done 1734675565.758982 memcpy done 1734675565.759368 munmap done 000869[0] 1734675565.759964 mapwrite 0x0df4c4 thru 0x0e8354 (0x8e91 bytes) 1734675565.781100 truncate done 1734675565.781316 mmap done 1734675565.842468 msync done 1734675565.842658 munmap done 000872[1] 1734675565.858482 trunc from 0x0e8355 to 0x0f563a (0xd2e6 bytes) 1734675565.875808 truncate done 000873[0] 1734675565.877626 write 0x0b6c20 thru 0x0c2091 (0xb472 bytes) 1734675565.888313 write done 000874[1] 1734675565.896856 write 0x10adb7 thru 0x10c8e5 (0x1b2f bytes) 1734675565.897346 write done 000877[0] 1734675565.922035 trunc from 0x10c8e6 to 0x1534d1 (0x46bec bytes) 1734675565.936033 truncate done 000878[0] 1734675565.937930 write 0x034858 thru 0x0414e4 (0xcc8d bytes) 1734675565.943784 write done 000879[0] 1734675565.958959 trunc from 0x1534d2 to 0x03c79c (0x116d35 bytes) 1734675565.972554 truncate done 000880[0] 1734675565.984796 write 0x1997ff thru 0x19a746 (0xf48 bytes) 1734675565.985492 write done 000881[0] 1734675565.999980 read 0x149369 thru 0x15433f (0xafd7 bytes) 1734675566.011120 read done 000884[1] 1734675566.022094 trunc from 0x19a747 to 0x1e3d66 (0x49620 bytes) 1734675566.060863 truncate done 000885[0] 1734675566.063915 mapread 0x1dac20 thru 0x1e3d66 (0x9147 bytes) 1734675566.069195 mmap done 1734675566.081090 memcpy done 1734675566.081807 munmap done 000886[1] 1734675566.087820 mapwrite 0x17135e thru 0x179db9 (0x8a5c bytes) 1734675566.088119 mmap done 1734675566.165276 msync done 1734675566.165393 munmap done 000888[0] 1734675566.180746 trunc from 0x1e3d67 to 0x16e8a5 (0x754c1 bytes) 1734675566.203585 truncate done 000890[0] 1734675566.234626 write 0x06e549 thru 0x079336 (0xadee bytes) 1734675566.242553 write done 000891[0] 1734675566.251329 read 0x0fd834 thru 0x10545b (0x7c28 bytes) 1734675566.269116 read done 000892[0] 1734675566.273309 mapread 0x07c97f thru 0x0821af (0x5831 bytes) 1734675566.273490 mmap done 1734675566.273578 memcpy done 1734675566.273671 munmap done 000893[1] 1734675566.280712 read 0x147cde thru 0x14def1 (0x6214 bytes) 1734675566.301852 read done 000895[1] 1734675566.308270 write 0x1620f3 thru 0x1713c3 (0xf2d1 bytes) 1734675566.318332 write done 000896[0] 1734675566.330305 mapread 0x07cbf6 thru 0x085c49 (0x9054 bytes) 1734675566.334613 mmap done 1734675566.334703 memcpy done 1734675566.334897 munmap done 000898[0] 1734675566.351796 mapwrite 0x06fc56 thru 0x071dd9 (0x2184 bytes) 1734675566.355882 mmap done 1734675566.401969 msync done 1734675566.402664 munmap done 000900[0] 1734675566.427354 write 0x0872c7 thru 0x0950f1 (0xde2b bytes) 1734675566.428284 write done 000903[0] 1734675566.458919 write 0x0045c2 thru 0x0089df (0x441e bytes) 1734675566.459400 write done 000906[1] 1734675566.490954 mapread 0x13e580 thru 0x13ffcc (0x1a4d bytes) 1734675566.496064 mmap done 1734675566.505127 memcpy done 1734675566.508713 munmap done 000909[1] 1734675566.547102 mapwrite 0x055241 thru 0x056099 (0xe59 bytes) 1734675566.552675 mmap done 1734675566.607837 msync done 1734675566.607897 munmap done 000910[0] 1734675566.618079 write 0x034f27 thru 0x039bb7 (0x4c91 bytes) 1734675566.626257 write done 000911[0] 1734675566.633903 mapwrite 0x09039f thru 0x099b0f (0x9771 bytes) 1734675566.638097 mmap done 1734675566.742832 msync done 1734675566.742905 munmap done 000915[1] 1734675566.770775 mapwrite 0x107c9f thru 0x108b92 (0xef4 bytes) 1734675566.776356 mmap done 1734675566.806765 msync done 1734675566.806827 munmap done 000917[1] 1734675566.826199 write 0x1b0ac5 thru 0x1b4f30 (0x446c bytes) 1734675566.827784 write done 000918[1] 1734675566.834907 mapwrite 0x0e4515 thru 0x0ec332 (0x7e1e bytes) 1734675566.839517 mmap done 1734675566.898941 msync done 1734675566.899038 munmap done 000921[0] 1734675566.908631 read 0x0412dc thru 0x04fcac (0xe9d1 bytes) 1734675566.931893 read done 000922[1] 1734675566.934087 trunc from 0x1b4f31 to 0x0cb277 (0xe9cb9 bytes) 1734675566.950849 truncate done 000923[0] 1734675566.962444 mapread 0x073301 thru 0x0816de (0xe3de bytes) 1734675566.968259 mmap done 1734675567.012095 memcpy done 1734675567.012852 munmap done 000924[1] 1734675567.023649 mapwrite 0x17c03f thru 0x18a58e (0xe550 bytes) 1734675567.036352 truncate done 1734675567.036523 mmap done 1734675567.127234 msync done 1734675567.127443 munmap done 000925[1] 1734675567.137267 write 0x0921cb thru 0x09e78d (0xc5c3 bytes) 1734675567.142533 write done 000926[0] 1734675567.151239 write 0x1afbb5 thru 0x1bda64 (0xdeb0 bytes) 1734675567.158000 write done 000927[1] 1734675567.171307 trunc from 0x1bda65 to 0x0daa06 (0xe305e bytes) 1734675567.191066 truncate done 000928[0] 1734675567.205748 trunc from 0x0daa07 to 0x0890ab (0x5195b bytes) 1734675567.227204 truncate done 000930[1] 1734675567.245993 write 0x0c65cc thru 0x0ce1b8 (0x7bed bytes) 1734675567.255137 write done 000931[0] 1734675567.266378 read 0x0c71a3 thru 0x0ce1b8 (0x7016 bytes) 1734675567.290311 read done 000932[1] 1734675567.304100 mapread 0x01d3e5 thru 0x02b87d (0xe499 bytes) 1734675567.308462 mmap done 1734675567.347489 memcpy done 1734675567.347622 munmap done 000934[1] 1734675567.348223 mapread 0x054a0d thru 0x063bb0 (0xf1a4 bytes) 1734675567.351223 mmap done 1734675567.384214 memcpy done 1734675567.384791 munmap done 000935[0] 1734675567.394146 write 0x1a680d thru 0x1aaa67 (0x425b bytes) 1734675567.394976 write done 000939[0] 1734675567.412577 read 0x18bf5c thru 0x1968ac (0xa951 bytes) 1734675567.422985 read done 000940[0] 1734675567.431918 read 0x0a93cb thru 0x0aa43d (0x1073 bytes) 1734675567.432072 read done 000941[1] 1734675567.440655 read 0x0019e3 thru 0x008d54 (0x7372 bytes) 1734675567.453534 read done 000942[1] 1734675567.460798 mapread 0x1794f4 thru 0x1862ac (0xcdb9 bytes) 1734675567.463849 mmap done 1734675567.480421 memcpy done 1734675567.480608 munmap done 000944[0] 1734675567.483353 read 0x0afd3b thru 0x0bcf15 (0xd1db bytes) 1734675567.483487 read done 000945[0] 1734675567.483763 mapread 0x0ebc33 thru 0x0f8577 (0xc945 bytes) 1734675567.483899 mmap done 1734675567.483998 memcpy done 1734675567.484028 munmap done 000946[0] 1734675567.484331 write 0x07ff24 thru 0x08264a (0x2727 bytes) 1734675567.513237 write done 000947[0] 1734675567.520130 mapread 0x04f2d0 thru 0x054335 (0x5066 bytes) 1734675567.520661 mmap done 1734675567.520736 memcpy done 1734675567.520838 munmap done 000949[1] 1734675567.528765 mapwrite 0x03d72d thru 0x042bdb (0x54af bytes) 1734675567.532494 mmap done 1734675567.583919 msync done 1734675567.584159 munmap done 000952[0] 1734675567.601047 write 0x1ba4b9 thru 0x1c75d8 (0xd120 bytes) 1734675567.609330 write done 000954[1] 1734675567.634469 write 0x0a4af1 thru 0x0b34a1 (0xe9b1 bytes) 1734675567.642524 write done 000956[1] 1734675567.661535 read 0x11666b thru 0x117079 (0xa0f bytes) 1734675567.690193 read done 000958[1] 1734675567.705622 mapread 0x03daa3 thru 0x045f3f (0x849d bytes) 1734675567.705972 mmap done 1734675567.706075 memcpy done 1734675567.706108 munmap done 000960[0] 1734675567.725558 write 0x15f122 thru 0x162b14 (0x39f3 bytes) 1734675567.738806 write done 000961[0] 1734675567.745938 trunc from 0x1c75d9 to 0x035183 (0x192455 bytes) 1734675567.769734 truncate done 000963[0] 1734675567.772584 write 0x0b3ad7 thru 0x0b4314 (0x83e bytes) 1734675567.772986 write done 000964[0] 1734675567.773254 trunc from 0x0b4315 to 0x11d7e6 (0x694d2 bytes) 1734675567.779406 truncate done 000966[1] 1734675567.794985 read 0x06f066 thru 0x07167d (0x2618 bytes) 1734675567.811141 read done 000967[0] 1734675567.813681 trunc from 0x11d7e7 to 0x16694a (0x49164 bytes) 1734675567.824495 truncate done 000968[1] 1734675567.826334 mapwrite 0x000203 thru 0x00841b (0x8219 bytes) 1734675567.830256 mmap done 1734675567.867276 msync done 1734675567.867360 munmap done 000969[1] 1734675567.875931 read 0x095287 thru 0x09ee17 (0x9b91 bytes) 1734675567.888528 read done 000979[0] 1734675567.971243 mapread 0x05bde6 thru 0x06828e (0xc4a9 bytes) 1734675567.975269 mmap done 1734675568.016276 memcpy done 1734675568.016399 munmap done 000980[0] 1734675568.016719 write 0x1d9361 thru 0x1db757 (0x23f7 bytes) 1734675568.017107 write done 000983[0] 1734675568.030267 mapread 0x17e629 thru 0x1860d8 (0x7ab0 bytes) 1734675568.030484 mmap done 1734675568.053640 memcpy done 1734675568.053922 munmap done 000984[1] 1734675568.054334 read 0x12e277 thru 0x13d673 (0xf3fd bytes) 1734675568.094195 read done 000985[0] 1734675568.094716 write 0x01c1d1 thru 0x01cdca (0xbfa bytes) 1734675568.106999 write done 000987[1] 1734675568.128741 trunc from 0x1db758 to 0x00b5f2 (0x1d0165 bytes) 1734675568.150329 truncate done 000989[1] 1734675568.162854 read 0x0047e0 thru 0x00b5f2 (0x6e13 bytes) 1734675568.166554 read done 000990[1] 1734675568.167497 mapread 0x0002d1 thru 0x00b5f2 (0xb322 bytes) 1734675568.167709 mmap done 1734675568.167764 memcpy done 1734675568.167913 munmap done 000991[1] 1734675568.168497 read 0x00b04e thru 0x00b5f2 (0x5a5 bytes) 1734675568.168544 read done 000994[1] 1734675568.187689 mapread 0x00467b thru 0x00b5f2 (0x6f78 bytes) 1734675568.187829 mmap done 1734675568.187886 memcpy done 1734675568.187912 munmap done 000996[1] 1734675568.196406 write 0x1b4ab5 thru 0x1befe0 (0xa52c bytes) 1734675568.198457 write done 000998[0] 1734675568.217739 trunc from 0x1befe1 to 0x0b506a (0x109f76 bytes) 1734675568.238355 truncate done 000999[0] 1734675568.240631 mapread 0x070b2a thru 0x0710bb (0x592 bytes) 1734675568.240819 mmap done 1734675568.245856 memcpy done 1734675568.246230 munmap done All operations completed A-OK! PASS fsx (22s) == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 01:19:29 (1734675569) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 oleg202-server: /home/green/git/lustre-release/lustre/tests/except/sanity.0f.ex oleg202-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see client > v2_15_63-134-gdacc4b6d38 for LU-15963, go 312 - need mds1 <= 2.14.55-100-g8a84c7f9c7 for LU-14927, skip 0f - need mds1 < v2_14_55-100-g8a84c7f9c7 for LU-14927, skip 0f excepting tests: 42a 42c 42b 118c 118d 407 119i 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 01:19:38 (1734675578) === Stopping clients: oleg202-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg202-client.virtnet /mnt/lustre2 opts: oleg202-client.virtnet: executing check_config_client /mnt/lustre oleg202-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg202-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a422800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a422800.idle_timeout=debug disable quota as required oleg202-server: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 01:19:49 (1734675589) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f14818] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all == sanity test 36a: MDS utime check (mknod, utime) ======= 01:19:51 (1734675591) utime: good mknod times 1734675591 <= 1734675592 <= 1734675592 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (3s) == sanity test 36b: OST utime check (open, utime) ======== 01:19:54 (1734675594) utime: good utime mtimes 100000, atime 200000 PASS 36b (2s) == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 01:19:56 (1734675596) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1734675596 <= 1734675597 <= 1734675597 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (3s) == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 01:19:59 (1734675599) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (2s) == sanity test 36e: utime on non-owned file (should return error) ========================================================== 01:20:02 (1734675602) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (3s) == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 01:20:04 (1734675604) fail_loc=0x80000214 Fri Dec 20 01:20:05 EST 2024 1734675605 Fri Dec 20 01:20:06 EST 2024 1734675606 PASS 36f (4s) == sanity test 36g: FMD cache expiry =============================================================================== 01:20:08 (1734675608) FMD max age: 30s FMD before: 6 FMD after: 0 PASS 36g (45s) == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 01:20:53 (1734675653) fail_loc=0x80000227 Fri Dec 20 01:20:54 EST 2024 1734675654 Fri Dec 20 01:20:55 EST 2024 1734675655 PASS 36h (4s) == sanity test 36i: change mtime on striped directory ==== 01:20:57 (1734675657) SKIP: sanity test_36i needs >= 2 MDTs SKIP 36i (1s) == sanity test 39a: mtime changed on create ============== 01:20:58 (1734675658) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (4s) == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 01:21:03 (1734675663) repeat after cancel_lru_locks PASS 39b (5s) == sanity test 39c: mtime change on rename ===================================================================================== 01:21:07 (1734675667) repeat after cancel_lru_locks PASS 39c (4s) == sanity test 39d: create, utime, stat ======================================================================================== 01:21:11 (1734675671) repeat after cancel_lru_locks PASS 39d (3s) == sanity test 39e: create, stat, utime, stat ================================================================================== 01:21:14 (1734675674) repeat after cancel_lru_locks PASS 39e (3s) == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 01:21:17 (1734675677) repeat after cancel_lru_locks PASS 39f (5s) == sanity test 39g: write, chmod, stat ========================================================================================= 01:21:22 (1734675682) repeat after cancel_lru_locks PASS 39g (5s) == sanity test 39h: write, utime within one second, stat ======================================================================= 01:21:27 (1734675687) repeat after cancel_lru_locks PASS 39h (3s) == sanity test 39i: write, rename, stat ======================================================================================== 01:21:30 (1734675690) repeat after cancel_lru_locks PASS 39i (4s) == sanity test 39j: write, rename, close, stat ================================================================================= 01:21:34 (1734675694) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14818 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 PASS 39j (7s) == sanity test 39k: write, utime, close, stat ================================================================================== 01:21:41 (1734675701) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14818 repeat after cancel_lru_locks PASS 39k (4s) == sanity test 39l: directory atime update ===================================================================================== 01:21:45 (1734675705) PASS 39l (10s) == sanity test 39m: test atime and mtime before 1970 ===== 01:21:55 (1734675715) repeat after cancel_lru_locks PASS 39m (4s) == sanity test 39n: check that O_NOATIME is honored ====== 01:21:59 (1734675719) 1+0 records in 1+0 records out PASS 39n (13s) == sanity test 39o: directory cached attributes updated after create ========================================================== 01:22:12 (1734675732) a b PASS 39o (3s) == sanity test 39p: remote directory cached attributes updated after create ================================================================== 01:22:15 (1734675735) SKIP: sanity test_39p needs >= 2 MDTs SKIP 39p (2s) == sanity test 39r: lazy atime update on OST ============= 01:22:17 (1734675737) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) == sanity test 39q: close won't zero out atime =========== 01:22:18 (1734675738) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.14818 PASS 39q (3s) == sanity test 39s: relatime is supported ================ 01:22:21 (1734675741) 192.168.202.102@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg202-client.virtnet /mnt/lustre (opts:) Starting client: oleg202-client.virtnet: -o relatime 192.168.202.102@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg202-client.virtnet /mnt/lustre (opts:) Starting client: oleg202-client.virtnet: -o user_xattr,flock 192.168.202.102@tcp:/lustre /mnt/lustre PASS 39s (8s) == sanity test 39u: stat race ============================ 01:22:29 (1734675749) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0542882 s, 19.3 MB/s fail_loc=0x80001434 PASS 39u (17s) == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 01:22:46 (1734675766) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00342403 s, 1.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (2s) == sanity test 41: test small file write + fstat =============================================================================== 01:22:48 (1734675768) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (3s) == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 01:22:51 (1734675771) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.0352595 s, 2.9 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6656 2201984 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7530496 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (3s) == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 01:22:54 (1734675774) total: 1000 open/close in 5.15 seconds: 194.10 ops/second total: 934 open/close in 4.88 seconds: 191.47 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 17.562 s, 27.9 MB/s osc.lustre-OST0000-osc-ffff8800a9cbb000.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800a9cbb000.cur_grant_bytes=490340352 osc.lustre-OST0000-osc-ffff8800a9cbb000.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff8800a9cbb000.cur_grant_bytes=490471424 osc.lustre-OST0000-osc-ffff8800a9cbb000.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800a9cbb000.rpc_stats= snapshot_time: 1734675860.160162108 secs.nsecs start_time: 1734675856.578387658 secs.nsecs elapsed_time: 3.581774450 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 DIO RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 33 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 32 96 96 2: 0 0 0 | 1 3 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 33 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 7168 2201472 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 91136 3678208 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 95232 7443456 2% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (108s) == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 01:24:43 (1734675883) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5844: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (4s) == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 01:24:46 (1734675886) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 9187 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (4s) == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 01:24:50 (1734675890) truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 9822 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (4s) == sanity test 43c: md5sum of copy into lustre =========== 01:24:54 (1734675894) bash: OK PASS 43c (3s) == sanity test 46: dirtying a previously written page ========================================================================== 01:24:57 (1734675897) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00754011 s, 543 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00144536 s, 2.8 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00269844 s, 1.5 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (3s) == sanity test 56r: check lfs find -size works =========== 01:25:00 (1734675900) PASS 56r (4s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 01:25:05 (1734675905) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff8800a9cbb000.max_cached_mb= users: 5 max_cached_mb: 1865 used_mb: 49 unused_mb: 1816 unevict_mb: 0 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff8800a9cbb000.read_ahead_stats= snapshot_time 1734675929.433430559 secs.nsecs start_time 1734675921.130866463 secs.nsecs elapsed_time 8.302564096 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (27s) resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 119a: Short directIO read must return actual read amount ========================================================== 01:25:33 (1734675933) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (2s) == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 01:25:35 (1734675935) PASS 131a (3s) == sanity test 131b: test append writev ================== 01:25:38 (1734675938) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (2s) == sanity test 131c: test read/write on file w/o objects ========================================================== 01:25:40 (1734675940) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (2s) == sanity test 131d: test short read ===================== 01:25:42 (1734675942) PASS 131d (2s) == sanity test 131e: test read hitting hole ============== 01:25:44 (1734675944) PASS 131e (2s) == sanity test 150a: truncate/append tests =============== 01:25:46 (1734675946) 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00182221 s, 3.3 MB/s Stopping client oleg202-client.virtnet /mnt/lustre (opts:) Starting client: oleg202-client.virtnet: -o user_xattr,flock 192.168.202.102@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.202.102@tcp:/lustre 7542784 13312 7523328 1% /mnt/lustre sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete PASS 150a (20s) == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 01:26:06 (1734675966) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (1s) == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 01:26:07 (1734675967) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (1s) == sanity test 150c: Verify fallocate Size and Blocks ==== 01:26:08 (1734675968) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (1s) == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 01:26:09 (1734675969) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (1s) == sanity test 150f: Verify fallocate punch functionality ========================================================== 01:26:10 (1734675970) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (1s) == sanity test 150g: Verify fallocate punch on large range ========================================================== 01:26:11 (1734675971) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (1s) == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 01:26:12 (1734675972) oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000315832 s, 19.3 MB/s oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 PASS 155a (4s) == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 01:26:16 (1734675976) oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00041695 s, 14.6 MB/s oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 PASS 155b (4s) == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 01:26:20 (1734675980) oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000268006 s, 22.7 MB/s oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 PASS 155c (7s) == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 01:26:27 (1734675987) oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 oleg202-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg202-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000511607 s, 11.9 MB/s oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 oleg202-server: error: set_param: setting : Invalid argument pdsh@oleg202-client: oleg202-server: ssh exited with exit code 22 PASS 155d (5s) == sanity test 207a: can refresh layout at glimpse ======= 01:26:32 (1734675992) 10+0 records in 10+0 records out 40960 bytes (41 kB) copied, 0.00915138 s, 4.5 MB/s fail_loc=0x170 PASS 207a (3s) == sanity test 207b: can refresh layout at open ========== 01:26:35 (1734675995) 4+0 records in 4+0 records out 16384 bytes (16 kB) copied, 0.00994653 s, 1.6 MB/s fail_loc=0x171 checksum is ce338fe6899778aacfc28414f2d9498b /mnt/lustre/f207b.sanity PASS 207b (3s) == sanity test 241a: bio vs dio ========================== 01:26:38 (1734675998) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00535359 s, 7.7 MB/s -rw-r--r-- 1 root root 40960 Dec 20 01:26 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6f13800.lock_unused_count=1 PASS 241a (29s) == sanity test 241b: dio vs dio ========================== 01:27:07 (1734676027) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.0059971 s, 6.8 MB/s -rw-r--r-- 1 root root 40960 Dec 20 01:27 /mnt/lustre/f241b.sanity PASS 241b (17s) == sanity test 251a: Handling short read and write correctly ========================================================== 01:27:24 (1734676044) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (3s) == sanity test 251b: short read restore offset correctly ========================================================== 01:27:27 (1734676047) 4+0 records in 4+0 records out 4096 bytes (4.1 kB) copied, 0.00438157 s, 935 kB/s fail_loc=0x1431 fail_val=5 PASS 251b (7s) == sanity test complete, duration 487 sec ================ 01:27:37 (1734676057) === sanity: start cleanup 01:27:38 (1734676058) === Starting client oleg202-client.virtnet: -o user_xattr,flock 192.168.202.102@tcp:/lustre /mnt/lustre2 Started clients oleg202-client.virtnet: 192.168.202.102@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Stopping clients: oleg202-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg202-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 01:27:41 (1734676061) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (495s) == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 01:27:44 (1734676064) mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 oleg202-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 01:27:51 (1734676071) === Starting client oleg202-client.virtnet: -o user_xattr,flock 192.168.202.102@tcp:/lustre /mnt/lustre2 Started clients oleg202-client.virtnet: 192.168.202.102@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg202-client.virtnet: executing check_config_client /mnt/lustre oleg202-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg202-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a9cbe000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6f13800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9cbe000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6f13800.idle_timeout=debug disable quota as required oleg202-server: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 01:27:59 (1734676079) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138234 s, 75.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f4965] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 01:28:00 (1734676080) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 01:28:02 (1734676082) -rw-r--r-- 1 root root 0 Dec 20 01:28 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 01:28:04 (1734676084) -rw-r--r-- 1 root root 0 Dec 20 01:28 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 01:28:06 (1734676086) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 01:28:08 (1734676088) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 01:28:10 (1734676090) total 186 -rwxrwxrwx 1 root root 0 Dec 20 01:28 f2a -rwxrwxrwx 1 root root 0 Dec 20 01:28 f2b -rw-r--r-- 1 root root 741483 Dec 20 01:19 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Dec 20 01:19 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71912 Dec 20 01:19 ffsx.sanity-dom.fsxlog total 186 -rwxrwxrwx 1 root root 0 Dec 20 01:28 f2a -rwxrwxrwx 1 root root 0 Dec 20 01:28 f2b -rw-r--r-- 1 root root 741483 Dec 20 01:19 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Dec 20 01:19 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 71912 Dec 20 01:19 ffsx.sanity-dom.fsxlog running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00258592 s, 198 kB/s PASS 2e (1s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 01:28:12 (1734676092) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (0s) == sanityn test 2g: check blocks update on sync write ==== 01:28:13 (1734676093) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.154405 s, 13.6 MB/s /mnt/lustre/f2g.sanityn has 4113 blocks /mnt/lustre2/f2g.sanityn has 4113 blocks PASS 2g (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 01:28:15 (1734676095) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 01:28:18 (1734676098) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (3s) == sanityn test 6: remove of open file on other node ============================================================================ 01:28:21 (1734676101) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (2s) == sanityn test 7: remove of open directory on other node ======================================================================= 01:28:24 (1734676104) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (3s) == sanityn test 8: remove of open special file on other node ==================================================================== 01:28:26 (1734676106) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 01:28:28 (1734676108) PASS 9a (2s) == sanityn test 9b: append to striped sparse file ======== 01:28:30 (1734676110) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174232 s, 60.2 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0203984 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 01:28:32 (1734676112) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00210236 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00321254 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00842779 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00749346 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00452382 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00328391 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0041762 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00526528 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00401348 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00361745 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00273634 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00420946 s, 0.2 kB/s PASS 10a (3s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 01:28:35 (1734676115) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00557526 s, 551 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0176685 s, 232 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000204714 s, 15.0 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 01:28:37 (1734676117) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.4965 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (3s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 01:28:40 (1734676120) warning: '-runtime' deprecated, use '-t runtime' instead - link 902 (time 1734676131.97 total 10.00 last 90.16) - link 2170 (time 1734676141.98 total 20.01 last 126.78) - link 3924 (time 1734676151.99 total 30.02 last 175.22) - link 5196 (time 1734676161.99 total 40.02 last 127.12) - link 6780 (time 1734676172.00 total 50.03 last 158.32) - link 7971 (time 1734676182.01 total 60.04 last 118.99) - link 8943 (time 1734676192.01 total 70.04 last 97.20) - link 9877 (time 1734676202.02 total 80.05 last 93.31) - link 10828 (time 1734676212.03 total 90.06 last 94.97) total: 11692 link in 100.00 seconds: 116.92 ops/second using seed 3712999441 running for 100 seconds - stat 1788 (time 1734676134 ; total 11 ; last 11) - stat 9761 (time 1734676145 ; total 22 ; last 11) - stat 10000 (time 1734676145 ; total 22 ; last 0) - stat 18065 (time 1734676156 ; total 33 ; last 11) - stat 20000 (time 1734676159 ; total 36 ; last 3) - stat 27792 (time 1734676170 ; total 47 ; last 11) - stat 30000 (time 1734676173 ; total 50 ; last 3) - stat 32678 (time 1734676184 ; total 61 ; last 11) - stat 34963 (time 1734676195 ; total 72 ; last 11) - stat 37335 (time 1734676206 ; total 83 ; last 11) - stat 39905 (time 1734676217 ; total 94 ; last 11) - stat 40000 (time 1734676217 ; total 94 ; last 0) total: 41842 stats in 100 seconds: 418.420013 stats/second - unlinked 0 (time 1734676173 ; total 0 ; last 0) - unlinked 10000 (time 1734676271 ; total 98 ; last 98) unlink(/mnt/lustre2/lockdir/lockfile11692) error: No such file or directory total: 11691 unlinks in 109 seconds: 107.256882 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (18643) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (18646) - No such process PASS 12 (164s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 01:31:24 (1734676284) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.4965 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 19412 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 01:31:26 (1734676286) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 20048 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 01:31:28 (1734676288) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 20681 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 01:31:31 (1734676291) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 21316 Terminated $DIR1/$tdir/sleep 60 PASS 14c (3s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 01:31:34 (1734676294) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 21952 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 01:31:37 (1734676297) fail_loc=0x8000030a PASS 17 (5s) == sanityn test 19: test concurrent uncached read races ========================================================================= 01:31:42 (1734676302) oleg202-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg202-client: oleg202-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 01:31:44 (1734676304) PASS 20 (3s) == sanityn test 23: others should see updated atime while another read============================================================== 01:31:47 (1734676307) now is 1734676309 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.4965 new atime is 1734676370 PASS 23 (65s) == sanityn test 27: align non-overlapping extent locks from request ============================================================= 01:32:52 (1734676372) 4+0 records in 4+0 records out 16793600 bytes (17 MB) copied, 0.302964 s, 55.4 MB/s dd 1 started dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB) copied, 0.487612 s, 32.3 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB) copied, 0.0121844 s, 672 kB/s dd 3 finished PASS 27 (6s) == sanityn test 39a: file mtime does not change after rename ========================================================== 01:32:58 (1734676378) repeat after cancel_lru_locks PASS 39a (3s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 01:33:01 (1734676381) repeat after cancel_lru_locks PASS 39b (5s) == sanityn test 39c: check truncate mtime update ================================================================================ 01:33:06 (1734676386) repeat after cancel_lru_locks PASS 39c (3s) == sanityn test 39d: sync write should update mtime ====== 01:33:09 (1734676389) fail_loc=0x411 fail_loc=0 PASS 39d (3s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 01:33:12 (1734676392) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00616185 s, 25.8 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3518: kill: (28976) - No such process PASS 51a (5s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 01:33:17 (1734676397) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0136661 s, 74.9 kB/s PASS 51c (8s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 01:33:25 (1734676405) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156891 s, 66.8 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 107a: Basic grouplock conflict =========== 01:33:29 (1734676409) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.160335 s, 65.4 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x280000400:0x3db:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.4965 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.4965 First grouplock blocks second one PASS 107a (4s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 01:33:33 (1734676413) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.182654 s, 57.4 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x240000400:0x3dd:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.4965 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) cleanup: ====================================================== == sanityn test complete, duration 359 sec =============== 01:33:43 (1734676423) === sanityn: start cleanup 01:33:43 (1734676423) === Stopping clients: oleg202-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg202-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 01:33:45 (1734676425) === PASS sanityn (363s) == sanity-dom test complete, duration 924 sec ============ 01:33:47 (1734676427) === sanity-dom: start cleanup 01:33:48 (1734676428) === Stopping clients: oleg202-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 01:33:49 (1734676429) ===