== sanity-dom test fsx: Dual-mount fsx with DoM files ==== 12:28:27 (1731346107) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 6108 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003[0] 1731346108.426540 mapwrite 0x11880a thru 0x1274f6 (0xeced bytes) 1731346108.433912 truncate done 1731346108.434111 mmap done 1731346108.463835 msync done 1731346108.463931 munmap done 000004[1] 1731346108.468865 read 0x0721c6 thru 0x07fee9 (0xdd24 bytes) 1731346108.485351 read done 000008[0] 1731346108.492310 mapread 0x039d19 thru 0x04542f (0xb717 bytes) 1731346108.492509 mmap done 1731346108.497183 memcpy done 1731346108.497244 munmap done 000012[1] 1731346108.512054 mapread 0x0f137d thru 0x0f6498 (0x511c bytes) 1731346108.513817 mmap done 1731346108.530357 memcpy done 1731346108.530405 munmap done truncating to largest ever: 0xf6790 000013[0] 1731346108.533752 trunc from 0x1274f7 to 0x0f678f (0x30d67 bytes) 1731346108.539749 truncate done 000015[0] 1731346108.541360 write 0x0086f5 thru 0x00c2a3 (0x3baf bytes) 1731346108.543832 write done truncating to largest ever: 0x178313 000021[1] 1731346108.552964 trunc from 0x0f6790 to 0x178312 (0x81b83 bytes) 1731346108.563665 truncate done 000023[1] 1731346108.573013 mapread 0x146e4b thru 0x15473e (0xd8f4 bytes) 1731346108.573248 mmap done 1731346108.578575 memcpy done 1731346108.578691 munmap done 000026[1] 1731346108.591309 mapwrite 0x1461d5 thru 0x150711 (0xa53d bytes) 1731346108.591586 mmap done 1731346108.612019 msync done 1731346108.612131 munmap done 000027[1] 1731346108.617181 mapread 0x009384 thru 0x010c2c (0x78a9 bytes) 1731346108.617381 mmap done 1731346108.624484 memcpy done 1731346108.624567 munmap done 000028[0] 1731346108.626194 mapread 0x1504f5 thru 0x152f89 (0x2a95 bytes) 1731346108.628393 mmap done 1731346108.636127 memcpy done 1731346108.636211 munmap done 000029[1] 1731346108.640975 write 0x17be2f thru 0x17e334 (0x2506 bytes) 1731346108.644167 write done 000030[0] 1731346108.648445 write 0x08edff thru 0x0983ab (0x95ad bytes) 1731346108.665424 write done 000031[0] 1731346108.670366 mapwrite 0x153a61 thru 0x153c39 (0x1d9 bytes) 1731346108.672732 mmap done 1731346108.694877 msync done 1731346108.694958 munmap done 000033[0] 1731346108.699992 read 0x04ecf0 thru 0x051a99 (0x2daa bytes) 1731346108.701674 read done 000034[1] 1731346108.702010 mapwrite 0x13722f thru 0x13ec5a (0x7a2c bytes) 1731346108.704045 mmap done 1731346108.734920 msync done 1731346108.735019 munmap done 000035[1] 1731346108.739286 mapwrite 0x16a207 thru 0x16e425 (0x421f bytes) 1731346108.741639 mmap done 1731346108.771400 msync done 1731346108.771496 munmap done 000038[0] 1731346108.783000 read 0x0231cc thru 0x0235f4 (0x429 bytes) 1731346108.792925 read done 000039[1] 1731346108.797252 write 0x191a9a thru 0x19801c (0x6583 bytes) 1731346108.797850 write done 000044[1] 1731346108.823608 read 0x0d0c58 thru 0x0d3345 (0x26ee bytes) 1731346108.839997 read done 000045[1] 1731346108.844521 mapwrite 0x06db7d thru 0x06e9eb (0xe6f bytes) 1731346108.844747 mmap done 1731346108.872189 msync done 1731346108.872243 munmap done 000048[0] 1731346108.873207 mapread 0x1789f5 thru 0x179fd9 (0x15e5 bytes) 1731346108.875349 mmap done 1731346108.882710 memcpy done 1731346108.882794 munmap done 000049[0] 1731346108.884248 mapwrite 0x1eea19 thru 0x1f37a3 (0x4d8b bytes) 1731346108.893120 truncate done 1731346108.893267 mmap done 1731346108.931507 msync done 1731346108.931572 munmap done 000053[1] 1731346108.943373 read 0x08eef7 thru 0x09dbab (0xecb5 bytes) 1731346108.955749 read done 000054[1] 1731346108.960320 read 0x13417d thru 0x1393c8 (0x524c bytes) 1731346108.975666 read done 000056[0] 1731346108.977309 write 0x059d68 thru 0x05a6f3 (0x98c bytes) 1731346108.991496 write done 000057[0] 1731346108.991913 read 0x058fba thru 0x06317e (0xa1c5 bytes) 1731346109.005315 read done 000058[1] 1731346109.005614 mapwrite 0x1a613a thru 0x1b4ca2 (0xeb69 bytes) 1731346109.007613 mmap done 1731346109.066712 msync done 1731346109.066870 munmap done 000060[0] 1731346109.075627 mapread 0x1e4cd5 thru 0x1f2df3 (0xe11f bytes) 1731346109.078350 mmap done 1731346109.099077 memcpy done 1731346109.099173 munmap done 000061[0] 1731346109.103403 mapread 0x157795 thru 0x15cc38 (0x54a4 bytes) 1731346109.103609 mmap done 1731346109.112211 memcpy done 1731346109.112277 munmap done 000062[1] 1731346109.117454 mapwrite 0x0a0252 thru 0x0a76ba (0x7469 bytes) 1731346109.119608 mmap done 1731346109.141899 msync done 1731346109.141985 munmap done 000063[0] 1731346109.145709 trunc from 0x1f37a4 to 0x040440 (0x1b3363 bytes) 1731346109.153219 truncate done 000064[1] 1731346109.157467 read 0x029eb8 thru 0x0379fc (0xdb45 bytes) 1731346109.163712 read done 000067[0] 1731346109.175773 write 0x00d87f thru 0x010ec6 (0x3648 bytes) 1731346109.182852 write done 000068[1] 1731346109.183168 mapread 0x0098c6 thru 0x012947 (0x9082 bytes) 1731346109.185844 mmap done 1731346109.203476 memcpy done 1731346109.203539 munmap done 000073[1] 1731346109.220213 mapread 0x02e89d thru 0x036272 (0x79d6 bytes) 1731346109.222443 mmap done 1731346109.236398 memcpy done 1731346109.236462 munmap done 000076[1] 1731346109.250344 read 0x02c537 thru 0x031f08 (0x59d2 bytes) 1731346109.254401 read done 000079[0] 1731346109.265671 mapread 0x022701 thru 0x02f348 (0xcc48 bytes) 1731346109.265909 mmap done 1731346109.282974 memcpy done 1731346109.283040 munmap done 000080[1] 1731346109.283444 mapread 0x0293f0 thru 0x0373d7 (0xdfe8 bytes) 1731346109.285675 mmap done 1731346109.285765 memcpy done 1731346109.285790 munmap done 000083[0] 1731346109.289939 mapread 0x03c197 thru 0x040440 (0x42aa bytes) 1731346109.290109 mmap done 1731346109.296022 memcpy done 1731346109.296088 munmap done 000084[1] 1731346109.296343 write 0x0ef2cc thru 0x0f99cc (0xa701 bytes) 1731346109.299924 write done 000085[0] 1731346109.303793 write 0x04424a thru 0x044b3f (0x8f6 bytes) 1731346109.311454 write done 000086[1] 1731346109.311788 mapwrite 0x01f1f6 thru 0x025869 (0x6674 bytes) 1731346109.314122 mmap done 1731346109.370333 msync done 1731346109.370423 munmap done 000088[1] 1731346109.379391 trunc from 0x0f99cd to 0x0ec9a8 (0xd024 bytes) 1731346109.386675 truncate done truncating to largest ever: 0x19c5d0 000089[0] 1731346109.392128 trunc from 0x0ec9a9 to 0x19c5cf (0xafc27 bytes) 1731346109.399161 truncate done 000092[1] 1731346109.411635 read 0x0e7952 thru 0x0ec649 (0x4cf8 bytes) 1731346109.423036 read done 000094[1] 1731346109.428851 trunc from 0x19c5d0 to 0x023e1d (0x1787b2 bytes) 1731346109.437516 truncate done 000096[1] 1731346109.439196 trunc from 0x023e1e to 0x11c277 (0xf845a bytes) 1731346109.441674 truncate done 000098[0] 1731346109.447624 write 0x0ad6c5 thru 0x0b7d95 (0xa6d1 bytes) 1731346109.450586 write done 000099[0] 1731346109.454694 trunc from 0x11c278 to 0x05016d (0xcc10a bytes) 1731346109.461715 truncate done 000100[0] 1731346109.463376 mapwrite 0x0fd7c0 thru 0x10a137 (0xc978 bytes) 1731346109.466415 truncate done 1731346109.466597 mmap done LOG DUMP (82 total operations): 1[18446744073708709887]: 1731346108.422465 SKIPPED (no operation) 2[0]: 1731346108.426540 MAPWRITE 0x11880a thru 0x1274f6 (0x0eced bytes) 3[0]: 1731346108.468865 READ 0x721c6 thru 0x7fee9 (0x0dd24 bytes) 4[0]: 1731346108.491968 SKIPPED (no operation) 5[0]: 1731346108.492310 MAPREAD 0x39d19 thru 0x4542f (0x0b717 bytes) 6[0]: 1731346108.504986 SKIPPED (no operation) 7[1]: 1731346108.512054 MAPREAD 0xf137d thru 0xf6498 (0x0511c bytes) 8[0]: 1731346108.533752 TRUNC_DN 0x1274f7 to 0xf6790 9[0]: 1731346108.541107 SKIPPED (no operation) 10[0]: 1731346108.541360 WRITE 0x086f5 thru 0x0c2a3 (0x03baf bytes) 11[0]: 1731346108.548656 SKIPPED (no operation) 12[0]: 1731346108.552331 SKIPPED (no operation) 13[0]: 1731346108.552498 SKIPPED (no operation) 14[0]: 1731346108.552701 SKIPPED (no operation) 15[1]: 1731346108.552964 TRUNC_UP 0xf6790 to 0x178313 16[1]: 1731346108.568678 SKIPPED (no operation) 17[1]: 1731346108.573013 MAPREAD 0x146e4b thru 0x15473e (0x0d8f4 bytes) 18[1]: 1731346108.587589 SKIPPED (no operation) 19[1]: 1731346108.591309 MAPWRITE 0x1461d5 thru 0x150711 (0x0a53d bytes) 20[1]: 1731346108.617181 MAPREAD 0x09384 thru 0x10c2c (0x078a9 bytes) 21[0]: 1731346108.626194 MAPREAD 0x1504f5 thru 0x152f89 (0x02a95 bytes) 22[1]: 1731346108.640975 WRITE 0x17be2f thru 0x17e334 (0x02506 bytes) HOLE 23[0]: 1731346108.648445 WRITE 0x8edff thru 0x983ab (0x095ad bytes) 24[0]: 1731346108.670366 MAPWRITE 0x153a61 thru 0x153c39 (0x001d9 bytes) 25[0]: 1731346108.695326 SKIPPED (no operation) 26[0]: 1731346108.699992 READ 0x4ecf0 thru 0x51a99 (0x02daa bytes) 27[1]: 1731346108.702010 MAPWRITE 0x13722f thru 0x13ec5a (0x07a2c bytes) 28[1]: 1731346108.739286 MAPWRITE 0x16a207 thru 0x16e425 (0x0421f bytes) 29[1]: 1731346108.779560 SKIPPED (no operation) 30[1]: 1731346108.783000 READ 0x231cc thru 0x235f4 (0x00429 bytes) 31[1]: 1731346108.797252 WRITE 0x191a9a thru 0x19801c (0x06583 bytes) HOLE 32[1]: 1731346108.805365 SKIPPED (no operation) 33[1]: 1731346108.814123 SKIPPED (no operation) 34[1]: 1731346108.818874 SKIPPED (no operation) 35[1]: 1731346108.823608 READ 0xd0c58 thru 0xd3345 (0x026ee bytes) 36[1]: 1731346108.844521 MAPWRITE 0x6db7d thru 0x6e9eb (0x00e6f bytes) 37[1]: 1731346108.872598 SKIPPED (no operation) 38[0]: 1731346108.873207 MAPREAD 0x1789f5 thru 0x179fd9 (0x015e5 bytes) 39[0]: 1731346108.884248 MAPWRITE 0x1eea19 thru 0x1f37a3 (0x04d8b bytes) 40[0]: 1731346108.937373 SKIPPED (no operation) 41[0]: 1731346108.943201 SKIPPED (no operation) 42[0]: 1731346108.943373 READ 0x8eef7 thru 0x9dbab (0x0ecb5 bytes) 43[0]: 1731346108.960320 READ 0x13417d thru 0x1393c8 (0x0524c bytes) 44[0]: 1731346108.977309 WRITE 0x59d68 thru 0x5a6f3 (0x0098c bytes) 45[0]: 1731346108.991913 READ 0x58fba thru 0x6317e (0x0a1c5 bytes) 46[1]: 1731346109.005614 MAPWRITE 0x1a613a thru 0x1b4ca2 (0x0eb69 bytes) 47[0]: 1731346109.075627 MAPREAD 0x1e4cd5 thru 0x1f2df3 (0x0e11f bytes) 48[0]: 1731346109.103403 MAPREAD 0x157795 thru 0x15cc38 (0x054a4 bytes) 49[1]: 1731346109.117454 MAPWRITE 0xa0252 thru 0xa76ba (0x07469 bytes) 50[0]: 1731346109.145709 TRUNC_DN 0x1f37a4 to 0x40441 51[0]: 1731346109.157467 READ 0x29eb8 thru 0x379fc (0x0db45 bytes) 52[0]: 1731346109.172691 SKIPPED (no operation) 53[0]: 1731346109.175773 WRITE 0x0d87f thru 0x10ec6 (0x03648 bytes) 54[1]: 1731346109.183168 MAPREAD 0x098c6 thru 0x12947 (0x09082 bytes) 55[1]: 1731346109.208021 SKIPPED (no operation) 56[1]: 1731346109.214578 SKIPPED (no operation) 57[1]: 1731346109.214890 SKIPPED (no operation) 58[1]: 1731346109.220213 MAPREAD 0x2e89d thru 0x36272 (0x079d6 bytes) 59[1]: 1731346109.250344 READ 0x2c537 thru 0x31f08 (0x059d2 bytes) 60[1]: 1731346109.260995 SKIPPED (no operation) 61[1]: 1731346109.265342 SKIPPED (no operation) 62[0]: 1731346109.265671 MAPREAD 0x22701 thru 0x2f348 (0x0cc48 bytes) 63[1]: 1731346109.283444 MAPREAD 0x293f0 thru 0x373d7 (0x0dfe8 bytes) 64[1]: 1731346109.286053 SKIPPED (no operation) 65[0]: 1731346109.289939 MAPREAD 0x3c197 thru 0x40440 (0x042aa bytes) 66[1]: 1731346109.296343 WRITE 0xef2cc thru 0xf99cc (0x0a701 bytes) HOLE 67[0]: 1731346109.303793 WRITE 0x4424a thru 0x44b3f (0x008f6 bytes) 68[1]: 1731346109.311788 MAPWRITE 0x1f1f6 thru 0x25869 (0x06674 bytes) 69[1]: 1731346109.375397 SKIPPED (no operation) 70[1]: 1731346109.379391 TRUNC_DN 0xf99cd to 0xec9a9 71[0]: 1731346109.392128 TRUNC_UP 0xec9a9 to 0x19c5d0 72[0]: 1731346109.403868 SKIPPED (no operation) 73[0]: 1731346109.408324 SKIPPED (no operation) 74[0]: 1731346109.411635 READ 0xe7952 thru 0xec649 (0x04cf8 bytes) 75[0]: 1731346109.426743 SKIPPED (no operation) 76[1]: 1731346109.428851 TRUNC_DN 0x19c5d0 to 0x23e1e 77[1]: 1731346109.438909 SKIPPED (no operation) 78[1]: 1731346109.439196 TRUNC_UP 0x23e1e to 0x11c278 79[1]: 1731346109.446355 SKIPPED (no operation) 80[0]: 1731346109.447624 WRITE 0xad6c5 thru 0xb7d95 (0x0a6d1 bytes) 81[0]: 1731346109.454694 TRUNC_DN 0x11c278 to 0x5016e 82[0]: 1731346109.463376 MAPWRITE 0xfd7c0 thru 0x10a137 (0x0c978 bytes) Using seed 6108 Correct content saved for comparison (maybe hexdump "/mnt/lustre/ffsx.sanity-dom" vs "/mnt/lustre/ffsx.sanity-dom.fsxgood") sanity-dom test_fsx: @@@@@@ FAIL: test_fsx failed with 229 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7439:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-dom.sh:180:main() Dumping lctl log to /tmp/testlogs//sanity-dom.test_fsx.*.1731346109.log rsync: chown "/tmp/testlogs/.sanity-dom.test_fsx.debug_log.oleg310-server.1731346109.log.N30aE0" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-dom.test_fsx.dmesg.oleg310-server.1731346109.log.qWiA8G" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]