== sanityn test 16a: 500 iterations of dual-mount fsx ==== 12:31:39 (1731346299) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.31625 s, 26.5 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.286946 s, 29.2 MB/s Chance of close/open is 1 in 50 Seed set to 6301 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000005[1] 1731346301.334608 write 0x48957b thru 0x497b16 (0xe59c bytes) truncating to largest ever: 0x349fcd 000007[0] 1731346301.340200 trunc from 0x497b17 to 0x349fcc (0x14db4a bytes) 000011[1] 1731346301.357373 write 0x6bc4c4 thru 0x6c92e1 (0xce1e bytes) 000012[1] 1731346301.374995 mapwrite 0x829180 thru 0x831e50 (0x8cd1 bytes) 000013[1] 1731346301.412870 mapread 0x508cde thru 0x517d74 (0xf097 bytes) 000014[1] 1731346301.424186 read 0x06547f thru 0x073bcc (0xe74e bytes) truncating to largest ever: 0x3fc2ab 000015[0] 1731346301.426990 trunc from 0x831e51 to 0x3fc2aa (0x435ba6 bytes) 000018[0] 1731346301.444204 read 0x233193 thru 0x23d027 (0x9e95 bytes) 000019[0] 1731346301.450126 read 0x32f3c5 thru 0x337518 (0x8154 bytes) 000020[1] 1731346301.476908 read 0x299941 thru 0x2a7d54 (0xe414 bytes) 000021[0] 1731346301.508136 trunc from 0x3fc2ab to 0x0c6101 (0x3361a9 bytes) 000022[0] 1731346301.522021 read 0x03596b thru 0x043d69 (0xe3ff bytes) 000023[1] 1731346301.531942 mapread 0x0594d7 thru 0x05ec30 (0x575a bytes) truncating to largest ever: 0x5c474f 000024[1] 1731346301.547210 trunc from 0x0c6102 to 0x5c474e (0x4fe64d bytes) 000027[1] 1731346301.556799 mapwrite 0x86d8ba thru 0x87033f (0x2a86 bytes) 000028[0] 1731346301.623991 mapwrite 0x53d8ea thru 0x54036b (0x2a82 bytes) 000032[1] 1731346301.691895 read 0x6c3fbe thru 0x6d2ced (0xed30 bytes) 000033[1] 1731346301.724520 read 0x4b1798 thru 0x4bae48 (0x96b1 bytes) truncating to largest ever: 0x862b93 000035[0] 1731346301.732829 trunc from 0x870340 to 0x862b92 (0xd7ad bytes) 000036[1] 1731346301.747984 read 0x0e54f4 thru 0x0f1792 (0xc29f bytes) 000037[1] 1731346301.777069 trunc from 0x862b93 to 0x732ab8 (0x1300da bytes) 000039[0] 1731346301.795353 read 0x701799 thru 0x701824 (0x8c bytes) 000041[0] 1731346301.803803 mapwrite 0x166d26 thru 0x173d5d (0xd038 bytes) 000043[0] 1731346301.853426 read 0x61981a thru 0x6253ee (0xbbd5 bytes) 000044[0] 1731346301.876094 read 0x28bcca thru 0x2975eb (0xb922 bytes) 000045[0] 1731346301.879886 trunc from 0x732ab9 to 0x1596c7 (0x5d93f1 bytes) 000048[1] 1731346301.898472 write 0x97e36a thru 0x982c00 (0x4897 bytes) 000049[0] 1731346301.908089 write 0x0e9d43 thru 0x0f9752 (0xfa10 bytes) 000053[0] 1731346301.942830 write 0x2d5cf4 thru 0x2de26c (0x8579 bytes) 000056[1] 1731346301.961715 mapread 0x4aa774 thru 0x4adf9b (0x3828 bytes) 000057[0] 1731346301.977912 mapread 0x3c379b thru 0x3d1a3e (0xe2a4 bytes) 000058[0] 1731346301.982063 mapread 0x1d31ea thru 0x1d444f (0x1266 bytes) 000060[1] 1731346301.985767 mapwrite 0x558f15 thru 0x560edf (0x7fcb bytes) 000062[1] 1731346302.057606 write 0x21d6df thru 0x21f9d3 (0x22f5 bytes) 000064[0] 1731346302.079375 trunc from 0x982c01 to 0x69b279 (0x2e7987 bytes) 000067[1] 1731346302.098733 read 0x4691ff thru 0x476aac (0xd8ae bytes) truncating to largest ever: 0x942ba0 000068[1] 1731346302.117173 trunc from 0x69b27a to 0x942b9f (0x2a7926 bytes) 000070[0] 1731346302.129300 write 0x2786c5 thru 0x280095 (0x79d1 bytes) 000071[1] 1731346302.137222 write 0x5f32d8 thru 0x5fec56 (0xb97f bytes) 000072[0] 1731346302.143159 mapread 0x69d641 thru 0x6ab806 (0xe1c6 bytes) 000076[1] 1731346302.179856 trunc from 0x942ba0 to 0x5deb0a (0x364095 bytes) 000077[0] 1731346302.193934 mapread 0x06f226 thru 0x078140 (0x8f1b bytes) 000083[0] 1731346302.219622 trunc from 0x5deb0b to 0x8809e5 (0x2a1edb bytes) 000084[0] 1731346302.231360 read 0x7d6c65 thru 0x7db36a (0x4706 bytes) 000089[1] 1731346302.273435 write 0x1aca8a thru 0x1af831 (0x2da8 bytes) 000091[0] 1731346302.310517 trunc from 0x8809e6 to 0x0ccd83 (0x7b3c62 bytes) 000092[1] 1731346302.325488 write 0x167e16 thru 0x17759c (0xf787 bytes) 000093[1] 1731346302.332446 mapwrite 0x475f5f thru 0x47cd5c (0x6dfe bytes) LOG DUMP (73 total operations): 1[0]: 1731346301.325418 SKIPPED (no operation) 2[0]: 1731346301.329681 SKIPPED (no operation) 3[0]: 1731346301.334324 SKIPPED (no operation) 4[1]: 1731346301.334608 WRITE 0x48957b thru 0x497b16 (0x0e59c bytes) HOLE 5[1]: 1731346301.339876 SKIPPED (no operation) 6[0]: 1731346301.340200 TRUNC_DN 0x497b17 to 0x349fcd 7[0]: 1731346301.352857 SKIPPED (no operation) 8[0]: 1731346301.355836 SKIPPED (no operation) 9[0]: 1731346301.357189 SKIPPED (no operation) 10[1]: 1731346301.357373 WRITE 0x6bc4c4 thru 0x6c92e1 (0x0ce1e bytes) HOLE 11[1]: 1731346301.374995 MAPWRITE 0x829180 thru 0x831e50 (0x08cd1 bytes) 12[1]: 1731346301.412870 MAPREAD 0x508cde thru 0x517d74 (0x0f097 bytes) 13[1]: 1731346301.424186 READ 0x6547f thru 0x73bcc (0x0e74e bytes) 14[0]: 1731346301.426990 TRUNC_DN 0x831e51 to 0x3fc2ab 15[0]: 1731346301.444204 READ 0x233193 thru 0x23d027 (0x09e95 bytes) 16[0]: 1731346301.450126 READ 0x32f3c5 thru 0x337518 (0x08154 bytes) 17[0]: 1731346301.476908 READ 0x299941 thru 0x2a7d54 (0x0e414 bytes) 18[0]: 1731346301.508136 TRUNC_DN 0x3fc2ab to 0xc6102 19[0]: 1731346301.522021 READ 0x3596b thru 0x43d69 (0x0e3ff bytes) 20[1]: 1731346301.531942 MAPREAD 0x594d7 thru 0x5ec30 (0x0575a bytes) 21[1]: 1731346301.547210 TRUNC_UP 0xc6102 to 0x5c474f 22[1]: 1731346301.556799 MAPWRITE 0x86d8ba thru 0x87033f (0x02a86 bytes) 23[0]: 1731346301.623991 MAPWRITE 0x53d8ea thru 0x54036b (0x02a82 bytes) 24[0]: 1731346301.688895 SKIPPED (no operation) 25[0]: 1731346301.691895 READ 0x6c3fbe thru 0x6d2ced (0x0ed30 bytes) 26[0]: 1731346301.724520 READ 0x4b1798 thru 0x4bae48 (0x096b1 bytes) 27[0]: 1731346301.732829 TRUNC_DN 0x870340 to 0x862b93 28[0]: 1731346301.747984 READ 0xe54f4 thru 0xf1792 (0x0c29f bytes) 29[1]: 1731346301.777069 TRUNC_DN 0x862b93 to 0x732ab9 30[1]: 1731346301.792129 SKIPPED (no operation) 31[1]: 1731346301.795353 READ 0x701799 thru 0x701824 (0x0008c bytes) 32[0]: 1731346301.803803 MAPWRITE 0x166d26 thru 0x173d5d (0x0d038 bytes) 33[0]: 1731346301.853426 READ 0x61981a thru 0x6253ee (0x0bbd5 bytes) 34[0]: 1731346301.876094 READ 0x28bcca thru 0x2975eb (0x0b922 bytes) 35[0]: 1731346301.879886 TRUNC_DN 0x732ab9 to 0x1596c8 36[0]: 1731346301.893065 SKIPPED (no operation) 37[1]: 1731346301.898472 WRITE 0x97e36a thru 0x982c00 (0x04897 bytes) HOLE 38[0]: 1731346301.908089 WRITE 0xe9d43 thru 0xf9752 (0x0fa10 bytes) 39[0]: 1731346301.932039 SKIPPED (no operation) 40[0]: 1731346301.936019 SKIPPED (no operation) 41[0]: 1731346301.939341 SKIPPED (no operation) 42[0]: 1731346301.942830 WRITE 0x2d5cf4 thru 0x2de26c (0x08579 bytes) 43[1]: 1731346301.961715 MAPREAD 0x4aa774 thru 0x4adf9b (0x03828 bytes) 44[0]: 1731346301.977912 MAPREAD 0x3c379b thru 0x3d1a3e (0x0e2a4 bytes) 45[0]: 1731346301.982063 MAPREAD 0x1d31ea thru 0x1d444f (0x01266 bytes) 46[0]: 1731346301.982494 SKIPPED (no operation) 47[1]: 1731346301.985767 MAPWRITE 0x558f15 thru 0x560edf (0x07fcb bytes) 48[1]: 1731346302.057606 WRITE 0x21d6df thru 0x21f9d3 (0x022f5 bytes) 49[1]: 1731346302.075790 SKIPPED (no operation) 50[0]: 1731346302.079375 TRUNC_DN 0x982c01 to 0x69b27a 51[0]: 1731346302.091964 SKIPPED (no operation) 52[0]: 1731346302.098733 READ 0x4691ff thru 0x476aac (0x0d8ae bytes) 53[1]: 1731346302.117173 TRUNC_UP 0x69b27a to 0x942ba0 54[1]: 1731346302.124985 SKIPPED (no operation) 55[0]: 1731346302.129300 WRITE 0x2786c5 thru 0x280095 (0x079d1 bytes) 56[1]: 1731346302.137222 WRITE 0x5f32d8 thru 0x5fec56 (0x0b97f bytes) 57[0]: 1731346302.143159 MAPREAD 0x69d641 thru 0x6ab806 (0x0e1c6 bytes) 58[0]: 1731346302.176443 SKIPPED (no operation) 59[0]: 1731346302.179668 SKIPPED (no operation) 60[1]: 1731346302.179856 TRUNC_DN 0x942ba0 to 0x5deb0b 61[0]: 1731346302.193934 MAPREAD 0x6f226 thru 0x78140 (0x08f1b bytes) 62[0]: 1731346302.208718 SKIPPED (no operation) 63[0]: 1731346302.216683 SKIPPED (no operation) 64[0]: 1731346302.219622 TRUNC_UP 0x5deb0b to 0x8809e6 65[0]: 1731346302.231360 READ 0x7d6c65 thru 0x7db36a (0x04706 bytes) 66[0]: 1731346302.271064 SKIPPED (no operation) 67[0]: 1731346302.272598 SKIPPED (no operation) 68[0]: 1731346302.272878 SKIPPED (no operation) 69[0]: 1731346302.273155 SKIPPED (no operation) 70[1]: 1731346302.273435 WRITE 0x1aca8a thru 0x1af831 (0x02da8 bytes) 71[0]: 1731346302.310517 TRUNC_DN 0x8809e6 to 0xccd84 72[1]: 1731346302.325488 WRITE 0x167e16 thru 0x17759c (0x0f787 bytes) HOLE 73[1]: 1731346302.332446 MAPWRITE 0x475f5f thru 0x47cd5c (0x06dfe bytes) Using seed 6301 Correct content saved for comparison (maybe hexdump "/mnt/lustre/f16a.sanityn" vs "/mnt/lustre/f16a.sanityn.fsxgood") sanityn test_16a: @@@@@@ FAIL: fsx failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7208:error() = /home/green/git/lustre-release/lustre/tests/sanityn.sh:426:test_16a() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7558:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7621:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7439:run_test() = /home/green/git/lustre-release/lustre/tests/sanityn.sh:433:main() Dumping lctl log to /tmp/testlogs//sanityn.test_16a.*.1731346302.log rsync: chown "/tmp/testlogs/.sanityn.test_16a.debug_log.oleg232-server.1731346302.log.xhC530" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanityn.test_16a.dmesg.oleg232-server.1731346302.log.ntUC0R" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]