-----============= acceptance-small: sanity ============----- Fri Apr 10 21:35:28 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg334-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34681859 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34681859 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34681859 > 34616886) for LU-14590, go 0d - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34681859 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34681859 <= 34681859) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34681859 < 34486116) for LU-14927, skip 0f excepting tests: 42a 42c 42b 118c 118d 407 119i 817 411a skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 === sanity: start setup 21:35:55 (1775871355) === oleg334-client.virtnet: executing check_config_client /mnt/lustre oleg334-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg334-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8c5cc4cac800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8c5cc4cac800.idle_timeout=debug disable quota as required oleg334-server: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity: finish setup 21:36:29 (1775871389) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7458] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 == sanity test 920: Test multy LUFID ===================== 21:36:51 (1775871411) /dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime) /dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime) 192.168.203.134@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) fail_loc=0x1507 [0x200000401:0x4:0x0] File: /mnt/lustre/d920.sanity/f920.sanity Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502276 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-10 21:36:54.000000000 -0400 Modify: 2026-04-10 21:36:54.000000000 -0400 Change: 2026-04-10 21:36:54.000000000 -0400 Birth: 2026-04-10 21:36:53.000000000 -0400 PASS 920 (8s) == sanity test 930: Check sparse read optimization (SRO) produces expected behavior ========================================================== 21:36:59 (1775871419) console_ratelimit=0 console_ratelimit=0 osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=4 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=4 Testing "4096 d10 s1 d2" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s1_d2 0+1 records in 0+1 records out 53248 bytes (53 kB, 52 KiB) copied, 0.11082 s, 480 kB/s real 0m0.151s user 0m0.001s sys 0m0.020s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s1_d2 0+1 records in 0+1 records out 53248 bytes (53 kB, 52 KiB) copied, 0.0920097 s, 579 kB/s real 0m0.131s user 0m0.000s sys 0m0.020s Testing "65536 d1 s1 d1" Read /mnt/lustre/d930.sanity/sparse_65536_d1_s1_d1 0+1 records in 0+1 records out 196608 bytes (197 kB, 192 KiB) copied, 0.0759291 s, 2.6 MB/s real 0m0.102s user 0m0.000s sys 0m0.026s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_65536_d1_s1_d1 0+1 records in 0+1 records out 196608 bytes (197 kB, 192 KiB) copied, 0.116655 s, 1.7 MB/s real 0m0.149s user 0m0.000s sys 0m0.022s Testing "4096 d10 s10 d2" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s10_d2 0+1 records in 0+1 records out 90112 bytes (90 kB, 88 KiB) copied, 0.0714998 s, 1.3 MB/s real 0m0.099s user 0m0.001s sys 0m0.018s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s10_d2 0+1 records in 0+1 records out 90112 bytes (90 kB, 88 KiB) copied, 0.0873503 s, 1.0 MB/s real 0m0.139s user 0m0.000s sys 0m0.022s Testing "65536 d1 s2 d2" Read /mnt/lustre/d930.sanity/sparse_65536_d1_s2_d2 0+1 records in 0+1 records out 327680 bytes (328 kB, 320 KiB) copied, 0.132173 s, 2.5 MB/s real 0m0.177s user 0m0.000s sys 0m0.030s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_65536_d1_s2_d2 0+1 records in 0+1 records out 327680 bytes (328 kB, 320 KiB) copied, 0.137888 s, 2.4 MB/s real 0m0.168s user 0m0.002s sys 0m0.031s osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=0 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=0 Testing "4096 d10 s10 d2" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s10_d2 0+1 records in 0+1 records out 90112 bytes (90 kB, 88 KiB) copied, 0.0461311 s, 2.0 MB/s real 0m0.063s user 0m0.000s sys 0m0.014s Should get 0 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s10_d2 0+1 records in 0+1 records out 90112 bytes (90 kB, 88 KiB) copied, 0.0418825 s, 2.2 MB/s real 0m0.062s user 0m0.001s sys 0m0.013s osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=12 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=12 Testing "4096 d10 s2 d2" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s2_d2 0+1 records in 0+1 records out 57344 bytes (57 kB, 56 KiB) copied, 0.0929921 s, 617 kB/s real 0m0.121s user 0m0.001s sys 0m0.016s Should get 0 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s2_d2 0+1 records in 0+1 records out 57344 bytes (57 kB, 56 KiB) copied, 0.0684262 s, 838 kB/s real 0m0.105s user 0m0.000s sys 0m0.019s Testing "4096 d10 s3 d2" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s3_d2 0+1 records in 0+1 records out 61440 bytes (61 kB, 60 KiB) copied, 0.0666489 s, 922 kB/s real 0m0.092s user 0m0.002s sys 0m0.016s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s3_d2 0+1 records in 0+1 records out 61440 bytes (61 kB, 60 KiB) copied, 0.0357996 s, 1.7 MB/s real 0m0.049s user 0m0.001s sys 0m0.013s Testing "4096 d10 s4 d2" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s4_d2 0+1 records in 0+1 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0435119 s, 1.5 MB/s real 0m0.072s user 0m0.001s sys 0m0.015s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s4_d2 0+1 records in 0+1 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0508581 s, 1.3 MB/s real 0m0.069s user 0m0.001s sys 0m0.015s osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=4 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=4 Testing "4096 s10" Read /mnt/lustre/d930.sanity/sparse_4096_s10 0+1 records in 0+1 records out 40960 bytes (41 kB, 40 KiB) copied, 0.0379498 s, 1.1 MB/s real 0m0.069s user 0m0.001s sys 0m0.015s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_s10 0+1 records in 0+1 records out 40960 bytes (41 kB, 40 KiB) copied, 0.0561177 s, 730 kB/s real 0m0.075s user 0m0.001s sys 0m0.013s Testing "4096 d10 s1" Read /mnt/lustre/d930.sanity/sparse_4096_d10_s1 0+1 records in 0+1 records out 45056 bytes (45 kB, 44 KiB) copied, 0.0412237 s, 1.1 MB/s real 0m0.057s user 0m0.001s sys 0m0.010s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d10_s1 0+1 records in 0+1 records out 45056 bytes (45 kB, 44 KiB) copied, 0.060748 s, 742 kB/s real 0m0.090s user 0m0.001s sys 0m0.013s Testing "4096 s1 d10" Read /mnt/lustre/d930.sanity/sparse_4096_s1_d10 0+1 records in 0+1 records out 45056 bytes (45 kB, 44 KiB) copied, 0.0756756 s, 595 kB/s real 0m0.114s user 0m0.001s sys 0m0.013s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_s1_d10 0+1 records in 0+1 records out 45056 bytes (45 kB, 44 KiB) copied, 0.0721199 s, 625 kB/s real 0m0.103s user 0m0.001s sys 0m0.018s Testing "1 d1 s4096 d8192" Read /mnt/lustre/d930.sanity/sparse_1_d1_s4096_d8192 0+1 records in 0+1 records out 12289 bytes (12 kB, 12 KiB) copied, 0.0347559 s, 354 kB/s real 0m0.059s user 0m0.001s sys 0m0.012s Should get 0 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_1_d1_s4096_d8192 0+1 records in 0+1 records out 12289 bytes (12 kB, 12 KiB) copied, 0.0452455 s, 272 kB/s real 0m0.077s user 0m0.001s sys 0m0.013s Testing "1 d1 s8190 d12288" Read /mnt/lustre/d930.sanity/sparse_1_d1_s8190_d12288 0+1 records in 0+1 records out 20479 bytes (20 kB, 20 KiB) copied, 0.0708791 s, 289 kB/s real 0m0.109s user 0m0.001s sys 0m0.018s Should get 0 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_1_d1_s8190_d12288 0+1 records in 0+1 records out 20479 bytes (20 kB, 20 KiB) copied, 0.0493429 s, 415 kB/s real 0m0.085s user 0m0.001s sys 0m0.017s Testing "1 d1 s8191 d12288" Read /mnt/lustre/d930.sanity/sparse_1_d1_s8191_d12288 0+1 records in 0+1 records out 20480 bytes (20 kB, 20 KiB) copied, 0.0440183 s, 465 kB/s real 0m0.061s user 0m0.000s sys 0m0.014s Should get 1 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_1_d1_s8191_d12288 0+1 records in 0+1 records out 20480 bytes (20 kB, 20 KiB) copied, 0.0531615 s, 385 kB/s real 0m0.077s user 0m0.000s sys 0m0.013s Testing "4096 d200 s56 r5" Read /mnt/lustre/d930.sanity/sparse_4096_d200_s56_r5 1+1 records in 1+1 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.779545 s, 6.7 MB/s real 0m0.807s user 0m0.000s sys 0m0.252s Should get 5 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_d200_s56_r5 1+1 records in 1+1 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.947098 s, 5.5 MB/s real 0m0.971s user 0m0.000s sys 0m0.238s Testing "4096 s200 d56 r5" Read /mnt/lustre/d930.sanity/sparse_4096_s200_d56_r5 1+1 records in 1+1 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.846914 s, 6.2 MB/s real 0m0.863s user 0m0.000s sys 0m0.231s Should get 5 sparse put messages Read /mnt/lustre/d930.sanity/nosparse_4096_s200_d56_r5 1+1 records in 1+1 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.95174 s, 5.5 MB/s real 0m0.970s user 0m0.000s sys 0m0.260s osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=64 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=64 PASS 930 (141s) == sanity test 931: Check SRO leads to less transferred data ========================================================== 21:39:21 (1775871561) osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=4 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=4 sparse 1 Testing "4096 s1 d255 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s1_d255_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.07799 s, 8.6 MB/s real 0m6.114s user 0m0.002s sys 0m2.209s Read /mnt/lustre/d931.sanity/nosparse_4096_s1_d255_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 5.54306 s, 9.5 MB/s real 0m5.574s user 0m0.003s sys 0m2.195s Data ratio is .99613585237271754328 sparse 2 Testing "4096 s2 d254 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s2_d254_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 7.09158 s, 7.4 MB/s real 0m7.158s user 0m0.001s sys 0m2.216s Read /mnt/lustre/d931.sanity/nosparse_4096_s2_d254_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.65497 s, 7.9 MB/s real 0m6.688s user 0m0.000s sys 0m2.196s Data ratio is .99223138892295639217 sparse 4 Testing "4096 s4 d252 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s4_d252_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.98266 s, 7.5 MB/s real 0m7.007s user 0m0.002s sys 0m2.094s Read /mnt/lustre/d931.sanity/nosparse_4096_s4_d252_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.4378 s, 8.1 MB/s real 0m6.464s user 0m0.000s sys 0m2.229s Data ratio is .98440636810655882388 sparse 8 Testing "4096 s8 d248 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s8_d248_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 7.45343 s, 7.0 MB/s real 0m7.514s user 0m0.000s sys 0m2.228s Read /mnt/lustre/d931.sanity/nosparse_4096_s8_d248_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.42717 s, 8.2 MB/s real 0m6.471s user 0m0.001s sys 0m2.129s Data ratio is .96879633662694147558 sparse 16 Testing "4096 s16 d240 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s16_d240_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.74881 s, 7.8 MB/s real 0m6.775s user 0m0.001s sys 0m2.247s Read /mnt/lustre/d931.sanity/nosparse_4096_s16_d240_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 7.58005 s, 6.9 MB/s real 0m7.605s user 0m0.001s sys 0m2.008s Data ratio is .93754316578208120590 sparse 32 Testing "4096 s32 d224 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s32_d224_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.52588 s, 8.0 MB/s real 0m6.579s user 0m0.001s sys 0m2.109s Read /mnt/lustre/d931.sanity/nosparse_4096_s32_d224_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.74382 s, 7.8 MB/s real 0m6.777s user 0m0.001s sys 0m2.204s Data ratio is .87506886398792174091 sparse 64 Testing "4096 s64 d192 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s64_d192_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 7.61936 s, 6.9 MB/s real 0m7.646s user 0m0.002s sys 0m2.330s Read /mnt/lustre/d931.sanity/nosparse_4096_s64_d192_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.01843 s, 8.7 MB/s real 0m6.041s user 0m0.001s sys 0m2.292s Data ratio is .75008768668414958867 sparse 128 Testing "4096 s128 d128 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s128_d128_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.85983 s, 7.6 MB/s real 0m6.897s user 0m0.000s sys 0m2.253s Read /mnt/lustre/d931.sanity/nosparse_4096_s128_d128_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 7.478 s, 7.0 MB/s real 0m7.554s user 0m0.000s sys 0m2.357s Data ratio is .50012319564154416392 sparse 256 Testing "4096 s256 d0 r50" Read /mnt/lustre/d931.sanity/sparse_4096_s256_d0_r50 0+0 records in 0+0 records out 0 bytes copied, 0.0151902 s, 0.0 kB/s real 0m0.049s user 0m0.001s sys 0m0.013s Read /mnt/lustre/d931.sanity/nosparse_4096_s256_d0_r50 12+1 records in 12+1 records out 52428800 bytes (52 MB, 50 MiB) copied, 6.05437 s, 8.7 MB/s real 0m6.096s user 0m0.001s sys 0m2.414s Data ratio is .00002868220377576802 osc.lustre-OST0000-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=64 osc.lustre-OST0001-osc-ffff8c5cc4cac800.sparse_read_threshold_kb=64 PASS 931 (1963s) == sanity test complete, duration 2194 sec =============== 22:12:04 (1775873524) === sanity: start cleanup 22:12:06 (1775873526) === === sanity: finish cleanup 22:12:10 (1775873530) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck