-----============= acceptance-small: sanity ============----- Tue Apr 14 14:20:50 EDT 2026 oleg421-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34539530 < 34486116) for LU-14927, skip 0f excepting tests: 42a 42b 42c 407 118c 118d 817 411 skipping tests SLOW=no: 27m 60i 64b 68 71 115 135 136 230d 300o oleg421-client.virtnet: executing check_config_client /mnt/lustre oleg421-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg421-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff95f309b87800.idle_timeout=debug osc.lustre-OST0001-osc-ffff95f309b87800.idle_timeout=debug disable quota as required oleg421-server: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7713] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=-1 == sanity test 60a: llog_test run from kernel module and test llog_reader ========================================================== 14:21:49 (1776190909) SKIP: sanity test_60a missing subtest run-llog.sh SKIP 60a (5s) == sanity test 60b: limit repeated messages from CERROR/CWARN ========================================================== 14:21:55 (1776190915) PASS 60b (7s) == sanity test 60c: unlink file when mds full ============ 14:22:02 (1776190922) create 5000 files - open/close 650 (time 1776190936.45 total 10.01 last 64.93) - open/close 1306 (time 1776190946.46 total 20.02 last 65.54) - open/close 1930 (time 1776190956.46 total 30.03 last 62.34) - open/close 2555 (time 1776190966.47 total 40.03 last 62.48) - open/close 3242 (time 1776190976.48 total 50.04 last 68.65) - open/close 3930 (time 1776190986.48 total 60.05 last 68.73) - open/close 4596 (time 1776190996.50 total 70.07 last 66.48) total: 5000 open/close in 78.28 seconds: 63.87 ops/second fail_loc=0x80000137 - unlinked 0 (time 1776191011 ; total 0 ; last 0) total: 5000 unlinks in 47 seconds: 106.382980 unlinks/second fail_loc=0 PASS 60c (144s) == sanity test 60d: test printk console message masking == 14:24:26 (1776191066) printk=0 emerg PASS 60d (7s) == sanity test 60e: no space while new llog is being created ========================================================== 14:24:33 (1776191073) fail_loc=0x15b PASS 60e (9s) == sanity test 60f: change debug_path works ============== 14:24:42 (1776191082) debug_path=/tmp/f60f.sanity fail_loc=0x8000050e striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d60f.sanity ls: cannot access '/tmp/f60f.sanity*': No such file or directory 0 /tmp/f60f.sanity.1776191084.13270 debug_path=/tmp/lustre-log PASS 60f (8s) == sanity test 60g: transaction abort won't cause MDT hung ========================================================== 14:24:50 (1776191090) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d60g.sanity /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4341: 14023 Killed ( local index=0; while true; do $LFS setdirstripe -i $(($index % $MDSCOUNT)) -c $MDSCOUNT $DIR/$tdir/subdir$index 2> /dev/null; mkdir $DIR/$tdir/subdir$index 2> /dev/null; rmdir $DIR/$tdir/subdir$index 2> /dev/null; index=$((index + 1)); done ) Started LFSCK on the device lustre-MDT0000: scrub namespace /mnt/lustre/d60g.sanity: subdir117 subdir13 subdir145 subdir164 subdir186 subdir190 subdir2 subdir204 subdir233 subdir250 subdir257 subdir261 subdir271 subdir283 subdir295 subdir32 subdir323 subdir351 subdir58 subdir70 subdir96 /mnt/lustre/d60g.sanity/subdir117: /mnt/lustre/d60g.sanity/subdir13: /mnt/lustre/d60g.sanity/subdir145: /mnt/lustre/d60g.sanity/subdir164: /mnt/lustre/d60g.sanity/subdir186: /mnt/lustre/d60g.sanity/subdir190: /mnt/lustre/d60g.sanity/subdir2: /mnt/lustre/d60g.sanity/subdir204: /mnt/lustre/d60g.sanity/subdir233: /mnt/lustre/d60g.sanity/subdir250: ls: closing directory '/mnt/lustre/d60g.sanity/subdir250': No such file or directory /mnt/lustre/d60g.sanity/subdir257: /mnt/lustre/d60g.sanity/subdir261: /mnt/lustre/d60g.sanity/subdir271: /mnt/lustre/d60g.sanity/subdir283: /mnt/lustre/d60g.sanity/subdir295: /mnt/lustre/d60g.sanity/subdir32: /mnt/lustre/d60g.sanity/subdir323: /mnt/lustre/d60g.sanity/subdir351: /mnt/lustre/d60g.sanity/subdir58: /mnt/lustre/d60g.sanity/subdir70: /mnt/lustre/d60g.sanity/subdir96: PASS 60g (129s) == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 14:27:00 (1776191220) fail_loc=0x80000188 /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000188/2: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000188/3: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000188/4: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000188/7: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000188/8: No such device lmv_stripe_count: 2 lmv_stripe_offset: 0 lmv_hash_type: crush mdtidx FID[seq:oid:ver] 0 [0x200000400:0xc8:0x0] 0 [0:0x0:0x0] lmv_stripe_count: 3 lmv_stripe_offset: 1 lmv_hash_type: crush,migrating,fixed mdtidx FID[seq:oid:ver] 1 [0x240000400:0xc6:0x0] 0 [0x200000400:0xc8:0x0] 0 [0:0x0:0x0] /mnt/lustre/d60h.sanity-0x80000188 ~ ~ fail_loc=0x80000189 /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000189/2: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000189/3: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000189/4: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000189/7: No such device /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8676: /mnt/lustre/d60h.sanity-0x80000189/8: No such device lmv_stripe_count: 2 lmv_stripe_offset: 0 lmv_hash_type: crush mdtidx FID[seq:oid:ver] 0 [0x200000400:0xc9:0x0] 0 [0:0x0:0x0] lmv_stripe_count: 3 lmv_stripe_offset: 1 lmv_hash_type: crush,migrating,fixed mdtidx FID[seq:oid:ver] 1 [0x240000400:0xc7:0x0] 0 [0x200000400:0xc9:0x0] 0 [0:0x0:0x0] /mnt/lustre/d60h.sanity-0x80000189 ~ ~ PASS 60h (15s) SKIP: sanity test_60i skipping SLOW test 60i == sanity test 60j: llog_reader reports corruptions ====== 14:27:17 (1776191237) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0001: clear the changelog for cl1 of all records total: 100 open/close in 2.34 seconds: 42.73 ops/second - unlinked 0 (time 1776191253 ; total 0 ; last 0) total: 100 unlinks in 2 seconds: 50.000000 unlinks/second oleg421-server: debugfs 1.47.3-wc2 (11-Nov-2025) SKIP: sanity test_60j path oi.1/0x1:0xc:0x0 is not in 'O/1/d/' format lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 SKIP 60j (28s) == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 14:27:46 (1776191266) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0432389 s, 94.7 kB/s PASS 61a (7s) == sanity test 61b: mmap() of unstriped file is successful ========================================================== 14:27:54 (1776191274) PASS 61b (6s) == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 14:28:00 (1776191280) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19259 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19263 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19267 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19271 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19275 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19279 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19283 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19287 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19291 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8825: 19295 Terminated dd if=/dev/zero of=$DIR/f63 bs=8k checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3996 1283692 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2904 1284784 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 13712 3593148 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1396 3605624 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 15108 7198772 1% /mnt/lustre pass grant check: client:281862144 server:281862144 PASS 63a (71s) == sanity test 63b: async write errors should be returned to fsync ============================================================= 14:29:11 (1776191351) debug=-1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0296154 s, 138 kB/s fail_loc=0x80000406 fsync: Input/output error checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3996 1283692 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2904 1284784 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1424 3605436 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1396 3605624 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2820 7211060 1% /mnt/lustre pass grant check: client:281862144 server:281862144 PASS 63b (14s) == sanity test 64a: verify filter grant calculations (in kernel) =============================================================== 14:29:25 (1776191365) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3996 1283692 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2904 1284784 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1424 3605436 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1396 3605624 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2820 7211060 1% /mnt/lustre osc.lustre-OST0000-osc-ffff95f309b87800.cur_lost_grant_bytes=700416 osc.lustre-OST0001-osc-ffff95f309b87800.cur_lost_grant_bytes=28672 osc.lustre-OST0000-osc-ffff95f309b87800.cur_grant_bytes=197042176 osc.lustre-OST0001-osc-ffff95f309b87800.cur_grant_bytes=84090880 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3996 1283692 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2904 1284784 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1424 3605436 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1396 3605624 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2820 7211060 1% /mnt/lustre pass grant check: client:281862144 server:281862144 PASS 64a (7s) SKIP: sanity test_64b skipping SLOW test 64b == sanity test 64c: verify grant shrink ================== 14:29:34 (1776191374) osc.lustre-OST0000-osc-ffff95f309b87800.cur_grant_bytes=0 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3996 1283692 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2904 1284784 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1424 3605596 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1396 3605624 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 2820 7211220 1% /mnt/lustre pass grant check: client:281161728 server:281161728 PASS 64c (8s) == sanity test 64d: check grant limit exceed ============= 14:29:42 (1776191382) 1000+0 records in 1000+0 records out 1048576000 bytes (1.0 GB, 1000 MiB) copied, 33.1234 s, 31.7 MB/s /home/green/git/lustre-release/lustre/tests/sanity.sh: line 8954: kill: (22188) - No such process checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 3996 1283692 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2904 1284784 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1022356 2581568 29% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1396 3605624 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 1023752 6187192 15% /mnt/lustre pass grant check: client:568758272 server:568758272 Waiting for MDT destroys to complete PASS 64d (59s) == sanity test 64e: check grant consumption (no grant allocation) ========================================================== 14:30:42 (1776191442) debug=+cache Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre fail_loc=0x725 1+0 records in 1+0 records out 2338816 bytes (2.3 MB, 2.2 MiB) copied, 0.15592 s, 15.0 MB/s fail_loc=0 Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre fail_loc=0x725 fail_loc=0 PASS 64e (20s) == sanity test 64f: check grant consumption (with grant allocation) ========================================================== 14:31:01 (1776191461) debug=+cache Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 3674112 bytes (3.7 MB, 3.5 MiB) copied, 0.169814 s, 21.6 MB/s Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre fail_loc=0x50a fail_val=3 1+0 records in 1+0 records out 3674112 bytes (3.7 MB, 3.5 MiB) copied, 0.153046 s, 24.0 MB/s fail_loc=0 fail_val=0 PASS 64f (15s) == sanity test 64g: grant shrink on MDT ================== 14:31:16 (1776191476) 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0192938 s, 6.8 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0202682 s, 6.5 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0130803 s, 10.0 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0137211 s, 9.6 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0274786 s, 4.8 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.012995 s, 10.1 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0278861 s, 4.7 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0236709 s, 5.5 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.030056 s, 4.4 MB/s 1+0 records in 1+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.01534 s, 8.5 MB/s 1089536 grants, 0 pages 1089536 grants, 8 pages 1089536 grants, 8 pages 1089536 grants, 8 pages mdc.lustre-MDT0000-mdc-ffff95f318773800.grant_shrink_interval=5 mdc.lustre-MDT0001-mdc-ffff95f318773800.grant_shrink_interval=5 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 8 pages 0 grants, 0 pages mdc.lustre-MDT0000-mdc-ffff95f318773800.grant_shrink_interval=1200 mdc.lustre-MDT0001-mdc-ffff95f318773800.grant_shrink_interval=1200 PASS 64g (52s) == sanity test 64h: grant shrink on read ================= 14:32:09 (1776191529) osc.lustre-OST0000-osc-ffff95f318773800.grant_shrink=1 osc.lustre-OST0000-osc-ffff95f318773800.grant_shrink_interval=10 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 2.63818 s, 4.0 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0235347 s, 174 kB/s PASS 64h (20s) == sanity test 64i: shrink on reconnect ================== 14:32:29 (1776191549) 64+0 records in 64+0 records out 67108864 bytes (67 MB, 64 MiB) copied, 6.56021 s, 10.2 MB/s fail_loc=0x80000513 fail_val=17 osc.lustre-OST0000-osc-ffff95f318773800.cur_grant_bytes=72943616B Failing ost1 on oleg421-server Stopping /mnt/lustre-ost1 (opts:) on oleg421-server reboot facets: ost1 Failover ost1 to oleg421-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg421-server: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 pdsh@oleg421-client: oleg421-server: ssh exited with exit code 1 Started lustre-OST0000 oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.95593 s, 8.8 MB/s PASS 64i (66s) == sanity test 65a: directory with no stripe info ======== 14:33:35 (1776191615) striped dir -i1 -c2 -H all_char /mnt/lustre/d65a.sanity default stripe 1, ost count 2 PASS 65a (8s) == sanity test 65b: directory setstripe -S stripe_size*2 -i 0 -c 1 ========================================================== 14:33:44 (1776191624) striped dir -i1 -c2 -H crush /mnt/lustre/d65b.sanity dir stripe 1, default stripe 1, ost count 2 PASS 65b (7s) == sanity test 65c: directory setstripe -S stripe_size*4 -i 1 -c 1 ========================================================== 14:33:52 (1776191632) striped dir -i1 -c2 -H all_char /mnt/lustre/d65c.sanity dir stripe 1, default stripe 1, ost count 2 PASS 65c (7s) == sanity test 65d: directory setstripe -S stripe_size -c stripe_count ========================================================== 14:34:00 (1776191640) striped dir -i1 -c2 -H all_char /mnt/lustre/d65d.sanity ll_dirstripe_verify: warning: non-sequential file1 stripe[0] 0 != file2 stripe[0] 0 dir stripe 0, default stripe 1, ost count 2 PASS 65d (7s) == sanity test 65e: directory setstripe defaults ========= 14:34:07 (1776191647) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d65e.sanity (Default) /mnt/lustre/d65e.sanity default stripe 1, ost count 2 PASS 65e (7s) == sanity test 65f: dir setstripe permission (should return error) ============================================================= 14:34:14 (1776191654) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d65f.sanityf running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [/mnt/lustre/d65f.sanityf] lfs setstripe: unable to open '/mnt/lustre/d65f.sanityf': Permission denied (13) PASS 65f (8s) == sanity test 65g: directory setstripe -d =============== 14:34:22 (1776191662) striped dir -i1 -c2 -H crush /mnt/lustre/d65g.sanity (Default) /mnt/lustre/d65g.sanity PASS 65g (8s) == sanity test 65h: directory stripe info inherit ============================================================================== 14:34:31 (1776191671) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d65h.sanity striped dir -i1 -c2 -H crush /mnt/lustre/d65h.sanity/dd1 PASS 65h (7s) == sanity test 65i: various tests to set root directory striping ========================================================== 14:34:39 (1776191679) /mnt/lustre stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65b.sanity stripe_count: 1 stripe_size: 2097152 pattern: raid0 stripe_offset: 0 /mnt/lustre/d60f.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f64e.sanity lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2564 0xa04 0 /mnt/lustre/f64h.sanity lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2567 0xa07 0 /mnt/lustre/d65d.sanity stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65e.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f60b.sanity lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2 0x2 0 /mnt/lustre/d65f.sanityf stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f64f.sanity lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2566 0xa06 0 /mnt/lustre/d65c.sanity stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: 1 /mnt/lustre/f61 lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2559 0x9ff 0 /mnt/lustre/d65h.sanity stripe_count: 1 stripe_size: 2097152 pattern: raid0 stripe_offset: 0 /mnt/lustre/f63b.sanity lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2561 0xa01 0 /mnt/lustre/f61b.sanity has no stripe info /mnt/lustre/f64i.sanity lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2568 0xa08 0 /mnt/lustre/d65g.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d60j.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65a.sanity stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre lmm_fid: [0x200000007:0x1:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65b.sanity lmm_fid: [0x240000404:0x2:0x0] stripe_count: 1 stripe_size: 2097152 pattern: raid0 stripe_offset: 0 /mnt/lustre/d60f.sanity lmm_fid: [0x200000402:0x138d:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f64e.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000405 lmm_object_id: 0x1 lmm_fid: [0x200000405:0x1:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2564 0xa04 0 /mnt/lustre/f64h.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000407 lmm_object_id: 0x17 lmm_fid: [0x200000407:0x17:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2567 0xa07 0 /mnt/lustre/d65d.sanity lmm_fid: [0x240000404:0x4:0x0] stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65e.sanity lmm_fid: [0x240000404:0x6:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f60b.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000402 lmm_object_id: 0x3 lmm_fid: [0x200000402:0x3:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2 0x2 0 /mnt/lustre/d65f.sanityf lmm_fid: [0x240000404:0x7:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/f64f.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000407 lmm_object_id: 0x1 lmm_fid: [0x200000407:0x1:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2566 0xa06 0 /mnt/lustre/d65c.sanity lmm_fid: [0x240000404:0x3:0x0] stripe_count: 1 stripe_size: 4194304 pattern: raid0 stripe_offset: 1 /mnt/lustre/f61 lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000402 lmm_object_id: 0x1585 lmm_fid: [0x200000402:0x1585:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2559 0x9ff 0 /mnt/lustre/d65h.sanity lmm_fid: [0x240000404:0x9:0x0] stripe_count: 1 stripe_size: 2097152 pattern: raid0 stripe_offset: 0 /mnt/lustre/f63b.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000402 lmm_object_id: 0x1589 lmm_fid: [0x200000402:0x1589:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2561 0xa01 0 /mnt/lustre/f61b.sanity has no stripe info /mnt/lustre/f64i.sanity lmm_magic: 0x0BD10BD0 lmm_seq: 0x200000407 lmm_object_id: 0x19 lmm_fid: [0x200000407:0x19:0x0] lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2568 0xa08 0 /mnt/lustre/d65g.sanity lmm_fid: [0x240000404:0x8:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d60j.sanity lmm_fid: [0x200000402:0x1520:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 /mnt/lustre/d65a.sanity lmm_fid: [0x240000404:0x1:0x0] stripe_count: -1 stripe_size: 65536 pattern: raid0 stripe_offset: -1 PASS 65i (9s) == sanity test 65j: set default striping on root directory (bug 6367)=========================================================== 14:34:48 (1776191688) PASS 65j (8s) == sanity test 65k: validate manual striping works properly with deactivated OSCs ========================================================== 14:34:56 (1776191696) Check OST status: lustre-OST0000-osc-MDT0001 is active lustre-OST0000-osc-MDT0000 is active lustre-OST0001-osc-MDT0001 is active lustre-OST0001-osc-MDT0000 is active - open/close 589 (time 1776191717.60 total 10.01 last 58.86) total: 1000 open/close in 17.22 seconds: 58.08 ops/second Deactivate: lustre-OST0000-osc-MDT0001 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d65k.sanity/0 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d65k.sanity/1 - unlinked 0 (time 1776191733 ; total 0 ; last 0) total: 1000 unlinks in 10 seconds: 100.000000 unlinks/second lustre-OST0000-osc-MDT0001 is Activate oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec - open/close 616 (time 1776191773.11 total 10.02 last 61.49) total: 1000 open/close in 16.31 seconds: 61.30 ops/second Deactivate: lustre-OST0000-osc-MDT0000 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d65k.sanity/0 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d65k.sanity/1 - unlinked 0 (time 1776191788 ; total 0 ; last 0) total: 1000 unlinks in 9 seconds: 111.111115 unlinks/second lustre-OST0000-osc-MDT0000 is Activate oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec - open/close 671 (time 1776191826.41 total 10.03 last 66.93) total: 1000 open/close in 15.02 seconds: 66.56 ops/second Deactivate: lustre-OST0001-osc-MDT0001 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d65k.sanity/0 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d65k.sanity/1 - unlinked 0 (time 1776191841 ; total 0 ; last 0) total: 1000 unlinks in 10 seconds: 100.000000 unlinks/second lustre-OST0001-osc-MDT0001 is Activate oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec - open/close 621 (time 1776191884.20 total 10.01 last 62.04) total: 1000 open/close in 15.73 seconds: 63.58 ops/second Deactivate: lustre-OST0001-osc-MDT0000 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d65k.sanity/0 /home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d65k.sanity/1 - unlinked 0 (time 1776191898 ; total 0 ; last 0) total: 1000 unlinks in 9 seconds: 111.111115 unlinks/second lustre-OST0001-osc-MDT0000 is Activate oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec oleg421-server: oleg421-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 40 oleg421-server: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec PASS 65k (232s) == sanity test 65l: lfs find on -1 stripe dir ================================================================================== 14:38:49 (1776191929) striped dir -i1 -c2 -H crush /mnt/lustre/d65l.sanity/test_dir PASS 65l (7s) == sanity test 65m: normal user can't set filesystem default stripe ========================================================== 14:38:55 (1776191935) running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-c] [2] [/mnt/lustre] lfs setstripe: setstripe error for '/mnt/lustre': Operation not permitted PASS 65m (7s) == sanity test 65n: don't inherit default layout from root for new subdirectories ========================================================== 14:39:02 (1776191942) Creating new pool oleg421-server: Pool lustre.test_65n created Adding targets to pool oleg421-server: OST lustre-OST0000_UUID added to pool lustre.test_65n oleg421-server: OST lustre-OST0001_UUID added to pool lustre.test_65n /home/green/git/lustre-release/lustre/utils/lfs getstripe -d /mnt/lustre/d65n.sanity-4 stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1 pool: test_65n /home/green/git/lustre-release/lustre/utils/lfs getstripe -d /mnt/lustre stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1 pool: test_65n Destroy the created pools: test_65n lustre.test_65n oleg421-server: OST lustre-OST0000_UUID removed from pool lustre.test_65n oleg421-server: OST lustre-OST0001_UUID removed from pool lustre.test_65n oleg421-server: Pool lustre.test_65n destroyed PASS 65n (35s) == sanity test 66: update inode blocks count on client ========================================================================= 14:39:38 (1776191978) 8+0 records in 8+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.0714319 s, 115 kB/s PASS 66 (14s) == sanity test 69: verify oa2dentry return -ENOENT doesn't LBUG ================================================================ 14:39:52 (1776191992) directio on /mnt/lustre/f69.sanity.2 for 1x4194304 bytes PASS fail_loc=0x217 directio on /mnt/lustre/f69.sanity for 2x4194304 bytes Write error No such file or directory (rc = -1, len = 8388608) fail_loc=0 directio on /mnt/lustre/f69.sanity for 2x4194304 bytes PASS directio on /mnt/lustre/f69.sanity for 1x4194304 bytes PASS fail_loc=0x217 directio on /mnt/lustre/f69.sanity for 1x4194304 bytes Read error: No such file or directory rc = -1 fail_loc=0 PASS 69 (15s) SKIP: sanity test_71 skipping SLOW test 71 == sanity test 72a: Test that remove suid works properly (bug5695) ============================================================== 14:40:09 (1776192009) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7713] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/f72a.sanity] [bs=512] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.00599903 s, 85.3 kB/s PASS 72a (7s) == sanity test 72b: Test that we keep mode setting if without file data changed (bug 24226) ========================================================== 14:40:16 (1776192016) running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7713] striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/f72b.sanity-dg striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/f72b.sanity-du running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/f72b.sanity-fg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/f72b.sanity-fu] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fu': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/f72b.sanity-dg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-dg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/f72b.sanity-du] chmod: changing permissions of '/mnt/lustre/f72b.sanity-du': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [2777] [/mnt/lustre/f72b.sanity-fg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [2777] [/mnt/lustre/f72b.sanity-fu] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fu': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [2777] [/mnt/lustre/f72b.sanity-dg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-dg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [2777] [/mnt/lustre/f72b.sanity-du] chmod: changing permissions of '/mnt/lustre/f72b.sanity-du': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [4777] [/mnt/lustre/f72b.sanity-fg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [4777] [/mnt/lustre/f72b.sanity-fu] chmod: changing permissions of '/mnt/lustre/f72b.sanity-fu': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [4777] [/mnt/lustre/f72b.sanity-dg] chmod: changing permissions of '/mnt/lustre/f72b.sanity-dg': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [4777] [/mnt/lustre/f72b.sanity-du] chmod: changing permissions of '/mnt/lustre/f72b.sanity-du': Operation not permitted PASS 72b (9s) == sanity test 73: multiple MDC requests (should not deadlock) ========================================================== 14:40:25 (1776192025) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d73-1 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d73-2 multiop /mnt/lustre/d73-1/f73-1 vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7713 fail_loc=0x80000129 fail_loc=0 /mnt/lustre/d73-1/f73-1 has type file OK /mnt/lustre/d73-1/f73-2 has type file OK /mnt/lustre/d73-2/f73-3 has type file OK PASS 73 (34s) == sanity test 74a: ldlm_enqueue freed-export error path, ls (shouldn't LBUG) ========================================================== 14:40:59 (1776192059) fail_loc=0x8000030e /mnt/lustre/f74a fail_loc=0 PASS 74a (7s) == sanity test 74b: ldlm_enqueue freed-export error path, touch (shouldn't LBUG) ========================================================== 14:41:06 (1776192066) fail_loc=0x8000030e fail_loc=0 PASS 74b (6s) == sanity test 74c: ldlm_lock_create error path, (shouldn't LBUG) ========================================================== 14:41:12 (1776192072) fail_loc=0x319 touch: cannot touch '/mnt/lustre/f74c.sanity': No such file or directory fail_loc=0 PASS 74c (7s) == sanity test 76a: confirm clients recycle inodes properly ============================================================== 14:41:19 (1776192079) before slab objects: 70 created: 512, after slab objects: 70 PASS 76a (61s) == sanity test 76b: confirm clients recycle directory inodes properly ============================================================== 14:42:20 (1776192140) slab objects before: 70, after: 70 PASS 76b (47s) == sanity test 77a: normal checksum read/write operation ========================================================== 14:43:07 (1776192187) 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.311984 s, 26.9 MB/s 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.874456 s, 9.6 MB/s PASS 77a (9s) == sanity test 77b: checksum error on client write, read ========================================================== 14:43:17 (1776192197) fail_loc=0x80000409 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 1.07061 s, 7.8 MB/s fail_loc=0 set checksum type to crc32, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to adler, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to crc32c, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10ip512, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10ip4K, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to t10crc512, rc = 0 fail_loc=0x80000408 fail_loc=0 set checksum type to crc32c, rc = 0 PASS 77b (39s) == sanity test 77c: checksum error on client read with debug ========================================================== 14:43:56 (1776192236) 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 1.03307 s, 8.1 MB/s osc.lustre-OST0000-osc-ffff95f318773800.checksum_dump=1 osc.lustre-OST0001-osc-ffff95f318773800.checksum_dump=1 obdfilter.lustre-OST0000.checksum_dump=1 obdfilter.lustre-OST0001.checksum_dump=1 fail_loc=0x80000408 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 2.15789 s, 3.9 MB/s fail_loc=0 osc.lustre-OST0000-osc-ffff95f318773800.checksum_dump=0 osc.lustre-OST0001-osc-ffff95f318773800.checksum_dump=0 obdfilter.lustre-OST0000.checksum_dump=0 obdfilter.lustre-OST0001.checksum_dump=0 PASS 77c (38s) == sanity test 77d: checksum error on OST direct write, read ========================================================== 14:44:34 (1776192274) fail_loc=0x80000409 directio on /mnt/lustre/f77d.sanity for 8x1048576 bytes PASS fail_loc=0 fail_loc=0x80000408 directio on /mnt/lustre/f77d.sanity for 8x1048576 bytes PASS fail_loc=0 PASS 77d (12s) == sanity test 77f: repeat checksum error on write (expect error) ========================================================== 14:44:46 (1776192286) set checksum type to crc32, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to adler, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to crc32c, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10ip512, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10ip4K, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to t10crc512, rc = 0 fail_loc=0x409 directio on /mnt/lustre/f77f.sanity for 8x1048576 bytes Write error Input/output error (rc = -1, len = 8388608) fail_loc=0 set checksum type to crc32c, rc = 0 PASS 77f (320s) == sanity test 77g: checksum error on OST write, read ==== 14:50:07 (1776192607) fail_loc=0x8000021a 8+0 records in 8+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 1.29362 s, 6.5 MB/s fail_loc=0 fail_loc=0x8000021b fail_loc=0 PASS 77g (21s) == sanity test 77k: enable/disable checksum correctly ==== 14:50:29 (1776192629) remount client, checksum should be 0 Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre Waiting 90s for '1' Updated after 2s: want '1' got '1' remount client, checksum should be 1 Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre remount client with option checksum, checksum should be 1 192.168.204.121@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock,checksum oleg421-server@tcp:/lustre /mnt/lustre remount client with option nochecksum, checksum should be 0 192.168.204.121@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock,nochecksum oleg421-server@tcp:/lustre /mnt/lustre Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre Waiting 90s for '0' Updated after 2s: want '0' got '0' PASS 77k (32s) == sanity test 77l: preferred checksum type is remembered after reconnected ========================================================== 14:51:02 (1776192662) error: set_param: setting /proc/fs/lustre/osc/lustre-OST0000-osc-ffff95f306364800/checksum_type=invalid: Invalid argument error: set_param: setting /proc/fs/lustre/osc/lustre-OST0001-osc-ffff95f306364800/checksum_type=invalid: Invalid argument set checksum type to invalid, rc = 22 set checksum type to crc32, rc = 0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306364800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306364800.lru_size=400 oleg421-client.virtnet: executing wait_import_state IDLE osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in IDLE state after 0 sec oleg421-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in FULL state after 0 sec set checksum type to adler, rc = 0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306364800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306364800.lru_size=400 oleg421-client.virtnet: executing wait_import_state IDLE osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in IDLE state after 16 sec oleg421-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in FULL state after 0 sec set checksum type to crc32c, rc = 0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306364800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306364800.lru_size=400 oleg421-client.virtnet: executing wait_import_state IDLE osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in IDLE state after 17 sec oleg421-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in FULL state after 0 sec set checksum type to t10ip512, rc = 0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306364800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306364800.lru_size=400 oleg421-client.virtnet: executing wait_import_state IDLE osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in IDLE state after 16 sec oleg421-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in FULL state after 0 sec set checksum type to t10ip4K, rc = 0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306364800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306364800.lru_size=400 oleg421-client.virtnet: executing wait_import_state IDLE osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in IDLE state after 14 sec oleg421-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in FULL state after 0 sec set checksum type to t10crc512, rc = 0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306364800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306364800.lru_size=400 oleg421-client.virtnet: executing wait_import_state IDLE osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in IDLE state after 15 sec oleg421-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306364800.ost_server_uuid in FULL state after 0 sec set checksum type to crc32c, rc = 0 PASS 77l (217s) == sanity test 77m: Verify checksum_speed is correctly read ========================================================== 14:54:39 (1776192879) checksum_speed= adler32: 227 crc32: 699 crc32c: 3912 PASS 77m (7s) == sanity test 77n: Verify read from a hole inside contiguous blocks with T10PI ========================================================== 14:54:46 (1776192886) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0275104 s, 149 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00546138 s, 750 kB/s set checksum type to t10ip512, rc = 0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0254127 s, 484 kB/s set checksum type to t10ip4K, rc = 0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0190339 s, 646 kB/s set checksum type to t10crc512, rc = 0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0122859 s, 1.0 MB/s set checksum type to crc32c, rc = 0 PASS 77n (17s) == sanity test 77o: Verify checksum_type for server (mdt and ofd(obdfilter)) ========================================================== 14:55:03 (1776192903) obdfilter.lustre-*.checksum_type: crc32 adler [crc32c] t10ip512 t10ip4K t10crc512 crc32 adler [crc32c] t10ip512 t10ip4K t10crc512 mdt.lustre-*.checksum_type: crc32 adler [crc32c] t10ip512 t10ip4K t10crc512 crc32 adler [crc32c] t10ip512 t10ip4K t10crc512 PASS 77o (13s) == sanity test 78: handle large O_DIRECT writes correctly ====================================================================== 14:55:16 (1776192916) MemFree: 3116, Max file size: 600000 MemTotal: 3693 Mem to use for directio: 1718 Smallest OST: 3511644 File size: 32 directIO rdwr round 1 of 1 directio on /mnt/lustre/f78.sanity for 32x1048576 bytes PASS PASS 78 (11s) == sanity test 79: df report consistency check ================================================================================= 14:55:27 (1776192927) Waiting for MDT destroys to complete UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 4392 1283296 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 3264 1284424 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 95376 3511644 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1404 3605616 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 96780 7117260 2% /mnt/lustre llite.lustre-ffff95f306364800.maxbytes=17592186040320 lov.lustre-clilov-ffff95f306364800.maxbytes=17592186040320 mdc.lustre-MDT0000-mdc-ffff95f306364800.maxbytes=4402345721856 mdc.lustre-MDT0001-mdc-ffff95f306364800.maxbytes=4402345721856 osc.lustre-OST0000-osc-ffff95f306364800.maxbytes=17592186040320 osc.lustre-OST0001-osc-ffff95f306364800.maxbytes=17592186040320 llite.lustre-ffff95f306364800.namelen_max=255 lov.lustre-clilov-ffff95f306364800.namelen_max=255 mdc.lustre-MDT0000-mdc-ffff95f306364800.namelen_max=255 mdc.lustre-MDT0001-mdc-ffff95f306364800.namelen_max=255 osc.lustre-OST0000-osc-ffff95f306364800.namelen_max=255 osc.lustre-OST0001-osc-ffff95f306364800.namelen_max=255 PASS 79 (13s) == sanity test 80: Page eviction is equally fast at high offsets too ========================================================== 14:55:41 (1776192941) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.046594 s, 22.5 MB/s PASS 80 (9s) == sanity test 81a: OST should retry write when get -ENOSPC ========================================================================= 14:55:50 (1776192950) fail_loc=0x80000228 PASS 81a (9s) == sanity test 81b: OST should return -ENOSPC when retry still fails ================================================================= 14:56:00 (1776192960) fail_loc=0x228 write: No space left on device PASS 81b (10s) == sanity test 99: cvs strange file/directory operations ========================================================== 14:56:09 (1776192969) striped dir -i1 -c2 -H crush /mnt/lustre/d99.sanity.cvsroot running as uid/gid/euid/egid 500/500/500/500, groups: [cvs] [-d] [/mnt/lustre/d99.sanity.cvsroot] [init] running as uid/gid/euid/egid 500/500/500/500, groups: [cvs] [-d] [/mnt/lustre/d99.sanity.cvsroot] [import] [-m] [nomesg] [d99.sanity.reposname] [vtag] [rtag] N d99.sanity.reposname/README N d99.sanity.reposname/functions No conflicts created by this import striped dir -i1 -c2 -H all_char /mnt/lustre/d99.sanity.reposname running as uid/gid/euid/egid 500/500/500/500, groups: [cvs] [-d] [/mnt/lustre/d99.sanity.cvsroot] [co] [d99.sanity.reposname] cvs checkout: Updating d99.sanity.reposname U d99.sanity.reposname/README U d99.sanity.reposname/functions running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [foo99] running as uid/gid/euid/egid 500/500/500/500, groups: [cvs] [add] [-m] [addmsg] [foo99] cvs add: scheduling file `foo99' for addition cvs add: use 'cvs commit' to add this file permanently running as uid/gid/euid/egid 500/500/500/500, groups: [cvs] [update] cvs update: Updating . A foo99 running as uid/gid/euid/egid 500/500/500/500, groups: [cvs] [commit] [-m] [nomsg] [foo99] RCS file: /mnt/lustre/d99.sanity.cvsroot/d99.sanity.reposname/foo99,v done Checking in foo99; /mnt/lustre/d99.sanity.cvsroot/d99.sanity.reposname/foo99,v <-- foo99 initial revision: 1.1 done PASS 99 (23s) == sanity test 100: check local port using privileged port ===================================================================== 14:56:32 (1776192992) PASS 100 (10s) == sanity test 101a: check read-ahead for random reads === 14:56:42 (1776193002) nreads: 10000 file size: 96MB 112.788372s, 5.81053MB/s osc.lustre-OST0000-osc-ffff95f306364800.rpc_stats= snapshot_time: 1776193123.139044411 secs.nsecs start_time: 1776193005.475551325 secs.nsecs elapsed_time: 117.663493086 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 0 0 0 osc.lustre-OST0001-osc-ffff95f306364800.rpc_stats= snapshot_time: 1776193123.140072121 secs.nsecs start_time: 1776193005.475583370 secs.nsecs elapsed_time: 117.664488751 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 6625 100 100 | 0 0 0 32: 0 0 100 | 0 0 0 64: 0 0 100 | 0 0 0 128: 0 0 100 | 0 0 0 256: 0 0 100 | 0 0 0 512: 0 0 100 | 0 0 0 1024: 0 0 100 | 25 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 6617 99 99 | 24 96 96 2: 8 0 100 | 1 4 100 read write offset rpcs % cum % | rpcs % cum % 0: 5 0 0 | 1 4 4 1: 0 0 0 | 0 0 4 2: 0 0 0 | 0 0 4 4: 0 0 0 | 0 0 4 8: 0 0 0 | 0 0 4 16: 6 0 0 | 0 0 4 32: 8 0 0 | 0 0 4 64: 19 0 0 | 0 0 4 128: 32 0 1 | 0 0 4 256: 72 1 2 | 0 0 4 512: 135 2 4 | 0 0 4 1024: 251 3 7 | 1 4 8 2048: 562 8 16 | 2 8 16 4096: 1088 16 32 | 4 16 32 8192: 2203 33 66 | 8 32 64 16384: 2244 33 100 | 9 36 100 llite.lustre-ffff95f306364800.read_ahead_stats= snapshot_time 1776193123.163672876 secs.nsecs start_time 1776193005.505338740 secs.nsecs elapsed_time 117.658334136 secs.nsecs hits 99368 samples [pages] misses 6625 samples [pages] readpage_not_consecutive 9991 samples [pages] zero_size_window 99368 samples [pages] failed_to_fast_read 6625 samples [pages] PASS 101a (127s) == sanity test 101b: check stride-io mode read-ahead =========================================================================== 14:58:49 (1776193129) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d101b.sanity 0.287777s, 29.1497MB/s Read-ahead success for size 8192 0.352450s, 23.8008MB/s Read-ahead success for size 16384 0.278200s, 30.1532MB/s Read-ahead success for size 32768 0.423390s, 19.813MB/s Read-ahead success for size 65536 0.297969s, 28.1526MB/s Read-ahead success for size 131072 0.295643s, 28.3741MB/s Read-ahead success for size 262144 0.348925s, 24.0413MB/s Read-ahead success for size 524288 0.403228s, 20.8036MB/s Read-ahead success for size 1048576 PASS 101b (18s) == sanity test 101c: check stripe_size aligned read-ahead ========================================================== 14:59:07 (1776193147) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d101c.sanity osc.lustre-OST0000-osc-ffff95f306364800.rpc_stats=0 osc.lustre-OST0001-osc-ffff95f306364800.rpc_stats=0 31.334460s, 20.915MB/s osc.lustre-OST0000-osc-ffff95f306364800.rpc_stats= snapshot_time: 1776193187.127124645 secs.nsecs start_time: 1776193155.725220815 secs.nsecs elapsed_time: 31.401903830 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 798 100 100 | 0 0 0 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 798 100 100 | 0 0 0 read write offset rpcs % cum % | rpcs % cum % 0: 1 0 0 | 0 0 0 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 1 0 0 | 0 0 0 32: 2 0 0 | 0 0 0 64: 4 0 1 | 0 0 0 128: 8 1 2 | 0 0 0 256: 16 2 4 | 0 0 0 512: 32 4 8 | 0 0 0 1024: 63 7 15 | 0 0 0 2048: 128 16 31 | 0 0 0 4096: 255 31 63 | 0 0 0 8192: 288 36 100 | 0 0 0 osc.lustre-OST0001-osc-ffff95f306364800.rpc_stats= snapshot_time: 1776193187.131397030 secs.nsecs start_time: 1776193155.725303757 secs.nsecs elapsed_time: 31.406093273 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 799 100 100 | 0 0 0 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 798 99 99 | 0 0 0 2: 1 0 100 | 0 0 0 read write offset rpcs % cum % | rpcs % cum % 0: 1 0 0 | 0 0 0 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 1 0 0 | 0 0 0 32: 2 0 0 | 0 0 0 64: 4 0 1 | 0 0 0 128: 8 1 2 | 0 0 0 256: 16 2 4 | 0 0 0 512: 32 4 8 | 0 0 0 1024: 64 8 16 | 0 0 0 2048: 128 16 32 | 0 0 0 4096: 255 31 63 | 0 0 0 8192: 288 36 100 | 0 0 0 osc.lustre-OST0000-osc-ffff95f306364800.rpc_stats check passed! osc.lustre-OST0001-osc-ffff95f306364800.rpc_stats check passed! PASS 101c (49s) == sanity test 101d: file read with and without read-ahead enabled ========================================================== 14:59:57 (1776193197) Create test file /mnt/lustre/f101d.sanity size 80M, 6950M free 80+0 records in 80+0 records out 83886080 bytes (84 MB, 80 MiB) copied, 2.60951 s, 32.1 MB/s Cancel LRU locks on lustre client to flush the client cache Disable read-ahead 0 Reading the test file /mnt/lustre/f101d.sanity with read-ahead disabled Cancel LRU locks on lustre client to flush the client cache Enable read-ahead with 40MB Reading the test file /mnt/lustre/f101d.sanity with read-ahead enabled read-ahead disabled time read 180.033 read-ahead enabled time read 3.40515 Waiting for MDT destroys to complete PASS 101d (209s) == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 15:03:26 (1776193406) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff95f306364800.max_cached_mb= users: 6 max_cached_mb: 1846 used_mb: 49 unused_mb: 1797 reclaim_count: 0 max_read_ahead_mb: 115 used_read_ahead_mb: 0 llite.lustre-ffff95f306364800.read_ahead_stats= snapshot_time 1776193432.973627232 secs.nsecs start_time 1776193424.605998175 secs.nsecs elapsed_time 8.367629057 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] PASS 101e (36s) == sanity test 101f: check mmap read performance ========= 15:04:02 (1776193442) /opt/iozone/bin/iozone debug=reada mmap Cancel LRU locks on lustre client to flush the client cache Reset readahead stats mmap read the file with small block size checking missing pages llite.lustre-ffff95f306364800.read_ahead_stats= snapshot_time 1776193447.528816102 secs.nsecs start_time 1776193447.283614842 secs.nsecs elapsed_time 0.245201260 secs.nsecs debug= super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS 101f (11s) == sanity test 101g: Big bulk(4/16 MiB) readahead ======== 15:04:13 (1776193453) remount client to enable new RPC size Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre osc.lustre-OST0000-osc-ffff95f31803a000.max_pages_per_rpc=16M osc.lustre-OST0001-osc-ffff95f31803a000.max_pages_per_rpc=16M 10+0 records in 10+0 records out 167772160 bytes (168 MB, 160 MiB) copied, 4.41431 s, 38.0 MB/s 10+0 records in 10+0 records out 167772160 bytes (168 MB, 160 MiB) copied, 3.61734 s, 46.4 MB/s osc.lustre-OST0000-osc-ffff95f31803a000.max_pages_per_rpc=8M osc.lustre-OST0001-osc-ffff95f31803a000.max_pages_per_rpc=8M 10+0 records in 10+0 records out 83886080 bytes (84 MB, 80 MiB) copied, 1.75086 s, 47.9 MB/s 10+0 records in 10+0 records out 83886080 bytes (84 MB, 80 MiB) copied, 1.50333 s, 55.8 MB/s osc.lustre-OST0000-osc-ffff95f31803a000.max_pages_per_rpc=4M osc.lustre-OST0001-osc-ffff95f31803a000.max_pages_per_rpc=4M 10+0 records in 10+0 records out 41943040 bytes (42 MB, 40 MiB) copied, 1.10228 s, 38.1 MB/s 10+0 records in 10+0 records out 41943040 bytes (42 MB, 40 MiB) copied, 0.7723 s, 54.3 MB/s Stopping client oleg421-client.virtnet /mnt/lustre (opts:) Starting client: oleg421-client.virtnet: -o user_xattr,flock oleg421-server@tcp:/lustre /mnt/lustre PASS 101g (39s) == sanity test 101h: Readahead should cover current read window ========================================================== 15:04:52 (1776193492) 70+0 records in 70+0 records out 73400320 bytes (73 MB, 70 MiB) copied, 1.77555 s, 41.3 MB/s Cancel LRU locks on lustre client to flush the client cache Reset readahead stats Read 10M of data but cross 64M bundary 1+0 records in 1+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.2345 s, 44.7 MB/s PASS 101h (11s) == sanity test 101i: allow current readahead to exceed reservation ========================================================== 15:05:03 (1776193503) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.469257 s, 22.3 MB/s llite.lustre-ffff95f306365800.max_read_ahead_per_file_mb=1 Reset readahead stats llite.lustre-ffff95f306365800.read_ahead_stats=0 5+0 records in 5+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.31357 s, 33.4 MB/s llite.lustre-ffff95f306365800.read_ahead_stats= snapshot_time 1776193506.594413102 secs.nsecs start_time 1776193506.217156342 secs.nsecs elapsed_time 0.377256760 secs.nsecs hits 2555 samples [pages] misses 5 samples [pages] zero_size_window 2555 samples [pages] failed_to_fast_read 6 samples [pages] llite.lustre-ffff95f306365800.max_read_ahead_per_file_mb=28 PASS 101i (10s) == sanity test 101j: A complete read block should be submitted when no RA ========================================================== 15:05:13 (1776193513) Disable read-ahead 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.720141 s, 23.3 MB/s Reset readahead stats 4096+0 records in 4096+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 42.4406 s, 395 kB/s snapshot_time 1776193559.002211967 secs.nsecs start_time 1776193516.407029631 secs.nsecs elapsed_time 42.595182336 secs.nsecs failed_to_fast_read 4096 samples [pages] Reset readahead stats 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.660633 s, 25.4 MB/s snapshot_time 1776193559.933543755 secs.nsecs start_time 1776193559.155753069 secs.nsecs elapsed_time 0.777790686 secs.nsecs failed_to_fast_read 16 samples [pages] Reset readahead stats 1+0 records in 1+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.27741 s, 60.5 MB/s snapshot_time 1776193560.442113962 secs.nsecs start_time 1776193560.030393370 secs.nsecs elapsed_time 0.411720592 secs.nsecs failed_to_fast_read 1 samples [pages] PASS 101j (54s) == sanity test 102a: user xattr test ============================================================================================ 15:06:07 (1776193567) set/get xattr... trusted.name1="value1" user.author1="author1" listxattr... remove xattr... set lustre special xattr ... lfs setstripe: setstripe error for '/mnt/lustre/f102a.sanity': stripe already set getfattr: Removing leading '/' from absolute path names setfattr: /mnt/lustre/f102a.sanity: Numerical result out of range PASS 102a (11s) == sanity test 102b: getfattr/setfattr for trusted.lov EAs ========================================================== 15:06:18 (1776193578) test layout '-S 65536 -i 1 -c 2' lmm_stripe_count: 2 lmm_stripe_size: 65536 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - l_ost_idx: 1 l_fid: 0x100010000:0xf69:0x0 - l_ost_idx: 0 l_fid: 0x100000000:0xf94:0x0 get/set/list trusted.lov xattr ... getfattr: Removing leading '/' from absolute path names setfattr 4 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 6 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 8 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 10 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 12 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 14 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 16 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 18 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 20 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 22 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 24 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 26 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 28 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 30 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 32 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 34 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 36 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 38 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 40 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 42 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 44 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 46 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 48 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 50 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 52 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 54 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 56 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 58 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 60 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 62 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 64 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 66 /mnt/lustre/f102b.sanity.2 setfattr 68 /mnt/lustre/f102b.sanity.2 setfattr 70 /mnt/lustre/f102b.sanity.2 setfattr 72 /mnt/lustre/f102b.sanity.2 setfattr 74 /mnt/lustre/f102b.sanity.2 setfattr 76 /mnt/lustre/f102b.sanity.2 setfattr 78 /mnt/lustre/f102b.sanity.2 setfattr 80 /mnt/lustre/f102b.sanity.2 setfattr 82 /mnt/lustre/f102b.sanity.2 setfattr 84 /mnt/lustre/f102b.sanity.2 setfattr 86 /mnt/lustre/f102b.sanity.2 setfattr 88 /mnt/lustre/f102b.sanity.2 setfattr 90 /mnt/lustre/f102b.sanity.2 setfattr 92 /mnt/lustre/f102b.sanity.2 setfattr 94 /mnt/lustre/f102b.sanity.2 setfattr 96 /mnt/lustre/f102b.sanity.2 setfattr 98 /mnt/lustre/f102b.sanity.2 setfattr 100 /mnt/lustre/f102b.sanity.2 setfattr 102 /mnt/lustre/f102b.sanity.2 setfattr 104 /mnt/lustre/f102b.sanity.2 setfattr 106 /mnt/lustre/f102b.sanity.2 setfattr 108 /mnt/lustre/f102b.sanity.2 setfattr 110 /mnt/lustre/f102b.sanity.2 setfattr 112 /mnt/lustre/f102b.sanity.2 setfattr 114 /mnt/lustre/f102b.sanity.2 setfattr 116 /mnt/lustre/f102b.sanity.2 setfattr 118 /mnt/lustre/f102b.sanity.2 setfattr 120 /mnt/lustre/f102b.sanity.2 setfattr 122 /mnt/lustre/f102b.sanity.2 setfattr 124 /mnt/lustre/f102b.sanity.2 setfattr 126 /mnt/lustre/f102b.sanity.2 setfattr 128 /mnt/lustre/f102b.sanity.2 setfattr 130 /mnt/lustre/f102b.sanity.2 setfattr 132 /mnt/lustre/f102b.sanity.2 setfattr 134 /mnt/lustre/f102b.sanity.2 setfattr 136 /mnt/lustre/f102b.sanity.2 setfattr 138 /mnt/lustre/f102b.sanity.2 setfattr 140 /mnt/lustre/f102b.sanity.2 setfattr 142 /mnt/lustre/f102b.sanity.2 setfattr 144 /mnt/lustre/f102b.sanity.2 setfattr 146 /mnt/lustre/f102b.sanity.2 setfattr 148 /mnt/lustre/f102b.sanity.2 setfattr 150 /mnt/lustre/f102b.sanity.2 setfattr 152 /mnt/lustre/f102b.sanity.2 setfattr 154 /mnt/lustre/f102b.sanity.2 setfattr 156 /mnt/lustre/f102b.sanity.2 setfattr 158 /mnt/lustre/f102b.sanity.2 setfattr 160 /mnt/lustre/f102b.sanity.2 setfattr 162 /mnt/lustre/f102b.sanity.2 test layout '-E 1M -S 65536 -i 1 -c 2 -Eeof -S4M' lcm_layout_gen: 2 lcm_mirror_count: 1 lcm_entry_count: 2 component0: lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 sub_layout: lmm_stripe_count: 2 lmm_stripe_size: 65536 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - l_ost_idx: 1 l_fid: 0x100010000:0xf6b:0x0 - l_ost_idx: 0 l_fid: 0x100000000:0xf96:0x0 component1: lcme_id: 2 lcme_mirror_id: 0 lcme_flags: 0 lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF sub_layout: lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: -1 get/set/list trusted.lov xattr ... getfattr: Removing leading '/' from absolute path names setfattr 4 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 6 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 8 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 10 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 12 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 14 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 16 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 18 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 20 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 22 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 24 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 26 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 28 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 30 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 32 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 34 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 36 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 38 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 40 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 42 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 44 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 46 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 48 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 50 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 52 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 54 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 56 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 58 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 60 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 62 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 64 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 66 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 68 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 70 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 72 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 74 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 76 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 78 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 80 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 82 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 84 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 86 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 88 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 90 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 92 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 94 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 96 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 98 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 100 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 102 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 104 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 106 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 108 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 110 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 112 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 114 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 116 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 118 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 120 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 122 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 124 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 126 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 128 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 130 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 132 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 134 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 136 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 138 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 140 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 142 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 144 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 146 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 148 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 150 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 152 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 154 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 156 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 158 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 160 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 162 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 164 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 166 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 168 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 170 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 172 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 174 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 176 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 178 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 180 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 182 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 184 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 186 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 188 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 190 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 192 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 194 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 196 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 198 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 200 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 202 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 204 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 206 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 208 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 210 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 212 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 214 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 216 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 218 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 220 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 222 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 224 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 226 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 228 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 230 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 232 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 234 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 236 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 238 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 240 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 242 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 244 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 246 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 248 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 250 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 252 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 254 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 256 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 258 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 260 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 262 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 264 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 266 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 268 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 270 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 272 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 274 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 276 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 278 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 280 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 282 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 284 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 286 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 288 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 290 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 292 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 294 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 296 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 298 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 300 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 302 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 304 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 306 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 308 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 310 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 312 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 314 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 316 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 318 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 320 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 322 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 324 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 326 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 328 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 330 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 332 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 334 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 336 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 338 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 340 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 342 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 344 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 346 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 348 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 350 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 352 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 354 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 356 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 358 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 360 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 362 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 364 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 366 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 368 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 370 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 372 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 374 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 376 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 378 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 380 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 382 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 384 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 386 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 388 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 390 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 392 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 394 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 396 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 398 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 400 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 402 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 404 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 406 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 408 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 410 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 412 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 414 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 416 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 418 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 420 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 422 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 424 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 426 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 428 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 430 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 432 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 434 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 436 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 438 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 440 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 442 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 444 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 446 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 448 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 450 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 452 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 454 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 456 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 458 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 460 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 462 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 464 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 466 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 468 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 470 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 472 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 474 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 476 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 478 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 480 /mnt/lustre/f102b.sanity.2 setfattr: /mnt/lustre/f102b.sanity.2: Numerical result out of range setfattr 482 /mnt/lustre/f102b.sanity.2 PASS 102b (16s) == sanity test 102c: non-root getfattr/setfattr for lustre.lov EAs ===================================================================== 15:06:34 (1776193594) get/set/list lustre.lov xattr ... striped dir -i0 -c2 -H crush /mnt/lustre/d102c.sanity running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [65536] [-i] [1] [-c] [2] [/mnt/lustre/d102c.sanity/f102c.sanity] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [getstripe] [-c] [/mnt/lustre/d102c.sanity/f102c.sanity] lustre.lov=0s0AvRCwEAAAANAAAAAAAAAAoEAAACAAAAAAABAAIAAABtDwAAAAAAAAAAAAAAAAAAAAAAAAEAAACYDwAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= running as uid/gid/euid/egid 500/500/500/500, groups: [mcreate] [/mnt/lustre/d102c.sanity/f102c.sanity2] running as uid/gid/euid/egid 500/500/500/500, groups: [setfattr] [-n] [lustre.lov] [-v] [0s0AvRCwEAAAANAAAAAAAAAAoEAAACAAAAAAABAAIAAABtDwAAAAAAAAAAAAAAAAAAAAAAAAEAAACYDwAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=] [/mnt/lustre/d102c.sanity/f102c.sanity2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [getstripe] [-S] [/mnt/lustre/d102c.sanity/f102c.sanity2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [getstripe] [-c] [/mnt/lustre/d102c.sanity/f102c.sanity2] PASS 102c (9s) == sanity test 102d: tar restore stripe info from tarfile,not keep osts ========================================================== 15:06:43 (1776193603) striped dir -i0 -c2 -H crush /mnt/lustre/d102d.sanity PASS 102d (18s) == sanity test 102f: tar copy files, not keep osts ======= 15:07:02 (1776193622) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d102f.sanity striped dir -i0 -c2 -H all_char /mnt/lustre/d102f.sanity.restore PASS 102f (19s) == sanity test 102h: grow xattr from inside inode to external block ========================================================== 15:07:20 (1776193640) save trusted.big on /mnt/lustre/f102h.sanity save trusted.sml on /mnt/lustre/f102h.sanity grow trusted.sml on /mnt/lustre/f102h.sanity trusted.big still valid after growing trusted.sml PASS 102h (15s) == sanity test 102ha: grow xattr from inside inode to external inode ========================================================== 15:07:35 (1776193655) setting xattr of max xattr size: 65536 save trusted.big on /mnt/lustre/f102ha.sanity save trusted.sml on /mnt/lustre/f102ha.sanity grow trusted.sml on /mnt/lustre/f102ha.sanity trusted.big still valid after growing trusted.sml setting xattr of > max xattr size: 65536 + 10 This should fail: save trusted.big on /mnt/lustre/f102ha.sanity setfattr: /mnt/lustre/f102ha.sanity: Argument list too long PASS 102ha (20s) == sanity test 102i: lgetxattr test on symbolic link ====================================================================== 15:07:56 (1776193676) getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f102i.sanity trusted.lov=0s0AvRCwEAAAApAAAAAAAAAAoEAAACAAAAAAAQAAEAAACpDwAAAAAAAAAAAAAAAAAAAAAAAAAAAAA= /mnt/lustre/f102i.sanitylink: trusted.lov: No such attribute PASS 102i (8s) == sanity test 102j: non-root tar restore stripe info from tarfile, not keep osts ============================================================= 15:08:04 (1776193684) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d102j.sanity running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [65536] [-i] [1] [-c] [2] [d102j.sanity] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [65536] [-i] [0] [-c] [1] [file1-0-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [65536] [-i] [1] [-c] [1] [file1-1-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [65536] [-i] [0] [-c] [2] [file1-0-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [65536] [-i] [1] [-c] [2] [file1-1-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [131072] [-i] [0] [-c] [1] [file2-0-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [131072] [-i] [1] [-c] [1] [file2-1-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [131072] [-i] [0] [-c] [2] [file2-0-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [131072] [-i] [1] [-c] [2] [file2-1-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [196608] [-i] [0] [-c] [1] [file3-0-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [196608] [-i] [1] [-c] [1] [file3-1-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [196608] [-i] [0] [-c] [2] [file3-0-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [196608] [-i] [1] [-c] [2] [file3-1-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [262144] [-i] [0] [-c] [1] [file4-0-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [262144] [-i] [1] [-c] [1] [file4-1-1] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [262144] [-i] [0] [-c] [2] [file4-0-2] running as uid/gid/euid/egid 500/500/500/500, groups: [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-S] [262144] [-i] [1] [-c] [2] [file4-1-2] running as uid/gid/euid/egid 500/500/500/500, groups: [tar] [cf] [/tmp/f102.tar] [d102j.sanity] [--xattrs] running as uid/gid/euid/egid 500/500/500/500, groups: [tar] [xf] [/tmp/f102.tar] [-C] [/mnt/lustre/d102j.sanity] [--xattrs] [--xattrs-include=lustre.*] PASS 102j (20s) == sanity test 102k: setfattr without parameter of value shouldn't cause a crash ========================================================== 15:08:25 (1776193705) striped dir -i0 -c2 -H crush /mnt/lustre/d102k.sanity PASS 102k (9s) == sanity test 102l: listxattr size test ============================================================================================ 15:08:34 (1776193714) listxattr as user... PASS 102l (10s) == sanity test 102m: Ensure listxattr fails on small bufffer ================================================================== 15:08:44 (1776193724) PASS 102m (8s) == sanity test 102n: silently ignore setxattr on internal trusted xattrs ========================================================== 15:08:52 (1776193732) setfattr: /mnt/lustre/f102n.sanity.1: Numerical result out of range PASS 102n (9s) == sanity test 102p: check setxattr(2) correctly fails without permission ========================================================== 15:09:01 (1776193741) setfacl as user... running as uid/gid/euid/egid 500/500/500/500, groups: [setfacl] [-m] [u:500:rwx] [/mnt/lustre/f102p.sanity] setfacl: /mnt/lustre/f102p.sanity: Operation not permitted setfattr as user... running as uid/gid/euid/egid 500/500/500/500, groups: [setfattr] [-x] [system.posix_acl_access] [/mnt/lustre/f102p.sanity] setfattr: /mnt/lustre/f102p.sanity: Operation not permitted PASS 102p (8s) == sanity test 102q: flistxattr should not return trusted.link EAs for orphans ========================================================== 15:09:09 (1776193749) PASS 102q (8s) == sanity test 102r: set EAs with empty values =========== 15:09:17 (1776193757) getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f102r.sanity user.f102r.sanity="" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/d102r.sanity user.d102r.sanity="" striped dir -i0 -c2 -H all_char /mnt/lustre/d102r.sanity getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/d102r.sanity user.d102r.sanity="" PASS 102r (10s) == sanity test 102s: getting nonexistent xattrs should fail ========================================================== 15:09:28 (1776193768) llite.lustre-ffff95f306365800.xattr_cache=0 /mnt/lustre/f102s.sanity: lustre.n102s: Operation not supported /mnt/lustre/f102s.sanity: security.n102s: No such attribute /mnt/lustre/f102s.sanity: system.n102s: Operation not supported /mnt/lustre/f102s.sanity: trusted.n102s: No such attribute /mnt/lustre/f102s.sanity: user.n102s: No such attribute llite.lustre-ffff95f306365800.xattr_cache=1 /mnt/lustre/f102s.sanity: lustre.n102s: No such attribute /mnt/lustre/f102s.sanity: security.n102s: No such attribute /mnt/lustre/f102s.sanity: system.n102s: Operation not supported /mnt/lustre/f102s.sanity: trusted.n102s: No such attribute /mnt/lustre/f102s.sanity: user.n102s: No such attribute PASS 102s (8s) == sanity test 102t: zero length xattr values handled correctly ========================================================== 15:09:37 (1776193777) llite.lustre-ffff95f306365800.xattr_cache=0 llite.lustre-ffff95f306365800.xattr_cache=1 PASS 102t (8s) == sanity test 103a: acl test ============================ 15:09:45 (1776193785) /usr/bin/setfacl oleg421-server: error: get_param: param_path 'mdt/lustre-MDT0000/job_xattr': No such file or directory pdsh@oleg421-client: oleg421-server: ssh exited with exit code 2 uid=1(bin) gid=1(bin) groups=1(bin) uid=2(daemon) gid=2(daemon) groups=2(daemon) users:x:100: Adding user daemon to group bin Adding user daemon to group bin performing cp with bin='bin' daemon='daemon' users='users'... [3] $ umask 022 -- ok [4] $ mkdir d -- ok [5] $ cd d -- ok [6] $ touch f -- ok [7] $ setfacl -m u:bin:rw f -- ok [8] $ ls -l f | awk -- '{ print $1 }' -- ok [11] $ cp f g -- ok [12] $ ls -l g | awk -- '{sub(/\./, "", $1); print $1 }' -- ok [15] $ rm g -- ok [16] $ cp -p f g -- ok [17] $ ls -l f | awk -- '{ print $1 }' -- ok [20] $ mkdir h -- ok [21] $ echo blubb > h/x -- ok [22] $ cp -rp h i -- ok [23] $ cat i/x -- ok [26] $ rm -r i -- ok [31] $ setfacl -R -m u:bin:rwx h -- ok [32] $ getfacl --omit-header h/x -- ok [40] $ cp -rp h i -- ok [41] $ getfacl --omit-header i/x -- ok [49] $ cd .. -- ok [50] $ rm -r d -- ok 22 commands (22 passed, 0 failed) performing getfacl-noacl with bin='bin' daemon='daemon' users='users'... [4] $ mkdir test -- ok [5] $ cd test -- ok [6] $ umask 027 -- ok [7] $ touch x -- ok [8] $ getfacl --omit-header x -- ok [14] $ getfacl --omit-header --access x -- ok [20] $ getfacl --omit-header -d x -- ok [21] $ getfacl --omit-header -d . -- ok [22] $ getfacl --omit-header -d / -- ok [25] $ getfacl --skip-base x -- ok [26] $ getfacl --omit-header --all-effective x -- ok [32] $ getfacl --omit-header --no-effective x -- ok [38] $ mkdir d -- ok [39] $ touch d/y -- ok [46] $ getfacl -dRP . | grep file | sort -- ok [51] $ ln -s d l -- ok [53] $ ln -s l ll -- ok [62] $ rm l ll x -- ok [63] $ rm -rf d -- ok [64] $ cd .. -- ok [65] $ rmdir test -- ok 21 commands (21 passed, 0 failed) performing misc with bin='bin' daemon='daemon' users='users'... [6] $ umask 027 -- ok [7] $ touch f -- ok [10] $ setfacl -m u::r f -- ok [11] $ setfacl -m u::rw,u:bin:rw f -- ok [12] $ ls -dl f | awk '{print $1}' -- ok [15] $ getfacl --omit-header f -- ok [23] $ rm f -- ok [24] $ umask 022 -- ok [25] $ touch f -- ok [26] $ setfacl -m u:bin:rw f -- ok [27] $ ls -dl f | awk '{print $1}' -- ok [30] $ getfacl --omit-header f -- ok [38] $ rm f -- ok [39] $ umask 027 -- ok [40] $ mkdir d -- ok [41] $ setfacl -m u:bin:rwx d -- ok [42] $ ls -dl d | awk '{print $1}' -- ok [45] $ getfacl --omit-header d -- ok [53] $ rmdir d -- ok [54] $ umask 022 -- ok [55] $ mkdir d -- ok [56] $ setfacl -m u:bin:rwx d -- ok [57] $ ls -dl d | awk '{print $1}' -- ok [60] $ getfacl --omit-header d -- ok [68] $ rmdir d -- ok [73] $ umask 022 -- ok [74] $ touch f -- ok [75] $ setfacl -m u:bin:rw,u:daemon:r f -- ok [76] $ ls -dl f | awk '{print $1}' -- ok [79] $ getfacl --omit-header f -- ok [90] $ setfacl -m g:users:rw,g:daemon:r f -- ok [91] $ ls -dl f | awk '{print $1}' -- ok [94] $ getfacl --omit-header f -- ok [107] $ setfacl -x g:users f -- ok [108] $ ls -dl f | awk '{print $1}' -- ok [111] $ getfacl --omit-header f -- ok [123] $ setfacl -x u:daemon f -- ok [124] $ ls -dl f | awk '{print $1}' -- ok [127] $ getfacl --omit-header f -- ok [136] $ rm f -- ok [140] $ umask 027 -- ok [141] $ mkdir d -- ok [142] $ setfacl -m u:bin:rwx,u:daemon:rw,d:u:bin:rwx,d:m:rx d -- ok [143] $ ls -dl d | awk '{print $1}' -- ok [146] $ getfacl --omit-header d -- ok [162] $ umask 027 -- ok [163] $ touch d/f -- ok [164] $ ls -dl d/f | awk '{print $1}' -- ok [167] $ getfacl --omit-header d/f -- ok [175] $ rm d/f -- ok [176] $ umask 022 -- ok [177] $ touch d/f -- ok [178] $ ls -dl d/f | awk '{print $1}' -- ok [181] $ getfacl --omit-header d/f -- ok [189] $ rm d/f -- ok [193] $ umask 000 -- ok [194] $ mkdir d/d -- ok [195] $ ls -dl d/d | awk '{print $1}' -- ok [198] $ getfacl --omit-header d/d -- ok [211] $ rmdir d/d -- ok [212] $ umask 022 -- ok [213] $ mkdir d/d -- ok [214] $ ls -dl d/d | awk '{print $1}' -- ok [217] $ getfacl --omit-header d/d -- ok [232] $ setfacl -nm u:daemon:rx,d:u:daemon:rx,g:users:rx,g:daemon:rwx d/d -- ok [233] $ ls -dl d/d | awk '{print $1}' -- ok [236] $ getfacl --omit-header d/d -- ok [256] $ ln -s d d/l -- ok [257] $ ls -dl d/l | awk '{ sub(/\.$/, "", $1); print $1 }' -- ok [260] $ ls -dl -L d/l | awk '{print $1}' -- ok [265] $ cd d -- ok [266] $ getfacl --omit-header l -- ok [283] $ cd .. -- ok [285] $ rm d/l -- ok [289] $ setfacl -m g:daemon:rx,u:bin:rx d/d -- ok [290] $ ls -dl d/d | awk '{print $1}' -- ok [293] $ getfacl --omit-header d/d -- ok [310] $ setfacl -m d:u:bin:rwx d/d -- ok [311] $ ls -dl d/d | awk '{print $1}' -- ok [314] $ getfacl --omit-header d/d -- ok [331] $ rmdir d/d -- ok [335] $ setfacl -k d -- ok [336] $ ls -dl d | awk '{print $1}' -- ok [339] $ getfacl --omit-header d -- ok [350] $ setfacl -b d -- ok [351] $ ls -dl d | awk '{sub(/\./, "", $1); print $1}' -- ok [354] $ getfacl --omit-header d -- ok [362] $ chmod 775 d -- ok [363] $ ls -dl d | awk '{sub(/\./, "", $1); print $1}' -- ok [366] $ getfacl --omit-header d -- ok [372] $ rmdir d -- ok [373] $ umask 002 -- ok [374] $ mkdir d -- ok [375] $ setfacl -m u:daemon:rwx,u:bin:rx,d:u:daemon:rwx,d:u:bin:rx d -- ok [376] $ ls -dl d | awk '{print $1}' -- ok [379] $ getfacl --omit-header d -- ok [394] $ chmod 750 d -- ok [395] $ ls -dl d | awk '{print $1}' -- ok [398] $ getfacl --omit-header d -- ok [413] $ chmod 750 d -- ok [414] $ ls -dl d | awk '{print $1}' -- ok [417] $ getfacl --omit-header d -- ok [432] $ rmdir d -- ok 103 commands (103 passed, 0 failed) performing permissions with bin='bin' daemon='daemon' users='users'... [12] $ id -u -- ok [19] $ mkdir d -- ok [20] $ cd d -- ok [21] $ umask 027 -- ok [22] $ touch f -- ok [23] $ ls -l f | awk -- '{sub(/\./, "", $1); print $1, $3, $4 }' -- ok [30] $ echo root > f -- ok [32] $ su daemon -- ok [33] $ echo daemon >> f -- ok [36] $ su -- ok [42] $ chown bin:bin f -- ok [43] $ ls -l f | awk -- '{sub(/\./, "", $1); print $1, $3, $4 }' -- ok [45] $ su bin -- ok [46] $ echo bin >> f -- ok [52] $ su daemon -- ok [53] $ cat f -- ok [57] $ echo daemon >> f -- ok [64] $ su bin -- ok [65] $ setfacl -m u:daemon:rw f -- ok [66] $ getfacl --omit-header f -- ok [77] $ su daemon -- ok [78] $ echo daemon >> f -- ok [79] $ cat f -- ok [88] $ su bin -- ok [89] $ chmod g-w f -- ok [90] $ getfacl --omit-header f -- ok [98] $ su daemon -- ok [99] $ echo daemon >> f -- ok [108] $ su bin -- ok [109] $ setfacl -m u:daemon:r,g:daemon:rw-,o::rw- f -- ok [111] $ su daemon -- ok [112] $ echo daemon >> f -- ok [119] $ su bin -- ok [120] $ setfacl -x u:daemon f -- ok [122] $ su daemon -- ok [123] $ echo daemon2 >> f -- ok [124] $ cat f -- ok [134] $ su bin -- ok [135] $ setfacl -m g:daemon:r f -- ok [137] $ su daemon -- ok [138] $ echo daemon3 >> f -- ok [145] $ su bin -- ok [146] $ setfacl -x g:daemon f -- ok [148] $ su daemon -- ok [149] $ echo daemon4 >> f -- ok [156] $ su -- ok [157] $ chgrp root f -- ok [159] $ su daemon -- ok [160] $ echo daemon5 >> f -- ok [161] $ cat f -- ok [172] $ su -- ok [173] $ setfacl -m g:bin:r,g:daemon:w f -- ok [175] $ su daemon -- ok [176] $ : < f -- ok [177] $ : > f -- ok [178] $ : <> f -- ok [186] $ su -- ok [187] $ mkdir -m 750 e -- ok [188] $ touch e/h -- ok [190] $ su bin -- ok [191] $ shopt -s nullglob ; echo e/* -- ok [194] $ echo i > e/i -- ok [197] $ su -- ok [198] $ setfacl -m u:bin:rx e -- ok [200] $ su bin -- ok [201] $ echo e/* -- ok [208] $ touch e/i 2>&1 | sed -e "s/touch .*e\/i.*:/touch \'e\/i\':/" -- ok [211] $ su -- ok [212] $ setfacl -m u:bin:rwx e -- ok [214] $ su bin -- ok [215] $ echo i > e/i -- ok [220] $ su -- ok [221] $ touch g -- ok [222] $ ln -s g l -- ok [223] $ setfacl -m u:bin:rw l -- ok [224] $ ls -l g | awk -- '{ print $1, $3, $4 }' -- ok [234] $ mknod -m 0660 hdt b 91 64 -- ok [235] $ mknod -m 0660 null c 1 3 -- ok [236] $ mkfifo -m 0660 fifo -- ok [238] $ su bin -- ok [239] $ : < hdt -- ok [241] $ : < null -- ok [243] $ : < fifo -- ok [246] $ su -- ok [247] $ setfacl -m u:bin:rw hdt null fifo -- ok [249] $ su bin -- ok [250] $ : < hdt -- ok [252] $ : < null -- ok [253] $ ( echo blah > fifo & ) ; cat fifo -- ok [261] $ su -- ok [262] $ mkdir -m 600 x -- ok [263] $ chown daemon:daemon x -- ok [264] $ echo j > x/j -- ok [265] $ ls -l x/j | awk -- '{sub(/\./, "", $1); print $1, $3, $4 }' -- ok [268] $ setfacl -m u:daemon:r x -- ok [270] $ ls -l x/j | awk -- '{sub(/\./, "", $1); print $1, $3, $4 }' -- ok [274] $ echo k > x/k -- ok [277] $ chmod 750 x -- ok [282] $ su -- ok [283] $ cd .. -- ok [284] $ rm -rf d -- ok 101 commands (101 passed, 0 failed) 65534 nobody:x:65534: /usr/bin/setfattr performing permissions_xattr with bin='bin' daemon='daemon' users='users'... [11] $ id -u -- ok [19] $ mkdir d -- ok [20] $ cd d -- ok [21] $ umask 027 -- ok [22] $ touch f -- ok [23] $ chown nobody:nobody f -- ok [24] $ ls -l f | awk -- '{ sub(/\.$/, "", $1); print $1, $3, $4 }' -- ok [26] $ su nobody -- ok [27] $ echo nobody > f -- ok [33] $ su bin -- ok [34] $ setfattr -n user.test.xattr -v 123456 f -- ok [41] $ su nobody -- ok [42] $ setfacl -m g:bin:rw f -- ok [43] $ getfacl --omit-header f -- ok [55] $ su bin -- ok [56] $ setfattr -n user.test.xattr -v 123456 f -- ok [57] $ getfattr -d f -- ok [66] $ su -- ok [67] $ ln -s f l -- ok [68] $ ls -l l | awk -- '{ sub(/\.$/, "", $1); print $1, $3, $4 }' -- ok [70] $ su bin -- ok [71] $ getfattr -d l -- ok [81] $ su -- ok [82] $ mkdir t -- ok [83] $ chown nobody:nobody t -- ok [84] $ chmod 1750 t -- ok [85] $ ls -dl t | awk -- '{ sub(/\.$/, "", $1); print $1, $3, $4 }' -- ok [87] $ su nobody -- ok [88] $ setfacl -m g:bin:rwx t -- ok [89] $ getfacl --omit-header t -- ok [96] $ su bin -- ok [97] $ setfattr -n user.test.xattr -v 654321 t -- ok [105] $ su -- ok [106] $ mkdir d -- ok [107] $ chown nobody:nobody d -- ok [108] $ chmod 750 d -- ok [109] $ ls -dl d | awk -- '{ sub(/\.$/, "", $1); print $1, $3, $4 }' -- ok [111] $ su nobody -- ok [112] $ setfacl -m g:bin:rwx d -- ok [113] $ getfacl --omit-header d -- ok [120] $ su bin -- ok [121] $ setfattr -n user.test.xattr -v 654321 d -- ok [122] $ getfattr -d d -- ok [131] $ su -- ok [132] $ mknod -m 0660 hdt b 91 64 -- ok [133] $ mknod -m 0660 null c 1 3 -- ok [134] $ mkfifo -m 0660 fifo -- ok [135] $ setfattr -n user.test.xattr -v 123456 hdt -- ok [137] $ setfattr -n user.test.xattr -v 123456 null -- ok [139] $ setfattr -n user.test.xattr -v 123456 fifo -- ok [145] $ su -- ok [146] $ cd .. -- ok [147] $ rm -rf d -- ok 53 commands (53 passed, 0 failed) performing setfacl with bin='bin' daemon='daemon' users='users'... [3] $ mkdir d -- ok [4] $ chown bin:bin d -- ok [5] $ cd d -- ok [7] $ su bin -- ok [8] $ sg bin -- [(1,0)(1 1,1 1)]ok [9] $ umask 027 -- ok [10] $ touch g -- ok [11] $ ls -dl g | awk '{sub(/\./, "", $1); print $1}' -- ok [14] $ setfacl -m m:- g -- ok [15] $ ls -dl g | awk '{print $1}' -- ok [18] $ getfacl g -- ok [28] $ setfacl -x m g -- ok [29] $ getfacl g -- ok [38] $ setfacl -m u:daemon:rw g -- ok [39] $ getfacl g -- ok [50] $ setfacl -m u::rwx,g::r-x,o:- g -- ok [51] $ getfacl g -- ok [62] $ setfacl -m u::rwx,g::r-x,o:-,m:- g -- ok [63] $ getfacl g -- ok [74] $ setfacl -m u::rwx,g::r-x,o:-,u:root:-,m:- g -- ok [75] $ getfacl g -- ok [87] $ setfacl -m u::rwx,g::r-x,o:-,u:root:-,m:- g -- ok [88] $ getfacl g -- ok [100] $ setfacl -m u::rwx,g::r-x,o:-,u:root:- g -- ok [101] $ getfacl g -- ok [113] $ setfacl --test -x u: g -- ok [116] $ setfacl --test -x u:x -- ok [119] $ setfacl -m d:u:root:rwx g -- ok [122] $ setfacl -x m g -- ok [129] $ mkdir d -- ok [130] $ setfacl --test -m u::rwx,u:bin:rwx,g::r-x,o::--- d -- ok [133] $ setfacl --test -m u::rwx,u:bin:rwx,g::r-x,m::---,o::--- d -- ok [136] $ setfacl --test -d -m u::rwx,u:bin:rwx,g::r-x,o::--- d -- ok [139] $ setfacl --test -d -m u::rwx,u:bin:rwx,g::r-x,m::---,o::--- d -- ok [142] $ su -- ok [143] $ cd .. -- ok [144] $ rm -r d -- ok 37 commands (37 passed, 0 failed) performing inheritance with bin='bin' daemon='daemon' users='users'... [4] $ id -u -- ok [7] $ mkdir d -- ok [8] $ setfacl -d -m group:bin:r-x d -- ok [9] $ getfacl d -- ok [23] $ mkdir d/subdir -- ok [24] $ getfacl d/subdir -- ok [40] $ touch d/f -- ok [41] $ ls -l d/f | awk -- '{ print $1 }' -- ok [43] $ getfacl d/f -- ok [54] $ su bin -- ok [55] $ echo i >> d/f -- ok [62] $ su -- ok [63] $ rm d/f -- ok [64] $ rmdir d/subdir -- ok [65] $ mv d tree -- ok [66] $ ./make-tree -- ok [67] $ getfacl tree/dir0/dir5/file4 -- ok [77] $ getfacl tree/dir0/dir6/file4 -- ok [87] $ echo i >> tree/dir6/dir2/file2 -- ok [88] $ echo i > tree/dir1/f -- ok [89] $ ls -l tree/dir1/f | awk -- '{ print $1 }' -- ok [98] $ rm -rf tree -- ok 22 commands (22 passed, 0 failed) LU-974 ignore umask when acl is enabled... performing 974 with bin='bin' daemon='daemon' users='users'... [3] $ umask 022 -- ok [4] $ mkdir 974 -- ok [6] $ touch 974/f1 -- ok [7] $ ls -dl 974/f1 | awk '{sub(/\./, "", $1); print $1 }' -- ok [10] $ setfacl -R -d -m mask:007 974 -- ok [11] $ touch 974/f2 -- ok [12] $ ls -dl 974/f2 | awk '{ print $1 }' -- ok [15] $ umask 077 -- ok [16] $ touch f3 -- ok [17] $ ls -dl f3 | awk '{sub(/\./, "", $1); print $1 }' -- ok [20] $ rm -rf 974 -- ok 11 commands (11 passed, 0 failed) performing 974_remote with bin='bin' daemon='daemon' users='users'... [4] $ umask 022 -- ok [5] $ lfs mkdir -i 1 974 -- ok [7] $ touch 974/f1 -- ok [8] $ ls -dl 974/f1 | awk '{ sub(/\.$/, "", $1); print $1 }' -- ok [11] $ setfacl -R -d -m mask:007 974 -- ok [12] $ touch 974/f2 -- ok [13] $ ls -dl 974/f2 | awk '{ sub(/\.$/, "", $1); print $1 }' -- ok [16] $ umask 077 -- ok [17] $ touch f3 -- ok [18] $ ls -dl f3 | awk '{ sub(/\.$/, "", $1); print $1 }' -- ok [21] $ rm -rf 974 -- ok 11 commands (11 passed, 0 failed) LU-2561 newly created file is same size as directory... performing 2561 with bin='bin' daemon='daemon' users='users'... [3] $ mkdir -p 2561 -- ok [4] $ cd 2561 -- ok [5] $ getfacl --access . | setfacl -d -M- . -- ok [6] $ touch f1 -- ok [7] $ stat -c '%s' f1 -- ok [9] $ cd .. -- ok [10] $ rm -rf 2561 -- ok 7 commands (7 passed, 0 failed) performing 4924 with bin='bin' daemon='daemon' users='users'... [3] $ mkdir 4924 -- ok [4] $ cd 4924 -- ok [5] $ touch f -- ok [6] $ chmod u=rwx,g=rwxs f -- ok [7] $ ls -l f | awk -- '{sub(/\./, "", $1); print $1, $3, $4 }' -- ok [9] $ touch f -- ok [10] $ ls -l f | awk -- '{sub(/\./, "", $1); print $1, $3, $4 }' -- ok [12] $ cd .. -- ok [13] $ rm -rf 4924 -- ok 9 commands (9 passed, 0 failed) PASS 103a (221s) == sanity test 103b: umask lfs setstripe ================= 15:13:26 (1776194006) PASS 103b (68s) == sanity test 103c: 'cp -rp' won't set empty acl ======== 15:14:35 (1776194075) getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names PASS 103c (6s) == sanity test 103e: inheritance of big amount of default ACLs ========================================================== 15:14:41 (1776194081) mdc.lustre-MDT0000-mdc-ffff95f306365800.stats=clear mdc.lustre-MDT0001-mdc-ffff95f306365800.stats=clear debug=0 7000 default ACLs created File: /mnt/lustre/d103e.sanity Size: 4096 Blocks: 120 IO Block: 4096 directory Device: 2c54f966h/743766374d Inode: 144115205423500033 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:14:44.000000000 -0400 Modify: 2026-04-14 15:14:44.000000000 -0400 Change: 2026-04-14 15:28:54.000000000 -0400 Birth: 2026-04-14 15:14:44.000000000 -0400 File: /mnt/lustre/d103e.sanity/f103e.sanity Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205423500035 Links: 1 Access: (0664/-rw-rw-r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:28:56.000000000 -0400 Modify: 2026-04-14 15:28:56.000000000 -0400 Change: 2026-04-14 15:28:56.000000000 -0400 Birth: 2026-04-14 15:28:55.000000000 -0400 7000 ACLs were inherited setfacl: /mnt/lustre/d103e.sanity/f103e.sanity: Argument list too long Added 1187 more ACLs to the file Total 8188 ACLs in file mdc.lustre-MDT0000-mdc-ffff95f306365800.stats= snapshot_time 1776195325.994932586 secs.nsecs start_time 1776194084.508563078 secs.nsecs elapsed_time 1241.486369508 secs.nsecs req_waittime 85126 samples [usecs] 1307 205544 702987852 8596832429014 req_active 93025 samples [reqs] 1 4 130944 208786 ldlm_ibits_enqueue 28601 samples [reqs] 1 1 28601 28601 ost_set_info 1 samples [usecs] 12208 12208 12208 149035264 mds_close 1 samples [usecs] 6595 6595 6595 43494025 mds_connect 5 samples [usecs] 10993 33489 109590 2783844320 mds_getxattr 20115 samples [usecs] 1359 58654 137529729 1221931831149 ldlm_cancel 28160 samples [usecs] 1307 62116 215767979 2216312381851 obd_ping 53 samples [usecs] 3285 27284 539438 7269808364 mdc.lustre-MDT0001-mdc-ffff95f306365800.stats= snapshot_time 1776195325.995261102 secs.nsecs start_time 1776194084.508673393 secs.nsecs elapsed_time 1241.486587709 secs.nsecs req_waittime 246 samples [usecs] 2052 79236 2779945 45711765925 req_active 246 samples [reqs] 1 1 246 246 ost_set_info 1 samples [usecs] 7618 7618 7618 58033924 obd_ping 245 samples [usecs] 2052 79236 2772327 45653732001 debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS 103e (1245s) == sanity test 103f: changelog doesn't interfere with default ACLs buffers ========================================================== 15:35:26 (1776195326) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 PASS 103f (17s) == sanity test 104a: lfs df [-ih] [path] test =================================================================================== 15:35:43 (1776195343) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 4724 1282964 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 3356 1284332 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 95388 3511632 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1432 3605588 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 96820 7117220 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 1.9K 998.1K 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1000.0K 376 999.6K 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 256.0K 1.4K 254.6K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 256.0K 1.4K 254.6K 1% /mnt/lustre[OST:1] filesystem_summary: 511.4K 2.3K 509.2K 1% /mnt/lustre UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 1.3G 4.6M 1.2G 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1.3G 3.3M 1.2G 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3.7G 93.2M 3.3G 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.7G 1.4M 3.4G 1% /mnt/lustre[OST:1] filesystem_summary: 7.3G 94.6M 6.8G 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 1958 1022042 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 376 1023624 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 1471 260673 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 1434 260710 1% /mnt/lustre[OST:1] filesystem_summary: 523717 2334 521383 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 4724 1282964 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 3356 1284332 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 95388 3511632 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1432 3605588 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 96820 7117220 2% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1000.0K 1.9K 998.1K 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1000.0K 376 999.6K 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 256.0K 1.4K 254.6K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 256.0K 1.4K 254.6K 1% /mnt/lustre[OST:1] filesystem_summary: 511.4K 2.3K 509.2K 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 4724 1282964 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 3356 1284332 1% /mnt/lustre[MDT:1] lustre-OST0001_UUID 3833116 1432 3605588 1% /mnt/lustre[OST:1] filesystem_summary: 3833116 1432 3605588 1% /mnt/lustre oleg421-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff95f306365800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff95f306365800.ost_server_uuid in FULL state after 0 sec UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 4724 1282964 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 3356 1284332 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 95388 3511632 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1432 3605588 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 96820 7117220 2% /mnt/lustre PASS 104a (15s) == sanity test 104b: runas -u 500 -g 500 lfs check servers test ============================================================================== 15:35:58 (1776195358) PASS 104b (6s) == sanity test 104c: Verify df vs lfs_df stays same after recordsize change ========================================================== 15:36:04 (1776195364) SKIP: sanity test_104c zfs only test SKIP 104c (4s) == sanity test 105a: flock when mounted without -o flock test ================================================================== 15:36:08 (1776195368) PASS 105a (7s) == sanity test 105b: fcntl when mounted without -o flock test ================================================================== 15:36:15 (1776195375) PASS 105b (6s) == sanity test 105c: lockf when mounted without -o flock test ========================================================== 15:36:21 (1776195381) PASS 105c (7s) == sanity test 105d: flock race (should not freeze) ================================================================== 15:36:28 (1776195388) striped dir -i1 -c2 -H crush /mnt/lustre/d105d.sanity fail_loc=0x80000315 fcntl cmd 7 failed: Input/output error fcntl cmd 5 failed: Invalid argument thread 1: set write lock (blocking): rc = 0 thread 2: unlock: rc = 0 thread 2: unlock done: rc = 0 thread 2: set write lock (non-blocking): rc = 0 thread 2: set write lock done: rc = 0 thread 1: set write lock done: rc = 0 thread 1: unlock: rc = 0 thread 1: unlock done: rc = 0 PASS 105d (19s) == sanity test 105e: Two conflicting flocks from same process ========================================================== 15:36:47 (1776195407) PASS 105e (9s) == sanity test 106: attempt exec of dir followed by chown of that dir ========================================================== 15:36:56 (1776195416) striped dir -i0 -c2 -H all_char /mnt/lustre/d106.sanity /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12065: /mnt/lustre/d106.sanity: Is a directory PASS 106 (7s) == sanity test 107: Coredump on SIG ====================== 15:37:04 (1776195424) kernel.core_pattern = core kernel.core_uses_pid = 0 /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12091: 116580 Segmentation fault (core dumped) sleep 60 kernel.core_pattern = |/usr/lib/systemd/systemd-coredump sysctl: "%P" must be of the form name=value sysctl: "%u" must be of the form name=value sysctl: "%g" must be of the form name=value sysctl: "%s" must be of the form name=value sysctl: "%t" must be of the form name=value sysctl: "%c" must be of the form name=value sysctl: "%h" must be of the form name=value sysctl: "%e" must be of the form name=value kernel.core_uses_pid = 1 PASS 107 (10s) == sanity test 110: filename length checking ============= 15:37:14 (1776195434) striped dir -i0 -c2 -H all_char /mnt/lustre/d110.sanity striped dir -i0 -c2 -H crush /mnt/lustre/d110.sanity/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa lfs mkdir: dirstripe error on '/mnt/lustre/d110.sanity/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb': File name too long lfs setdirstripe: cannot create dir '/mnt/lustre/d110.sanity/bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb': File name too long touch: cannot touch '/mnt/lustre/d110.sanity/yyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy': File name too long total 8 drwxr-xr-x 2 root root 8192 Apr 14 15:37 aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa -rw-r--r-- 1 root root 0 Apr 14 15:37 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx PASS 110 (8s) SKIP: sanity test_115 skipping SLOW test 115 == sanity test 116a: stripe QOS: free space balance ============================================================================= 15:37:24 (1776195444) Free space priority 90% Waiting for MDT destroys to complete OST kbytes available: 3511632 3605588 Min free space: OST 0: 3511632 Max free space: OST 1: 3605588 striped dir -i0 -c2 -H all_char /mnt/lustre/d116a.sanity/OST0 Check for uneven OSTs: diff=93956KB (2%) must be > 17% ...no Fill 17% remaining space in OST0 with 596977KB .................................................................................................................................................................................................................................................................................................... Waiting for MDT destroys to complete OST kbytes available: 2899088 3605588 Min free space: OST 0: 2899088 Max free space: OST 1: 3605588 diff=706500=24% must be > 17% for QOS mode...ok writing 600 files to QOS-assigned OSTs ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................wrote 600 200k files Note: free space may not be updated, so measurements might be off Waiting for MDT destroys to complete OST kbytes available: 2860672 3536996 Min free space: OST 0: 2860672 Max free space: OST 1: 3536996 free space delta: orig 706500 final 676324 Wrote 38416KB to smaller OST 0 Wrote 68592KB to larger OST 1 Wrote 78% more data to larger OST 1 lustre-OST0000_UUID 266 files created on smaller OST 0 lustre-OST0001_UUID 334 files created on larger OST 1 Wrote 25% more files to larger OST 1 Waiting for MDT destroys to complete cleanup time 25 PASS 116a (147s) == sanity test 116b: QoS shouldn't LBUG if not enough OSTs found on the 2nd pass ========================================================== 15:39:51 (1776195591) lod.lustre-MDT0000-mdtlov.qos_threshold_rr=0 lov.lustre-MDT0000-mdtlov.qos_threshold_rr=0 fail_loc=0x147 total: 20 open/close in 0.53 seconds: 37.96 ops/second fail_loc=0 lod.lustre-MDT0000-mdtlov.qos_threshold_rr=17% lov.lustre-MDT0000-mdtlov.qos_threshold_rr=17% PASS 116b (12s) == sanity test 117: verify osd extend ==================== 15:40:03 (1776195603) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0624313 s, 16.8 MB/s fail_loc=0x21e fail_loc=0 Truncate succeeded. PASS 117 (7s) resend_count is set to 4 4 == sanity test 118a: verify O_SYNC works ================= 15:40:10 (1776195610) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.00936337 s, 14.0 MB/s PASS 118a (7s) == sanity test 118b: Reclaim dirty pages on fatal error ==================================================================== 15:40:17 (1776195617) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.00940749 s, 13.9 MB/s fail_val=0 fail_loc=0x217 open: No such file or directory fail_val=0 fail_loc=0 Dirty pages not leaked on ENOENT PASS 118b (9s) SKIP: sanity test_118c skipping ALWAYS excluded test 118c resend_count is set to 4 4 SKIP: sanity test_118d skipping ALWAYS excluded test 118d == sanity test 118f: Simulate unrecoverable OSC side error ==================================================================== 15:40:29 (1776195629) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0138601 s, 9.5 MB/s fail_loc=0x8000040a write: Input/output error fail_loc=0x0 No pages locked after fsync 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.00762041 s, 17.2 MB/s PASS 118f (6s) == sanity test 118g: Don't stay in wait if we got local -ENOMEM ==================================================================== 15:40:35 (1776195635) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.00909374 s, 14.4 MB/s fail_loc=0x406 write: Input/output error fail_loc=0 No pages locked after fsync 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.00982867 s, 13.3 MB/s PASS 118g (7s) == sanity test 118h: Verify timeout in handling recoverables errors ==================================================================== 15:40:42 (1776195642) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0068982 s, 19.0 MB/s fail_val=0 fail_loc=0x20e write: Input/output error fail_val=0 fail_loc=0 No pages locked after fsync PASS 118h (19s) resend_count is set to 4 4 == sanity test 118i: Fix error before timeout in recoverable error ==================================================================== 15:41:01 (1776195661) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0298527 s, 4.4 MB/s fail_val=0 fail_loc=0x20e fail_val=0 fail_loc=0 No pages locked after fsync PASS 118i (17s) resend_count is set to 4 4 == sanity test 118j: Simulate unrecoverable OST side error ==================================================================== 15:41:18 (1776195678) 2+0 records in 2+0 records out 131072 bytes (131 kB, 128 KiB) copied, 0.0266098 s, 4.9 MB/s fail_val=0 fail_loc=0x220 write: Bad address fail_val=0 fail_loc=0x0 No pages locked after fsync PASS 118j (10s) == sanity test 118k: bio alloc -ENOMEM and IO TERM handling =================================================================== 15:41:29 (1776195689) fail_val=0 fail_loc=0x20e striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d118k.sanity /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126397 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.283259 s, 37.0 MB/s /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12781: kill: (126400) - No such process 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.370769 s, 28.3 MB/s /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12781: kill: (126403) - No such process /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126406 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126410 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126413 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126416 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126419 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126422 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 12782: 126425 Terminated ( dd if=/dev/zero of=$DIR/$tdir/$tfile-$i bs=1M count=10 || error "dd to $DIR/$tdir/$tfile-$i failed" ) fail_val=0 fail_loc=0 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 3.86541 s, 2.7 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 4.94703 s, 2.1 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 4.49002 s, 2.3 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 3.50089 s, 3.0 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 2.96162 s, 3.5 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 5.87529 s, 1.8 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 6.50646 s, 1.6 MB/s 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 10.1124 s, 1.0 MB/s PASS 118k (20s) == sanity test 118l: fsync dir =========================== 15:41:49 (1776195709) striped dir -i0 -c2 -H crush /mnt/lustre/d118l.sanity PASS 118l (8s) == sanity test 118m: fdatasync dir ======================= 15:41:56 (1776195716) striped dir -i0 -c2 -H all_char /mnt/lustre/d118m.sanity PASS 118m (7s) resend_count is set to 4 4 == sanity test 118n: statfs() sends OST_STATFS requests in parallel ========================================================== 15:42:03 (1776195723) fail_val=0 fail_loc=0x242 fail_val=0 fail_loc=0 PASS 118n (12s) == sanity test 119a: Short directIO read must return actual read amount ========================================================== 15:42:15 (1776195735) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (7s) == sanity test 119b: Sparse directIO read must return actual read amount ========================================================== 15:42:22 (1776195742) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425981 s, 24.6 MB/s PASS 119b (6s) == sanity test 119c: Testing for direct read hitting hole ========================================================== 15:42:28 (1776195748) directio on /mnt/lustre/f119c.sanity for 1x1048576 bytes PASS directio on /mnt/lustre/f119c.sanity for 2x1048576 bytes PASS PASS 119c (6s) == sanity test 119d: The DIO path should try to send a new rpc once one is completed ========================================================== 15:42:34 (1776195754) directio on /mnt/lustre/f119d.sanity for 1x1048576 bytes PASS fail_loc=0x40d directio on /mnt/lustre/f119d.sanity for 4x1048576 bytes PASS fail_loc=0 the DIO writes have completed, now wait for the reads (should not block very long) PASS 119d (12s) == sanity test 120a: Early Lock Cancel: mkdir test ======= 15:42:46 (1776195766) striped dir -i0 -c1 -H crush /mnt/lustre/d120a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 striped dir -i0 -c1 -H crush /mnt/lustre/d120a.sanity/d1 ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120a (9s) == sanity test 120b: Early Lock Cancel: create test ====== 15:42:55 (1776195775) striped dir -i0 -c2 -H crush /mnt/lustre/d120b.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120b (10s) == sanity test 120c: Early Lock Cancel: link test ======== 15:43:05 (1776195785) striped dir -i0 -c1 -H all_char /mnt/lustre/d120c.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 striped dir -i0 -c1 -H crush /mnt/lustre/d120c.sanity/d1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d120c.sanity/d2 ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120c (11s) == sanity test 120d: Early Lock Cancel: setattr test ===== 15:43:16 (1776195796) striped dir -i0 -c1 -H all_char /mnt/lustre/d120d.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120d (10s) == sanity test 120e: Early Lock Cancel: unlink test ====== 15:43:26 (1776195806) striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d120e.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 1+0 records in 1+0 records out 512 bytes copied, 0.0225428 s, 22.7 kB/s 1+0 records in 1+0 records out 512 bytes copied, 0.0198989 s, 25.7 kB/s ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120e (17s) == sanity test 120f: Early Lock Cancel: rename test ====== 15:43:43 (1776195823) striped dir -i0 -c1 -H all_char /mnt/lustre/d120f.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 striped dir -i0 -c1 -H all_char /mnt/lustre/d120f.sanity/d1 striped dir -i0 -c1 -H all_char /mnt/lustre/d120f.sanity/d2 1+0 records in 1+0 records out 512 bytes copied, 0.0298942 s, 17.1 kB/s 1+0 records in 1+0 records out 512 bytes copied, 0.0276665 s, 18.5 kB/s 1+0 records in 1+0 records out 512 bytes copied, 0.0280491 s, 18.3 kB/s 1+0 records in 1+0 records out 512 bytes copied, 0.0152514 s, 33.6 kB/s rename returned 0: Success ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120f (21s) == sanity test 120g: Early Lock Cancel: performance test ========================================================== 15:44:05 (1776195845) ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=400 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=400 create 10000 files striped dir -i0 -c2 -H all_char /mnt/lustre/d120g.sanity - open/close 574 (time 1776195863.21 total 10.01 last 57.33) - open/close 1187 (time 1776195873.24 total 20.04 last 61.11) - open/close 1787 (time 1776195883.25 total 30.05 last 59.95) - open/close 2385 (time 1776195893.25 total 40.05 last 59.79) - open/close 2903 (time 1776195903.26 total 50.07 last 51.73) - open/close 3421 (time 1776195913.26 total 60.07 last 51.80) - open/close 3950 (time 1776195923.27 total 70.08 last 52.85) - open/close 4536 (time 1776195933.28 total 80.09 last 58.54) - open/close 5213 (time 1776195943.29 total 90.09 last 67.67) - open/close 5932 (time 1776195953.29 total 100.09 last 71.89) - open/close 6513 (time 1776195963.30 total 110.11 last 58.03) - open/close 7110 (time 1776195973.31 total 120.11 last 59.67) - open/close 7689 (time 1776195983.31 total 130.11 last 57.90) - open/close 8285 (time 1776195993.31 total 140.11 last 59.58) - open/close 8891 (time 1776196003.31 total 150.12 last 60.58) - open/close 9506 (time 1776196013.36 total 160.16 last 61.24) total: 10000 open/close in 168.28 seconds: 59.43 ops/second total: 1 cancels, 0 blockings rm 10000 files total: 10000 removes in 175 total: 1 cancels, 0 blockings ldlm.namespaces.lustre-MDT0000-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0000-osc-ffff95f306365800.lru_size=0 ldlm.namespaces.lustre-OST0001-osc-ffff95f306365800.lru_size=0 PASS 120g (362s) == sanity test 121: read cancel race ===================== 15:50:07 (1776196207) fail_loc=0x310 fail_loc=0 PASS 121 (8s) == sanity test 123aa: verify statahead work ============== 15:50:15 (1776196215) striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123aa.sanity total: 100 open/close in 2.44 seconds: 40.94 ops/second llite.lustre-ffff95f306365800.statahead_max=0 101 real 0m1.573s user 0m0.008s sys 0m0.159s ls -l 100 files without statahead: 1 sec llite.lustre-ffff95f306365800.statahead_max=32 32 101 real 0m0.439s user 0m0.003s sys 0m0.065s ls -l 100 files with statahead: 0 sec statahead total: 26 statahead wrong: 0 agl total: 26 - open/close 643 (time 1776196238.88 total 10.01 last 64.25) total: 900 open/close in 14.17 seconds: 63.54 ops/second llite.lustre-ffff95f306365800.statahead_max=0 1001 real 0m15.403s user 0m0.034s sys 0m1.401s ls -l 1000 files without statahead: 15 sec llite.lustre-ffff95f306365800.statahead_max=32 32 1001 real 0m3.107s user 0m0.019s sys 0m0.376s ls -l 1000 files with statahead: 3 sec statahead total: 27 statahead wrong: 0 agl total: 27 ls -l done rm -r /mnt/lustre/d123aa.sanity/: 10 seconds rm done statahead total: 27 statahead wrong: 0 agl total: 27 PASS 123aa (75s) == sanity test 123ab: verify statahead work by using statx ========================================================== 15:51:30 (1776196290) striped dir -i1 -c2 -H crush /mnt/lustre/d123ab.sanity total: 100 open/close in 1.66 seconds: 60.24 ops/second llite.lustre-ffff95f306365800.statahead_max=0 100 real 0m1.623s user 0m0.008s sys 0m0.135s statx -l 100 files without statahead: 2 sec llite.lustre-ffff95f306365800.statahead_max=32 32 100 real 0m0.552s user 0m0.005s sys 0m0.061s statx -l 100 files with statahead: 0 sec statahead total: 28 statahead wrong: 0 agl total: 28 - open/close 619 (time 1776196313.17 total 10.01 last 61.81) total: 900 open/close in 14.47 seconds: 62.21 ops/second llite.lustre-ffff95f306365800.statahead_max=0 1000 real 0m17.024s user 0m0.094s sys 0m1.177s statx -l 1000 files without statahead: 17 sec llite.lustre-ffff95f306365800.statahead_max=32 32 1000 real 0m2.564s user 0m0.034s sys 0m0.375s statx -l 1000 files with statahead: 2 sec statahead total: 29 statahead wrong: 0 agl total: 29 statx -l done rm -r /mnt/lustre/d123ab.sanity/: 10 seconds rm done statahead total: 29 statahead wrong: 0 agl total: 29 PASS 123ab (76s) == sanity test 123ac: verify statahead work by using statx without glimpse RPCs ========================================================== 15:52:47 (1776196367) striped dir -i1 -c2 -H crush /mnt/lustre/d123ac.sanity total: 100 open/close in 1.76 seconds: 56.68 ops/second llite.lustre-ffff95f306365800.statahead_max=0 208 real 0m1.043s user 0m0.003s sys 0m0.120s statx -c "%n %i %A %h %u %g %W %X %Z" -D 100 files without statahead: 1 sec llite.lustre-ffff95f306365800.statahead_max=32 32 208 real 0m0.386s user 0m0.003s sys 0m0.040s statx -c "%n %i %A %h %u %g %W %X %Z" -D 100 files with statahead: 1 sec statahead total: 30 statahead wrong: 0 agl total: 29 - open/close 627 (time 1776196390.21 total 10.00 last 62.69) total: 900 open/close in 14.60 seconds: 61.66 ops/second llite.lustre-ffff95f306365800.statahead_max=0 2008 real 0m8.464s user 0m0.029s sys 0m0.920s statx -c "%n %i %A %h %u %g %W %X %Z" -D 1000 files without statahead: 9 sec llite.lustre-ffff95f306365800.statahead_max=32 32 2008 real 0m2.354s user 0m0.013s sys 0m0.204s statx -c "%n %i %A %h %u %g %W %X %Z" -D 1000 files with statahead: 2 sec statahead total: 31 statahead wrong: 0 agl total: 29 statx -c "%n %i %A %h %u %g %W %X %Z" -D done rm -r /mnt/lustre/d123ac.sanity/: 9 seconds rm done statahead total: 31 statahead wrong: 0 agl total: 29 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ac.sanity total: 100 open/close in 1.85 seconds: 54.19 ops/second llite.lustre-ffff95f306365800.statahead_max=0 100 real 0m0.080s user 0m0.002s sys 0m0.020s statx --cached=always -D 100 files without statahead: 0 sec llite.lustre-ffff95f306365800.statahead_max=32 32 100 real 0m0.139s user 0m0.001s sys 0m0.022s statx --cached=always -D 100 files with statahead: 0 sec statahead total: 31 statahead wrong: 0 agl total: 29 - open/close 597 (time 1776196448.55 total 10.01 last 59.65) total: 900 open/close in 14.65 seconds: 61.44 ops/second llite.lustre-ffff95f306365800.statahead_max=0 1000 real 0m0.147s user 0m0.004s sys 0m0.025s statx --cached=always -D 1000 files without statahead: 0 sec llite.lustre-ffff95f306365800.statahead_max=32 32 1000 real 0m0.161s user 0m0.001s sys 0m0.023s statx --cached=always -D 1000 files with statahead: 0 sec statahead total: 31 statahead wrong: 0 agl total: 29 - open/close 650 (time 1776196473.66 total 10.01 last 64.93) - open/close 1327 (time 1776196483.67 total 20.01 last 67.67) - open/close 1967 (time 1776196493.68 total 30.03 last 63.91) - open/close 2581 (time 1776196503.68 total 40.03 last 61.39) - open/close 3180 (time 1776196513.69 total 50.03 last 59.87) - open/close 3854 (time 1776196523.70 total 60.05 last 67.30) - open/close 4514 (time 1776196533.73 total 70.08 last 65.81) - open/close 5252 (time 1776196543.74 total 80.09 last 73.71) - open/close 5862 (time 1776196553.75 total 90.10 last 60.96) - open/close 6554 (time 1776196563.75 total 100.10 last 69.20) - open/close 7071 (time 1776196573.76 total 110.10 last 51.66) - open/close 7700 (time 1776196583.78 total 120.12 last 62.77) - open/close 8370 (time 1776196593.79 total 130.14 last 66.91) total: 9000 open/close in 139.37 seconds: 64.57 ops/second llite.lustre-ffff95f306365800.statahead_max=0 10000 real 0m0.215s user 0m0.003s sys 0m0.047s statx --cached=always -D 10000 files without statahead: 0 sec llite.lustre-ffff95f306365800.statahead_max=32 32 10000 real 0m0.219s user 0m0.001s sys 0m0.047s statx --cached=always -D 10000 files with statahead: 1 sec statahead total: 31 statahead wrong: 0 agl total: 29 - open/close 629 (time 1776196622.61 total 10.00 last 62.89) - open/close 1203 (time 1776196632.61 total 20.01 last 57.37) - open/close 1856 (time 1776196642.62 total 30.01 last 65.26) - open/close 2526 (time 1776196652.63 total 40.03 last 66.92) - open/close 3178 (time 1776196662.64 total 50.04 last 65.13) - open/close 3875 (time 1776196672.65 total 60.04 last 69.67) - open/close 4563 (time 1776196682.66 total 70.05 last 68.73) - open/close 5133 (time 1776196692.67 total 80.06 last 56.96) - open/close 5552 (time 1776196702.67 total 90.06 last 41.88) - open/close 6077 (time 1776196712.69 total 100.09 last 52.38) - open/close 6566 (time 1776196722.70 total 110.09 last 48.87) - open/close 7184 (time 1776196732.70 total 120.10 last 61.78) - open/close 7804 (time 1776196742.71 total 130.10 last 61.96) - open/close 8507 (time 1776196752.72 total 140.12 last 70.21) - open/close 9144 (time 1776196762.72 total 150.12 last 63.70) - open/close 9795 (time 1776196772.74 total 160.13 last 65.00) - open/close 10000 (time 1776196776.16 total 163.55 last 59.93) - open/close 10631 (time 1776196786.17 total 173.56 last 63.05) - open/close 11253 (time 1776196796.17 total 183.56 last 62.19) - open/close 11891 (time 1776196806.18 total 193.58 last 63.71) - open/close 12506 (time 1776196816.19 total 203.58 last 61.49) - open/close 13116 (time 1776196826.20 total 213.59 last 60.93) - open/close 13731 (time 1776196836.21 total 223.60 last 61.43) - open/close 14384 (time 1776196846.22 total 233.61 last 65.25) - open/close 15033 (time 1776196856.22 total 243.61 last 64.89) - open/close 15645 (time 1776196866.23 total 253.62 last 61.15) - open/close 16283 (time 1776196876.25 total 263.64 last 63.67) - open/close 16928 (time 1776196886.25 total 273.65 last 64.47) - open/close 17472 (time 1776196896.28 total 283.67 last 54.27) - open/close 18061 (time 1776196906.29 total 293.68 last 58.85) - open/close 18583 (time 1776196916.30 total 303.69 last 52.14) - open/close 19151 (time 1776196926.30 total 313.69 last 56.77) - open/close 19771 (time 1776196936.33 total 323.72 last 61.83) - open/close 20000 (time 1776196940.18 total 327.57 last 59.51) - open/close 20597 (time 1776196950.20 total 337.59 last 59.60) - open/close 21251 (time 1776196960.20 total 347.60 last 65.35) - open/close 21889 (time 1776196970.21 total 357.61 last 63.74) - open/close 22542 (time 1776196980.22 total 367.61 last 65.26) - open/close 23136 (time 1776196990.22 total 377.61 last 59.39) - open/close 23839 (time 1776197000.23 total 387.62 last 70.27) - open/close 24408 (time 1776197010.23 total 397.63 last 56.85) - open/close 25055 (time 1776197020.24 total 407.63 last 64.68) - open/close 25683 (time 1776197030.24 total 417.64 last 62.76) - open/close 26371 (time 1776197040.26 total 427.65 last 68.72) - open/close 27070 (time 1776197050.27 total 437.66 last 69.80) - open/close 27682 (time 1776197060.29 total 447.68 last 61.11) - open/close 28320 (time 1776197070.30 total 457.69 last 63.69) - open/close 28956 (time 1776197080.31 total 467.70 last 63.55) - open/close 29610 (time 1776197090.31 total 477.71 last 65.38) - open/close 30000 (time 1776197096.67 total 484.06 last 61.39) - open/close 30618 (time 1776197106.67 total 494.07 last 61.75) - open/close 31179 (time 1776197116.68 total 504.08 last 56.05) - open/close 31784 (time 1776197126.69 total 514.08 last 60.48) - open/close 32399 (time 1776197136.69 total 524.08 last 61.46) - open/close 33051 (time 1776197146.69 total 534.09 last 65.18) - open/close 33670 (time 1776197156.70 total 544.09 last 61.86) - open/close 34316 (time 1776197166.72 total 554.11 last 64.51) - open/close 34938 (time 1776197176.73 total 564.13 last 62.09) - open/close 35544 (time 1776197186.74 total 574.13 last 60.58) - open/close 36229 (time 1776197196.74 total 584.13 last 68.49) - open/close 36891 (time 1776197206.74 total 594.13 last 66.19) - open/close 37497 (time 1776197216.74 total 604.14 last 60.57) - open/close 38084 (time 1776197226.75 total 614.14 last 58.69) - open/close 38650 (time 1776197236.75 total 624.14 last 56.59) - open/close 39270 (time 1776197246.75 total 634.14 last 61.97) - open/close 39904 (time 1776197256.76 total 644.15 last 63.37) - open/close 40447 (time 1776197266.76 total 654.16 last 54.27) - open/close 41054 (time 1776197276.77 total 664.16 last 60.66) - open/close 41666 (time 1776197286.78 total 674.17 last 61.17) - open/close 42267 (time 1776197296.79 total 684.18 last 60.01) - open/close 42886 (time 1776197306.80 total 694.19 last 61.86) - open/close 43533 (time 1776197316.82 total 704.22 last 64.53) - open/close 44161 (time 1776197326.82 total 714.22 last 62.79) - open/close 44773 (time 1776197336.83 total 724.22 last 61.19) - open/close 45375 (time 1776197346.83 total 734.23 last 60.16) - open/close 45979 (time 1776197356.84 total 744.23 last 60.36) - open/close 46579 (time 1776197366.84 total 754.23 last 59.99) - open/close 47209 (time 1776197376.84 total 764.24 last 62.99) - open/close 47778 (time 1776197386.85 total 774.24 last 56.88) - open/close 48364 (time 1776197396.85 total 784.24 last 58.57) - open/close 48898 (time 1776197406.87 total 794.26 last 53.30) - open/close 49381 (time 1776197416.87 total 804.26 last 48.30) - open/close 49831 (time 1776197426.87 total 814.27 last 44.98) - open/close 50000 (time 1776197430.61 total 818.00 last 45.27) - open/close 50504 (time 1776197440.61 total 828.00 last 50.38) - open/close 51026 (time 1776197450.63 total 838.02 last 52.12) - open/close 51575 (time 1776197460.64 total 848.03 last 54.86) - open/close 52132 (time 1776197470.64 total 858.03 last 55.69) - open/close 52686 (time 1776197480.65 total 868.05 last 55.31) - open/close 53215 (time 1776197490.66 total 878.05 last 52.87) - open/close 53795 (time 1776197500.68 total 888.07 last 57.89) - open/close 54393 (time 1776197510.69 total 898.08 last 59.75) - open/close 55019 (time 1776197520.70 total 908.10 last 62.51) - open/close 55646 (time 1776197530.71 total 918.10 last 62.64) - open/close 56259 (time 1776197540.71 total 928.11 last 61.29) - open/close 56871 (time 1776197550.73 total 938.12 last 61.10) - open/close 57510 (time 1776197560.74 total 948.13 last 63.83) - open/close 58085 (time 1776197570.75 total 958.14 last 57.45) - open/close 58707 (time 1776197580.76 total 968.16 last 62.12) - open/close 59192 (time 1776197590.79 total 978.18 last 48.39) - open/close 59738 (time 1776197600.79 total 988.18 last 54.58) - open/close 60000 (time 1776197604.53 total 991.92 last 70.15) - open/close 60574 (time 1776197614.55 total 1001.94 last 57.28) - open/close 61124 (time 1776197624.55 total 1011.94 last 54.99) - open/close 61746 (time 1776197634.57 total 1021.96 last 62.04) - open/close 62308 (time 1776197644.58 total 1031.98 last 56.13) - open/close 62873 (time 1776197654.59 total 1041.99 last 56.45) - open/close 63477 (time 1776197664.60 total 1051.99 last 60.37) - open/close 64091 (time 1776197674.62 total 1062.02 last 61.24) - open/close 64715 (time 1776197684.63 total 1072.02 last 62.37) - open/close 65294 (time 1776197694.64 total 1082.03 last 57.84) - open/close 65853 (time 1776197704.65 total 1092.05 last 55.82) - open/close 66375 (time 1776197714.66 total 1102.05 last 52.18) - open/close 67007 (time 1776197724.67 total 1112.06 last 63.12) - open/close 67618 (time 1776197734.68 total 1122.07 last 61.04) - open/close 68178 (time 1776197744.69 total 1132.08 last 55.95) - open/close 68732 (time 1776197754.69 total 1142.08 last 55.38) - open/close 69188 (time 1776197764.70 total 1152.09 last 45.55) - open/close 69657 (time 1776197774.70 total 1162.09 last 46.90) - open/close 70000 (time 1776197781.25 total 1168.64 last 52.40) - open/close 70585 (time 1776197791.27 total 1178.66 last 58.37) - open/close 71182 (time 1776197801.27 total 1188.66 last 59.70) - open/close 71771 (time 1776197811.29 total 1198.68 last 58.78) - open/close 72356 (time 1776197821.30 total 1208.69 last 58.47) - open/close 72954 (time 1776197831.30 total 1218.70 last 59.76) - open/close 73577 (time 1776197841.31 total 1228.70 last 62.28) - open/close 74217 (time 1776197851.31 total 1238.71 last 63.96) - open/close 74802 (time 1776197861.32 total 1248.72 last 58.44) - open/close 75434 (time 1776197871.33 total 1258.72 last 63.15) - open/close 76059 (time 1776197881.33 total 1268.73 last 62.49) - open/close 76703 (time 1776197891.34 total 1278.73 last 64.39) - open/close 77325 (time 1776197901.36 total 1288.75 last 62.04) - open/close 77966 (time 1776197911.37 total 1298.76 last 64.05) - open/close 78629 (time 1776197921.37 total 1308.77 last 66.28) - open/close 79232 (time 1776197931.40 total 1318.79 last 60.14) - open/close 79780 (time 1776197941.40 total 1328.79 last 54.80) - open/close 80000 (time 1776197946.41 total 1333.81 last 43.87) - open/close 80529 (time 1776197956.43 total 1343.82 last 52.84) - open/close 81051 (time 1776197966.43 total 1353.82 last 52.16) - open/close 81638 (time 1776197976.44 total 1363.83 last 58.67) - open/close 82238 (time 1776197986.45 total 1373.84 last 59.94) - open/close 82841 (time 1776197996.45 total 1383.85 last 60.27) - open/close 83456 (time 1776198006.46 total 1393.86 last 61.43) - open/close 84124 (time 1776198016.47 total 1403.86 last 66.76) - open/close 84784 (time 1776198026.48 total 1413.88 last 65.92) - open/close 85379 (time 1776198036.50 total 1423.89 last 59.41) - open/close 85929 (time 1776198046.51 total 1433.90 last 54.95) - open/close 86535 (time 1776198056.52 total 1443.92 last 60.50) - open/close 87118 (time 1776198066.53 total 1453.92 last 58.25) - open/close 87726 (time 1776198076.55 total 1463.94 last 60.69) - open/close 88328 (time 1776198086.57 total 1473.96 last 60.09) - open/close 88920 (time 1776198096.58 total 1483.97 last 59.13) - open/close 89487 (time 1776198106.58 total 1493.98 last 56.69) total: 90000 open/close in 1502.69 seconds: 59.89 ops/second llite.lustre-ffff95f306365800.statahead_max=0 100000 real 0m1.116s user 0m0.019s sys 0m0.280s statx --cached=always -D 100000 files without statahead: 1 sec llite.lustre-ffff95f306365800.statahead_max=32 32 100000 real 0m1.045s user 0m0.016s sys 0m0.272s statx --cached=always -D 100000 files with statahead: 1 sec statahead total: 31 statahead wrong: 0 agl total: 29 statx --cached=always -D done