== sanity-pfl test 22c: Test repeat with out of space on > 1 OST ========================================================== 17:38:48 (1717018728)
striped dir -i0 -c2 -H crush /mnt/lustre/d22c.sanity-pfl
Creating new pool
oleg330-server: Pool lustre.test_22c created
Adding targets to pool
oleg330-server: OST lustre-OST0000_UUID added to pool lustre.test_22c
oleg330-server: OST lustre-OST0001_UUID added to pool lustre.test_22c
Waiting for MDT destroys to complete
Waiting for orphan cleanup...
osp.lustre-OST0000-osc-MDT0000.old_sync_processed
osp.lustre-OST0000-osc-MDT0001.old_sync_processed
osp.lustre-OST0001-osc-MDT0000.old_sync_processed
osp.lustre-OST0001-osc-MDT0001.old_sync_processed
wait 40 secs maximumly for oleg330-server mds-ost sync done.
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0244878 s, 42.8 MB/s
/mnt/lustre/d22c.sanity-pfl/f22c.sanity-pfl
  lcm_layout_gen:    3
  lcm_mirror_count:  1
  lcm_entry_count:   2
    lcme_id:             1
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   134217728
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 1, l_fid: [0x2c0000400:0x214:0x0] }

    lcme_id:             2
    lcme_mirror_id:      0
    lcme_flags:          extension
    lcme_extent.e_start: 134217728
    lcme_extent.e_end:   EOF
      lmm_stripe_count:  0
      lmm_extension_size: 67108864
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: -1
      lmm_pool:          test_22c

347+0 records in
347+0 records out
363855872 bytes (364 MB) copied, 3.06271 s, 119 MB/s
lfs setstripe: setstripe error for '/mnt/lustre/f22c.sanity-pfl.fill_ost1': stripe already set
348+0 records in
348+0 records out
364904448 bytes (365 MB) copied, 3.32758 s, 110 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0185291 s, 56.6 MB/s
/mnt/lustre/d22c.sanity-pfl/f22c.sanity-pfl
  lcm_layout_gen:    5
  lcm_mirror_count:  1
  lcm_entry_count:   3
    lcme_id:             1
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   134217728
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 1, l_fid: [0x2c0000400:0x214:0x0] }

    lcme_id:             4
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 134217728
    lcme_extent.e_end:   201326592
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    65535
      lmm_stripe_offset: 0
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 0, l_fid: [0x280000400:0x211:0x0] }

    lcme_id:             2
    lcme_mirror_id:      0
    lcme_flags:          extension
    lcme_extent.e_start: 201326592
    lcme_extent.e_end:   EOF
      lmm_stripe_count:  0
      lmm_extension_size: 67108864
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: -1
      lmm_pool:          test_22c

280+0 records in
280+0 records out
293601280 bytes (294 MB) copied, 3.04194 s, 96.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0199351 s, 52.6 MB/s
/mnt/lustre/d22c.sanity-pfl/f22c.sanity-pfl
  lcm_layout_gen:    7
  lcm_mirror_count:  1
  lcm_entry_count:   3
    lcme_id:             1
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   134217728
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 1, l_fid: [0x2c0000400:0x214:0x0] }

    lcme_id:             4
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 134217728
    lcme_extent.e_end:   268435456
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    65535
      lmm_stripe_offset: 0
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 0, l_fid: [0x280000400:0x211:0x0] }

    lcme_id:             2
    lcme_mirror_id:      0
    lcme_flags:          extension
    lcme_extent.e_start: 268435456
    lcme_extent.e_end:   EOF
      lmm_stripe_count:  0
      lmm_extension_size: 67108864
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: -1
      lmm_pool:          test_22c

Waiting for MDT destroys to complete
Waiting for orphan cleanup...
osp.lustre-OST0000-osc-MDT0000.old_sync_processed
osp.lustre-OST0000-osc-MDT0001.old_sync_processed
osp.lustre-OST0001-osc-MDT0000.old_sync_processed
osp.lustre-OST0001-osc-MDT0001.old_sync_processed
wait 40 secs maximumly for oleg330-server mds-ost sync done.
oleg330-server: error: set_param: setting /sys/kernel/debug/lustre/osp/lustre-OST0001-osc-MDT0000/reserved_mb_high=0: Numerical result out of range
oleg330-server: error: set_param: setting /sys/kernel/debug/lustre/osp/lustre-OST0001-osc-MDT0001/reserved_mb_high=0: Numerical result out of range
pdsh@oleg330-client: oleg330-server: ssh exited with exit code 34
set OST1 lwm back to 0, hwm back to 0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0340004 s, 30.8 MB/s
/mnt/lustre/d22c.sanity-pfl/f22c.sanity-pfl
  lcm_layout_gen:    8
  lcm_mirror_count:  1
  lcm_entry_count:   3
    lcme_id:             1
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   134217728
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 1, l_fid: [0x2c0000400:0x214:0x0] }

    lcme_id:             4
    lcme_mirror_id:      0
    lcme_flags:          init
    lcme_extent.e_start: 134217728
    lcme_extent.e_end:   335544320
      lmm_stripe_count:  1
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    65535
      lmm_stripe_offset: 0
      lmm_pool:          test_22c
      lmm_objects:
      - 0: { l_ost_idx: 0, l_fid: [0x280000400:0x211:0x0] }

    lcme_id:             2
    lcme_mirror_id:      0
    lcme_flags:          extension
    lcme_extent.e_start: 335544320
    lcme_extent.e_end:   EOF
      lmm_stripe_count:  0
      lmm_extension_size: 67108864
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: -1
      lmm_pool:          test_22c

 sanity-pfl test_22c: @@@@@@ FAIL: Write: third component not found 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6427:error()
  = /home/green/git/lustre-release/lustre/tests/sanity-pfl.sh:2168:test_22c()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6744:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6791:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6632:run_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pfl.sh:2176:main()
Dumping lctl log to /tmp/testlogs//sanity-pfl.test_22c.*.1717018855.log
rsync: chown "/tmp/testlogs/.sanity-pfl.test_22c.debug_log.oleg330-server.1717018855.log.Lc02Kh" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.sanity-pfl.test_22c.dmesg.oleg330-server.1717018855.log.AG5JoF" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2]
Waiting for MDT destroys to complete
Waiting for orphan cleanup...
osp.lustre-OST0000-osc-MDT0000.old_sync_processed
osp.lustre-OST0000-osc-MDT0001.old_sync_processed
osp.lustre-OST0001-osc-MDT0000.old_sync_processed
osp.lustre-OST0001-osc-MDT0001.old_sync_processed
wait 40 secs maximumly for oleg330-server mds-ost sync done.
set OST0 lwm back to 3, hwm back to 7
Waiting for MDT destroys to complete
Waiting for orphan cleanup...
osp.lustre-OST0000-osc-MDT0000.old_sync_processed
osp.lustre-OST0000-osc-MDT0001.old_sync_processed
osp.lustre-OST0001-osc-MDT0000.old_sync_processed
osp.lustre-OST0001-osc-MDT0001.old_sync_processed
wait 40 secs maximumly for oleg330-server mds-ost sync done.
oleg330-server: error: set_param: setting /sys/kernel/debug/lustre/osp/lustre-OST0001-osc-MDT0000/reserved_mb_high=0: Numerical result out of range
oleg330-server: error: set_param: setting /sys/kernel/debug/lustre/osp/lustre-OST0001-osc-MDT0001/reserved_mb_high=0: Numerical result out of range
pdsh@oleg330-client: oleg330-server: ssh exited with exit code 34