lhsmtool_posix: 1762455558.247265 [10827]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455558.301547 [10828]: waiting for message from kernel
lhsmtool_posix: 1762455558.324892 [10829]: freezing thread IOs
lhsmtool_posix: 1762455561.831518 [10828]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455561.832698 [10933]: [0x200000402:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cefe6
lhsmtool_posix: 1762455561.833603 [10929]: [0x200000402:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cefe2
lhsmtool_posix: 1762455561.845288 [10929]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455561.845288 [10933]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455561.840856 [10934]: [0x200000402:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cefe7
lhsmtool_posix: 1762455561.840798 [10931]: [0x200000402:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cefe4
lhsmtool_posix: 1762455561.840840 [10930]: [0x200000402:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cefe3
lhsmtool_posix: 1762455561.840845 [10932]: [0x200000402:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cefe5
lhsmtool_posix: 1762455561.860253 [10938]: [0x200000402:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cefea
lhsmtool_posix: 1762455561.861102 [10828]: waiting for message from kernel
lhsmtool_posix: 1762455561.861374 [10939]: [0x200000402:0xd:0x0] action ARCHIVE reclen 72, cookie=0x690cefeb
lhsmtool_posix: 1762455561.841240 [10935]: [0x200000402:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cefe8
lhsmtool_posix: 1762455561.872490 [10938]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455561.872578 [10934]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455561.857128 [10937]: [0x200000402:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cefe9
lhsmtool_posix: 1762455561.878513 [10931]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455561.878613 [10935]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455561.878505 [10939]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455561.884702 [10932]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455561.890681 [10937]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455561.891413 [10930]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455561.959755 [10933]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp'
lhsmtool_posix: 1762455561.960042 [10933]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455561.965912 [10929]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp'
lhsmtool_posix: 1762455561.966177 [10929]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455561.972083 [10931]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp'
lhsmtool_posix: 1762455561.972248 [10931]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455561.978842 [10938]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp'
lhsmtool_posix: 1762455561.979016 [10938]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455561.981043 [10939]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp'
lhsmtool_posix: 1762455561.981238 [10939]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp.lov
lhsmtool_posix: 1762455561.985091 [10933]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp'
lhsmtool_posix: 1762455561.987580 [10934]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp'
lhsmtool_posix: 1762455561.987723 [10934]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455562.006289 [10938]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp'
lhsmtool_posix: 1762455562.007081 [10932]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'
lhsmtool_posix: 1762455562.007223 [10932]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455562.008549 [10931]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp'
lhsmtool_posix: 1762455562.013365 [10929]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp'
lhsmtool_posix: 1762455562.019746 [10930]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp'
lhsmtool_posix: 1762455562.019872 [10937]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp'
lhsmtool_posix: 1762455562.019990 [10930]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455562.020015 [10937]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455562.020765 [10939]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp'
lhsmtool_posix: 1762455562.020880 [10935]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp'
lhsmtool_posix: 1762455562.020993 [10935]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455562.021343 [10934]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp'
lhsmtool_posix: 1762455562.024694 [10932]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'
lhsmtool_posix: 1762455562.034236 [10930]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp'
lhsmtool_posix: 1762455562.038333 [10935]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp'
lhsmtool_posix: 1762455562.039945 [10937]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp'
lhsmtool_posix: 1762455571.138511 [10829]: canceling running request matching [0x200000402:0x4:0x0]
lhsmtool_posix: 1762455571.551058 [10929]: copied 1048576 bytes in 9.584658 seconds
lhsmtool_posix: 1762455571.551120 [10929]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455571.551236 [10929]: Action completed, notifying coordinator cookie=0x690cefe2, FID=[0x200000402:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455571.562535 [10929]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455571.869862 [10829]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455572.005746 [10933]: copied 1048576 bytes in 10.045476 seconds
lhsmtool_posix: 1762455572.005814 [10933]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.005907 [10933]: Action completed, notifying coordinator cookie=0x690cefe6, FID=[0x200000402:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.022287 [10938]: copied 1048576 bytes in 10.043124 seconds
lhsmtool_posix: 1762455572.022360 [10938]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.022466 [10938]: Action completed, notifying coordinator cookie=0x690cefea, FID=[0x200000402:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.026320 [10931]: copied 1048576 bytes in 10.053905 seconds
lhsmtool_posix: 1762455572.026407 [10931]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.026522 [10931]: Action completed, notifying coordinator cookie=0x690cefe4, FID=[0x200000402:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.034341 [10939]: copied 1048576 bytes in 10.052815 seconds
lhsmtool_posix: lhsmtool_posix: 1762455572.034443 [10934]: copied 1048576 bytes in 10.046578 seconds
lhsmtool_posix: 1762455572.034499 [10934]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp': Operation canceled (125)
1762455572.034441 [10939]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp': Operation canceled (125)
lhsmtool_posix: lhsmtool_posix: 1762455572.034620 [10934]: Action completed, notifying coordinator cookie=0x690cefe7, FID=[0x200000402:0x9:0x0], hp_flags=0 err=125
1762455572.034629 [10939]: Action completed, notifying coordinator cookie=0x690cefeb, FID=[0x200000402:0xd:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.035293 [10933]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.040508 [10932]: copied 1048576 bytes in 10.033135 seconds
lhsmtool_posix: 1762455572.040591 [10932]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.040715 [10932]: Action completed, notifying coordinator cookie=0x690cefe5, FID=[0x200000402:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.055497 [10930]: copied 1048576 bytes in 10.035329 seconds
lhsmtool_posix: 1762455572.055573 [10930]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.055684 [10930]: Action completed, notifying coordinator cookie=0x690cefe3, FID=[0x200000402:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.062003 [10937]: copied 1048576 bytes in 10.041834 seconds
lhsmtool_posix: 1762455572.062077 [10937]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.062184 [10937]: Action completed, notifying coordinator cookie=0x690cefe9, FID=[0x200000402:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.063669 [10931]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.063669 [10938]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.064125 [10939]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.070483 [10935]: copied 1048576 bytes in 10.048724 seconds
lhsmtool_posix: 1762455572.070555 [10935]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455572.070662 [10935]: Action completed, notifying coordinator cookie=0x690cefe8, FID=[0x200000402:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455572.072166 [10934]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.073597 [10932]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.097015 [10930]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.097506 [10937]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455572.097799 [10935]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.794565 [10829]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455586.255375 [10828]: process finished, errs: 10 major, 0 minor, rc=0 (Success)