lhsmtool_posix: 1762455737.164836 [10838]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455737.211419 [10839]: waiting for message from kernel
lhsmtool_posix: 1762455737.241048 [10840]: freezing thread IOs
lhsmtool_posix: 1762455739.733623 [10839]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455739.734700 [10839]: waiting for message from kernel
lhsmtool_posix: 1762455739.735006 [10947]: [0x200000402:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cf0a0
lhsmtool_posix: 1762455739.735428 [10946]: [0x200000402:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cf09f
lhsmtool_posix: 1762455739.735631 [10942]: [0x200000402:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cf09b
lhsmtool_posix: 1762455739.735985 [10948]: [0x200000402:0xd:0x0] action ARCHIVE reclen 72, cookie=0x690cf0a1
lhsmtool_posix: 1762455739.736248 [10945]: [0x200000402:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cf09e
lhsmtool_posix: 1762455739.736428 [10939]: [0x200000402:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cf098
lhsmtool_posix: 1762455739.736619 [10941]: [0x200000402:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cf09a
lhsmtool_posix: 1762455739.736818 [10940]: [0x200000402:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cf099
lhsmtool_posix: 1762455739.737035 [10943]: [0x200000402:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cf09c
lhsmtool_posix: 1762455739.738201 [10944]: [0x200000402:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cf09d
lhsmtool_posix: 1762455739.744086 [10947]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455739.745511 [10942]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455739.750790 [10939]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455739.751366 [10941]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455739.751489 [10946]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455739.752055 [10945]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455739.752505 [10940]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455739.758984 [10948]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455739.760928 [10943]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455739.770127 [10944]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455739.824104 [10939]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp'
lhsmtool_posix: 1762455739.824361 [10939]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455739.829630 [10941]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp'
lhsmtool_posix: 1762455739.829788 [10941]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455739.830637 [10945]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp'
lhsmtool_posix: 1762455739.830736 [10945]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455739.840372 [10940]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp'
lhsmtool_posix: 1762455739.840530 [10940]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455739.841199 [10944]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp'
lhsmtool_posix: 1762455739.841277 [10944]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455739.845787 [10947]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp'
lhsmtool_posix: 1762455739.845969 [10947]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455739.847754 [10946]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp'
lhsmtool_posix: 1762455739.847884 [10946]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455739.852761 [10943]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp'
lhsmtool_posix: 1762455739.852922 [10943]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455739.853372 [10948]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp'
lhsmtool_posix: 1762455739.853455 [10948]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp.lov
lhsmtool_posix: 1762455739.855839 [10939]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp'
lhsmtool_posix: 1762455739.858917 [10941]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp'
lhsmtool_posix: 1762455739.859944 [10944]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp'
lhsmtool_posix: 1762455739.860956 [10942]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'
lhsmtool_posix: 1762455739.861104 [10942]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455739.864043 [10940]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp'
lhsmtool_posix: 1762455739.867182 [10945]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp'
lhsmtool_posix: 1762455739.867562 [10947]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp'
lhsmtool_posix: 1762455739.868719 [10946]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp'
lhsmtool_posix: lhsmtool_posix: 1762455739.898521 [10948]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp'
1762455739.898469 [10942]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'
lhsmtool_posix: 1762455739.898631 [10943]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp'
lhsmtool_posix: 1762455748.854785 [10840]: canceling running request matching [0x200000402:0x4:0x0]
lhsmtool_posix: 1762455748.879705 [10939]: copied 1048576 bytes in 9.054713 seconds
lhsmtool_posix: 1762455748.880612 [10939]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455748.881361 [10939]: Action completed, notifying coordinator cookie=0x690cf098, FID=[0x200000402:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455748.891065 [10939]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.756345 [10840]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455749.887448 [10941]: copied 1048576 bytes in 10.057522 seconds
lhsmtool_posix: 1762455749.887518 [10941]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455749.887604 [10940]: copied 1048576 bytes in 10.046928 secondslhsmtool_posix: 1762455749.887627 [10941]: Action completed, notifying coordinator cookie=0x690cf09a, FID=[0x200000402:0x6:0x0], hp_flags=0 err=125

lhsmtool_posix: 1762455749.887935 [10940]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455749.887996 [10940]: Action completed, notifying coordinator cookie=0x690cf099, FID=[0x200000402:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455749.894390 [10944]: copied 1048576 bytes in 10.052992 seconds
lhsmtool_posix: 1762455749.894460 [10944]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455749.894580 [10944]: Action completed, notifying coordinator cookie=0x690cf09d, FID=[0x200000402:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455749.906664 [10940]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.910307 [10941]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.911046 [10944]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.927247 [10948]: copied 1048576 bytes in 10.071929 seconds
lhsmtool_posix: 1762455749.927311 [10948]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455749.927409 [10948]: Action completed, notifying coordinator cookie=0x690cf0a1, FID=[0x200000402:0xd:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455749.928785 [10947]: copied 1048576 bytes in 10.082667 seconds
lhsmtool_posix: 1762455749.928826 [10947]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455749.928911 [10947]: Action completed, notifying coordinator cookie=0x690cf0a0, FID=[0x200000402:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: lhsmtool_posix: 1762455749.933411 [10942]: copied 1048576 bytes in 10.072131 seconds
1762455749.933347 [10945]: copied 1048576 bytes in 10.102521 seconds
lhsmtool_posix: lhsmtool_posix: 1762455749.933459 [10942]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'1762455749.933482 [10945]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp': Operation canceled (125)
: Operation canceled (125)
lhsmtool_posix: lhsmtool_posix: 1762455749.933645 [10942]: Action completed, notifying coordinator cookie=0x690cf09b, FID=[0x200000402:0x7:0x0], hp_flags=0 err=125
1762455749.933635 [10945]: Action completed, notifying coordinator cookie=0x690cf09e, FID=[0x200000402:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455749.948110 [10948]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.950482 [10947]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.952527 [10945]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455749.952893 [10942]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455750.009876 [10946]: copied 1048576 bytes in 10.161844 seconds
lhsmtool_posix: 1762455750.009935 [10946]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455750.012240 [10946]: Action completed, notifying coordinator cookie=0x690cf09f, FID=[0x200000402:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455750.015778 [10943]: copied 1048576 bytes in 10.159298 seconds
lhsmtool_posix: 1762455750.015857 [10943]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455750.015957 [10943]: Action completed, notifying coordinator cookie=0x690cf09c, FID=[0x200000402:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455750.034559 [10946]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455750.036956 [10943]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455757.600117 [10840]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455762.663375 [10839]: process finished, errs: 10 major, 0 minor, rc=0 (Success)