lhsmtool_posix: 1762455565.498610 [11797]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455565.541909 [11798]: waiting for message from kernel
lhsmtool_posix: 1762455565.626985 [11799]: freezing thread IOs
lhsmtool_posix: 1762455568.912893 [11798]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455568.913274 [11898]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cefe8
lhsmtool_posix: 1762455568.916167 [11798]: waiting for message from kernel
lhsmtool_posix: 1762455568.916554 [11906]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690ceff0
lhsmtool_posix: 1762455568.916911 [11903]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cefed
lhsmtool_posix: 1762455568.917114 [11901]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cefeb
lhsmtool_posix: 1762455568.917333 [11899]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cefe9
lhsmtool_posix: 1762455568.917831 [11907]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690ceff1
lhsmtool_posix: 1762455568.918046 [11905]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cefef
lhsmtool_posix: 1762455568.918279 [11900]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cefea
lhsmtool_posix: 1762455568.918470 [11902]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cefec
lhsmtool_posix: 1762455568.919365 [11904]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cefee
lhsmtool_posix: 1762455568.924583 [11907]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455568.925216 [11905]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455568.925641 [11900]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455568.929668 [11906]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455568.930367 [11901]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455568.931389 [11898]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455568.931642 [11902]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: lhsmtool_posix: 1762455568.932088 [11899]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
1762455568.932076 [11903]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455568.932513 [11904]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455569.005499 [11907]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455569.005643 [11907]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455569.006069 [11898]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455569.006129 [11898]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov
lhsmtool_posix: 1762455569.013607 [11905]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455569.013773 [11905]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455569.020640 [11899]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455569.020814 [11899]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455569.021222 [11902]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455569.021278 [11902]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455569.020646 [11900]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455569.023382 [11900]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455569.031301 [11903]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455569.031484 [11903]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455569.031535 [11898]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455569.046419 [11899]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: lhsmtool_posix: 1762455569.046560 [11902]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
1762455569.046544 [11900]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455569.046879 [11905]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455569.047195 [11907]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455569.047326 [11904]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455569.047434 [11904]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455569.053033 [11901]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455569.053914 [11901]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455569.055532 [11903]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455569.056454 [11906]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455569.056582 [11906]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455569.059897 [11904]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455569.064552 [11901]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455569.072754 [11906]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455578.275024 [11799]: canceling running request matching [0x200000403:0x3:0x0]
lhsmtool_posix: 1762455578.608438 [11898]: copied 1048576 bytes in 9.602205 seconds
lhsmtool_posix: 1762455578.608531 [11898]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455578.608695 [11898]: Action completed, notifying coordinator cookie=0x690cefe8, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455578.640687 [11898]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.423175 [11799]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455579.573542 [11899]: copied 1048576 bytes in 10.552594 seconds
lhsmtool_posix: 1762455579.573611 [11899]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.573712 [11899]: Action completed, notifying coordinator cookie=0x690cefe9, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.574808 [11907]: copied 1048576 bytes in 10.569011 seconds
lhsmtool_posix: 1762455579.574844 [11907]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.574935 [11907]: Action completed, notifying coordinator cookie=0x690ceff1, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.578433 [11902]: copied 1048576 bytes in 10.557023 seconds
lhsmtool_posix: 1762455579.578518 [11902]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.578681 [11902]: Action completed, notifying coordinator cookie=0x690cefec, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.580080 [11905]: copied 1048576 bytes in 10.566158 seconds
lhsmtool_posix: 1762455579.580165 [11905]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.580246 [11905]: Action completed, notifying coordinator cookie=0x690cefef, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.580510 [11903]: copied 1048576 bytes in 10.548869 seconds
lhsmtool_posix: 1762455579.580556 [11903]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.580639 [11903]: Action completed, notifying coordinator cookie=0x690cefed, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.586595 [11904]: copied 1048576 bytes in 10.538925 seconds
lhsmtool_posix: 1762455579.586668 [11904]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.586768 [11904]: Action completed, notifying coordinator cookie=0x690cefee, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.596249 [11907]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.596752 [11899]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.601801 [11902]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.603010 [11904]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.603384 [11905]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.603976 [11903]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.605278 [11900]: copied 1048576 bytes in 10.581753 seconds
lhsmtool_posix: 1762455579.605320 [11900]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.605403 [11900]: Action completed, notifying coordinator cookie=0x690cefea, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.612242 [11906]: copied 1048576 bytes in 10.555516 seconds
lhsmtool_posix: 1762455579.612307 [11906]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.612380 [11906]: Action completed, notifying coordinator cookie=0x690ceff0, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.616705 [11900]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.625498 [11906]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455579.627672 [11901]: copied 1048576 bytes in 10.573593 seconds
lhsmtool_posix: 1762455579.627721 [11901]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455579.627789 [11901]: Action completed, notifying coordinator cookie=0x690cefeb, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455579.639302 [11901]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455589.563467 [11799]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455596.411384 [11798]: process finished, errs: 10 major, 0 minor, rc=0 (Success)