lhsmtool_posix: 1784047424.086511 [113652]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1784047424.113060 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.759690 [113653]: copytool fs=lustre archive#=1 item_count=3 lhsmtool_posix: 1784047435.760049 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.760305 [113653]: copytool fs=lustre archive#=2 item_count=1 lhsmtool_posix: 1784047435.760570 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.760684 [114138]: [0x200000bd3:0x2f:0x0] action RESTORE reclen 72, cookie=0x6a56f9d7 lhsmtool_posix: 1784047435.760940 [114140]: [0x200000bd3:0x34:0x0] action ARCHIVE reclen 72, cookie=0x6a56f9d9 lhsmtool_posix: 1784047435.761358 [114137]: [0x200000bd3:0x2d:0x0] action ARCHIVE reclen 72, cookie=0x6a56f9d6 lhsmtool_posix: 1784047435.763154 [114139]: [0x200000bd3:0x31:0x0] action REMOVE reclen 72, cookie=0x6a56f9d8 lhsmtool_posix: 1784047435.769963 [114138]: processing file 'd250.sanity-hsm/f250.sanity-hsm-to-restore.bis' lhsmtool_posix: 1784047435.770075 [114138]: reading stripe rules from '/tmp/arc1/sanity-hsm.test_251//0bfc/0x200000bd3:0x2f:0x0.lov' for '/tmp/arc1/sanity-hsm.test_251//0bfc/0x200000bd3:0x2f:0x0' lhsmtool_posix: 1784047435.770160 [114138]: cannot open '/tmp/arc1/sanity-hsm.test_251//0bfc/0x200000bd3:0x2f:0x0.lov': No such file or directory (2) lhsmtool_posix: 1784047435.770202 [114138]: cannot get stripe rules for '/tmp/arc1/sanity-hsm.test_251//0bfc/0x200000bd3:0x2f:0x0' (No data available), use default lhsmtool_posix: 1784047435.773762 [114140]: processing file 'd251.sanity-hsm/f251.sanity-hsm' lhsmtool_posix: 1784047435.775193 [114139]: processing file 'd250.sanity-hsm/f250.sanity-hsm-to-remove.bis' lhsmtool_posix: 1784047435.799618 [114139]: removing file '/tmp/arc1/sanity-hsm.test_251//0be2/0x200000bd3:0x31:0x0' lhsmtool_posix: 1784047435.799723 [114139]: cannot unlink '/tmp/arc1/sanity-hsm.test_251//0be2/0x200000bd3:0x31:0x0': No such file or directory (2) lhsmtool_posix: 1784047435.799750 [114139]: Action completed, notifying coordinator cookie=0x6a56f9d8, FID=[0x200000bd3:0x31:0x0], hp_flags=0 err=2 lhsmtool_posix: 1784047435.801415 [114137]: processing file 'd250.sanity-hsm/f250.sanity-hsm-to-archive.bis' exiting: Terminated lhsmtool_posix: 1784047435.828571 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.828608 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.828859 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.828879 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.828946 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.828961 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829027 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829042 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829112 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829126 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829289 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829308 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829377 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829393 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829460 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829477 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829542 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829559 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829632 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829658 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829734 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829748 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829860 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829875 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.829943 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.829957 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.830028 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.830043 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.830112 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.830128 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.831869 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.831915 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.832095 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.832109 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.832168 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.832177 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.832788 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.832810 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.832875 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.832888 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.832951 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.832964 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833024 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833034 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833097 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833110 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833168 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833178 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833344 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833362 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833428 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833442 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833507 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833522 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833589 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833604 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833689 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833707 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833774 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833788 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833857 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833871 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.833937 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.833952 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.834019 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.834035 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.834103 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.834116 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.837495 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.837549 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.837800 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.837850 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.837922 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.837938 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838005 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838019 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838085 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838099 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838167 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838182 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838354 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838372 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838439 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838455 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838519 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838535 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838606 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838622 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838706 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838723 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838792 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838806 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838873 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838884 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.838943 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.838953 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839011 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839022 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839083 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839093 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839152 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839162 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839222 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839233 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839330 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839347 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839413 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839429 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839495 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839509 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.839577 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.839591 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.841457 [114140]: llapi_hsm_action_begin() on '/mnt/lustre2/.lustre/fid/0x200000bd3:0x34:0x0' failed: No such file or directory (2) lhsmtool_posix: 1784047435.841561 [114140]: Action completed, notifying coordinator cookie=0x6a56f9d9, FID=[0x200000bd3:0x34:0x0], hp_flags=0 err=2 lhsmtool_posix: 1784047435.846080 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846142 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846448 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846470 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846574 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846589 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846661 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846675 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846737 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846748 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846809 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846821 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846886 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846901 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.846969 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.846985 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.848461 [114139]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000bd3:0x31:0x0' failed: No such file or directory (2) lhsmtool_posix: 1784047435.850520 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.850574 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.850659 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.850676 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.850740 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.850753 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.850818 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.850833 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.850899 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.850912 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.850980 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.850994 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851057 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851072 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851139 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851153 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851232 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851338 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851415 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851430 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851495 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851509 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851579 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851594 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851670 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851687 [113653]: waiting for message from kernel lhsmtool_posix: 1784047435.851757 [113653]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1784047435.851772 [113653]: waiting for message from kernel