00000080:00200080:2.0F:1715208947.775977:0:29316:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=11c40f0 00800000:00000080:2.0:1715208947.776001:0:29316:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800b07b9a20 uarg=0000000000000000 00000002:00000080:2.0:1715208947.776010:0:29316:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800b07b9a20 uarg=0000000000000000 00000100:00100000:2.0:1715208947.776090:0:29316:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:29316:1798523503987072:192.168.202.138@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208947.776170:0:29316:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715208947.778029:0:29316:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:29316:1798523503987072:192.168.202.138@tcp:60:lhsmtool_posix.0 00000080:00200008:2.0:1715208947.778109:0:29316:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715208947.778149:0:29316:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012aaf5500 x1798523503978880/t4294967514(4294967514) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208760 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:2.0:1715208947.778180:0:29316:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715208947.778188:0:29316:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b6324000 x1798523503987200/t0(0) o35->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715208947.778204:0:29316:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:29316:1798523503987200:192.168.202.138@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208947.778255:0:29316:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715208947.780944:0:29316:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324000 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:29316:1798523503987200:192.168.202.138@tcp:35:lhsmtool_posix.0 00000002:00100000:2.0:1715208947.780967:0:29316:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012aaf5500 x1798523503978880/t4294967514(4294967514) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208760 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:2.0:1715208947.781007:0:29316:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200008:2.0:1715208947.784476:0:29316:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00010000:00010000:1.0F:1715208948.060292:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715208948.524310:0:30635:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208948.524319:0:30635:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208948.524322:0:30635:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208948.524325:0:30635:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208948.524356:0:30635:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208948.524359:0:30635:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715208948.524411:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503987328:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0F:1715208948.524412:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503987264:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208948.524502:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503987392:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208948.526205:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503987264:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208948.526229:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503987392:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715208948.526230:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503987328:192.168.202.138@tcp:400:kworker.0 00010000:00010000:0.0F:1715208949.062167:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715208950.064345:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715208951.066328:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715208952.068257:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715208952.744547:0:32010:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 18:55:52 (1715208952) 00000080:00200008:3.0:1715208952.809352:0:32053:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208952.809359:0:32053:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208952.809374:0:32053:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.809386:0:32053:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.809397:0:32053:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208952.809405:0:32053:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208952.809407:0:32053:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:3.0:1715208952.809413:0:32053:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800aa3bbcc8 00010000:00010000:3.0:1715208952.809415:0:32053:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.809420:0:32053:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715208952.809697:0:32053:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208952.809700:0:32053:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715208952.809708:0:32053:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.809743:0:32053:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809765:0:32053:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809771:0:32053:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32053 initiator: MDT0 00000100:00100000:3.0:1715208952.809799:0:32053:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa136600 going to sleep for 0 seconds 00000100:00100000:3.0:1715208952.809807:0:32053:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:32053:1798523503987456:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715208952.809814:0:32053:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809818:0:32053:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809822:0:32053:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809825:0:32053:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809829:0:32053:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809833:0:32053:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae77840 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715208952.809836:0:32053:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809840:0:32053:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809844:0:32053:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809851:0:32053:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208952.809854:0:32053:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32053 initiator: MDT0 00010000:00010000:3.0:1715208952.809858:0:32053:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77840/0xbbeffb005ec3e95e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32053 initiator: MDT0 00000080:00020000:3.0:1715208952.809871:0:32053:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715208952.809882:0:32053:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208952.809884:0:32053:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208952.809889:0:32053:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.809893:0:32053:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.809897:0:32053:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208952.809901:0:32053:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208952.809903:0:32053:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:3.0:1715208952.809905:0:32053:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800aa3bbcc8 00010000:00010000:3.0:1715208952.809907:0:32053:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.809910:0:32053:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208952.809959:0:32053:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208952.809964:0:32053:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.809968:0:32053:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.809975:0:32053:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208952.809980:0:32053:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208952.809982:0:32053:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:3.0:1715208952.809984:0:32053:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800aa3bbb80 00010000:00010000:3.0:1715208952.809986:0:32053:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.809991:0:32053:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208952.809996:0:32053:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715208952.810000:0:32053:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715208952.810451:0:32054:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208952.810461:0:32054:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208952.810467:0:32054:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.810474:0:32054:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208952.810480:0:32054:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208952.810482:0:32054:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:1.0:1715208952.810485:0:32054:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800b5c93b80 00010000:00010000:1.0:1715208952.810487:0:32054:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.810492:0:32054:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208952.810498:0:32054:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715208952.810501:0:32054:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715208952.810516:0:32054:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208952.810519:0:32054:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208952.810522:0:32054:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.810526:0:32054:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208952.810530:0:32054:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208952.810534:0:32054:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:1.0:1715208952.810537:0:32054:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800b5c93bb0 00010000:00010000:1.0:1715208952.810539:0:32054:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.810542:0:32054:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208952.810547:0:32054:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208952.810550:0:32054:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:1.0:1715208952.810553:0:32054:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208952.810558:0:32054:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff8800b6ebbb00, open_flags 8000, mode 0 opened 0 00000080:00200000:1.0:1715208952.810562:0:32054:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:1.0:1715208952.810568:0:32054:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:1.0:1715208952.810590:0:32054:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 32054 initiator: MDT0 00010000:00010000:1.0:1715208952.810594:0:32054:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 32054 initiator: MDT0 00000020:00100000:1.0:1715208952.810600:0:32054:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715208952.810606:0:32054:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a615f80 x1798523503987584/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715208952.810612:0:32054:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 32054 initiator: MDT0 00000100:00100000:1.0:1715208952.810621:0:32054:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a615f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32054:1798523503987584:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1715208952.810715:0:32054:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87f00 going to sleep for 11 seconds 00000100:00100000:2.0:1715208952.812255:0:32054:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967515 gen 1 00000100:00100000:2.0:1715208952.812262:0:32054:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff88012a615f80 x1798523503987584/t4294967516(4294967516) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208968 ref 3 fl Rpc:RPQU/204/0 rc 0/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000100:00100000:2.0:1715208952.812270:0:32054:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615f80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32054:1798523503987584:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208952.812276:0:32054:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812282:0:32054:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812286:0:32054:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812290:0:32054:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812293:0:32054:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812296:0:32054:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136baed00 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715208952.812298:0:32054:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812301:0:32054:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812308:0:32054:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812312:0:32054:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715208952.812314:0:32054:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 32054 initiator: MDT0 00010000:00010000:2.0:1715208952.812317:0:32054:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baed00/0xbbeffb005ec3e965 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 32054 initiator: MDT0 00000002:00100000:2.0:1715208952.812326:0:32054:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a615f80 x1798523503987584/t4294967516(4294967516) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208968 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715208952.812332:0:32054:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a615f80 x1798523503987584/t4294967516(4294967516) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208968 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208952.812347:0:32054:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:2.0:1715208952.812349:0:32054:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:2.0:1715208952.812352:0:32054:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:2.0:1715208952.812360:0:32054:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715208952.812367:0:32054:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a615f80 x1798523503987584/t4294967516(4294967516) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208968 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208952.812397:0:32054:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715208952.812430:0:32054:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=1d5d0f0 00800000:00000080:2.0:1715208952.812435:0:32054:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aaf7e440 uarg=0000000000000000 00000002:00000080:2.0:1715208952.812442:0:32054:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aaf7e440 uarg=0000000000000000 00000100:00100000:2.0:1715208952.812458:0:32054:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326680 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32054:1798523503987648:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208952.812489:0:32054:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715208952.813363:0:32054:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326680 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32054:1798523503987648:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:0.0:1715208952.816199:0:32055:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:0.0:1715208952.816214:0:32055:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715208952.816245:0:32055:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816254:0:32055:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816263:0:32055:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00000100:00100000:0.0:1715208952.816274:0:32055:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeee480 going to sleep for 0 seconds 00000100:00100000:0.0:1715208952.816281:0:32055:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf5c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:32055:1798523503987712:192.168.202.138@tcp:101:lfs.0 00010000:00010000:0.0:1715208952.816291:0:32055:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816297:0:32055:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816303:0:32055:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816309:0:32055:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816315:0:32055:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816321:0:32055:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2bd680 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:0.0:1715208952.816324:0:32055:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816330:0:32055:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816342:0:32055:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816348:0:32055:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715208952.816352:0:32055:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816357:0:32055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd680/0xbbeffb005ec3e96c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32055 initiator: MDT0 00000080:00020000:0.0:1715208952.816374:0:32055:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715208952.816399:0:32055:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:0.0:1715208952.816407:0:32055:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715208952.816426:0:32055:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816432:0:32055:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816439:0:32055:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00000100:00100000:0.0:1715208952.816448:0:32055:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeee480 going to sleep for 0 seconds 00000100:00100000:0.0:1715208952.816454:0:32055:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf5c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:32055:1798523503987776:192.168.202.138@tcp:101:lfs.0 00010000:00010000:0.0:1715208952.816461:0:32055:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816467:0:32055:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816472:0:32055:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816484:0:32055:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816489:0:32055:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816495:0:32055:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2bd440 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:0.0:1715208952.816498:0:32055:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816503:0:32055:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816508:0:32055:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816514:0:32055:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715208952.816517:0:32055:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816522:0:32055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bd440/0xbbeffb005ec3e973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32055 initiator: MDT0 00000080:00020000:0.0:1715208952.816536:0:32055:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715208952.816553:0:32055:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715208952.816557:0:32055:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:0.0:1715208952.816563:0:32055:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715208952.816579:0:32055:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816586:0:32055:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816603:0:32055:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00000100:00100000:0.0:1715208952.816611:0:32055:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeee480 going to sleep for 0 seconds 00000100:00100000:0.0:1715208952.816617:0:32055:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf5c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:32055:1798523503987840:192.168.202.138@tcp:101:lfs.0 00010000:00010000:0.0:1715208952.816623:0:32055:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816628:0:32055:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816634:0:32055:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816639:0:32055:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816645:0:32055:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816650:0:32055:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2bcfc0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:0.0:1715208952.816653:0:32055:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816658:0:32055:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816663:0:32055:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816668:0:32055:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715208952.816671:0:32055:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32055 initiator: MDT0 00010000:00010000:0.0:1715208952.816681:0:32055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bcfc0/0xbbeffb005ec3e97a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32055 initiator: MDT0 00000080:00020000:0.0:1715208952.816696:0:32055:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208952.818899:0:32056:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715208952.818909:0:32056:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208952.818926:0:32056:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818932:0:32056:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818936:0:32056:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32056 initiator: MDT0 00000100:00100000:1.0:1715208952.818943:0:32056:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87540 going to sleep for 0 seconds 00000100:00100000:1.0:1715208952.818947:0:32056:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job bash:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:32056:1798523503987904:192.168.202.138@tcp:101:bash.0 00010000:00010000:1.0:1715208952.818952:0:32056:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818955:0:32056:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818958:0:32056:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818961:0:32056:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818965:0:32056:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818968:0:32056:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136baf600 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208952.818969:0:32056:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818972:0:32056:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818981:0:32056:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818985:0:32056:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208952.818987:0:32056:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32056 initiator: MDT0 00010000:00010000:1.0:1715208952.818990:0:32056:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baf600/0xbbeffb005ec3e981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 32056 initiator: MDT0 00000080:00020000:1.0:1715208952.819001:0:32056:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208952.821533:0:32057:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208952.821546:0:32057:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208952.821556:0:32057:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.821567:0:32057:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208952.821577:0:32057:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208952.821580:0:32057:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:1.0:1715208952.821585:0:32057:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800aa347af8 00010000:00010000:1.0:1715208952.821588:0:32057:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.821597:0:32057:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208952.821607:0:32057:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208952.821614:0:32057:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d26c.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff880136f588c8), flags=16 00000080:00200000:1.0:1715208952.821623:0:32057:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d26c.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff880136f588c8), intent=0 00000002:00010000:1.0:1715208952.821631:0:32057:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d26c.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1715208952.821655:0:32057:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.821661:0:32057:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.821668:0:32057:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 32057 initiator: MDT0 00000100:00100000:1.0:1715208952.821683:0:32057:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job rm:cbae74da-7571-45ad-b971-0e0378bbd4e4:32057:1798523503987968:192.168.202.138@tcp:101:rm.0 00000100:00100000:1.0:1715208952.821735:0:32057:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87540 going to sleep for 11 seconds 00000100:00100000:1.0:1715208952.823822:0:32057:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job rm:cbae74da-7571-45ad-b971-0e0378bbd4e4:32057:1798523503987968:192.168.202.138@tcp:101:rm.0 00010000:00010000:1.0:1715208952.823838:0:32057:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823849:0:32057:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823855:0:32057:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823862:0:32057:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823868:0:32057:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823873:0:32057:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bafcc0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208952.823877:0:32057:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823896:0:32057:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823902:0:32057:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823908:0:32057:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208952.823912:0:32057:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 32057 initiator: MDT0 00010000:00010000:1.0:1715208952.823918:0:32057:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 32057 initiator: MDT0 00000002:00100000:1.0:1715208952.823932:0:32057:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=7, status=0 req@ffff88012a617800 x1798523503987968/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 584/584 e 0 to 0 dl 1715208968 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:1.0:1715208952.823955:0:32057:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.823966:0:32057:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208952.823973:0:32057:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800aa347930 00010000:00010000:1.0:1715208952.823976:0:32057:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.823983:0:32057:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208952.824089:0:32057:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208952.824100:0:32057:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208952.824108:0:32057:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.824124:0:32057:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208952.824133:0:32057:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208952.824136:0:32057:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:1.0:1715208952.824141:0:32057:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800aa347b90 00010000:00010000:1.0:1715208952.824144:0:32057:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208952.824151:0:32057:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208952.824160:0:32057:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208952.824166:0:32057:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26c.sanity-hsm, flags=16 00000080:00200000:3.0:1715208952.828346:0:32058:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208952.828361:0:32058:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.828373:0:32058:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.828386:0:32058:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208952.828396:0:32058:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208952.828399:0:32058:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:3.0:1715208952.828404:0:32058:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800a94e7af8 00010000:00010000:3.0:1715208952.828408:0:32058:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.828428:0:32058:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208952.828439:0:32058:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208952.828444:0:32058:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26c.sanity-hsm, flags=17 00000080:00200000:3.0:1715208952.828471:0:32058:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208952.828478:0:32058:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.828484:0:32058:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.828492:0:32058:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208952.828499:0:32058:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208952.828502:0:32058:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:3.0:1715208952.828505:0:32058:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800a94e7af8 00010000:00010000:3.0:1715208952.828508:0:32058:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.828515:0:32058:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208952.828522:0:32058:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208952.828525:0:32058:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26c.sanity-hsm, flags=17 00000080:00200000:3.0:1715208952.828554:0:32058:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208952.828559:0:32058:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208952.828565:0:32058:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.828583:0:32058:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208952.828591:0:32058:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208952.828593:0:32058:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e8c4 00000080:00010000:3.0:1715208952.828597:0:32058:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e8c4 from it ffff8800a94e7bb0 00010000:00010000:3.0:1715208952.828599:0:32058:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208952.828606:0:32058:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa30ba80/0xbbeffb005ec3e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f670bc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208952.828614:0:32058:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208952.828618:0:32058:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d26c.sanity-hsm, flags=17 00010000:00010000:0.0:1715208953.070211:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208953.303123:0:32190:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_26c: @@@@@@ FAIL: cannot create /mnt/lustre2/d26c.sanity-hsm/f26c.sanity-hsm with cp, status=1 00000100:00080000:2.0:1715208953.532155:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208953.532163:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208953.532166:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208953.532169:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208953.532185:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208953.532188:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715208953.532203:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503988032:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715208953.532217:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503988096:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208953.532289:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503988160:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208953.534075:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503988032:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208953.534094:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503988160:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715208953.534101:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503988096:192.168.202.138@tcp:400:kworker.0 Debug log: 324 lines, 324 kept, 0 dropped, 0 bad.