00010000:00010000:3.0F:1781283542.786675:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1781283543.810650:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1781283544.831576:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283545.857362:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781283546.239628:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000902e868a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2272:1867807973741120:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0F:1781283546.242344:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002bac33b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973741184:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283546.250850:0:2269:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781283546.250882:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bef97e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973741248:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283546.254892:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000902e868a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2272:1867807973741120:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283546.257976:0:2270:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1781283546.258007:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d972f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973741312:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283546.258325:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e8540b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973741376:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283546.259012:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bef97e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973741248:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283546.259029:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002bac33b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973741184:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283546.267509:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d972f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973741312:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283546.271967:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e8540b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973741376:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1781283546.880746:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283547.903684:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283548.927999:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283549.951750:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283550.976515:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781283551.364549:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bd3b010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973741440:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.364680:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014b3ab0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741568:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.364706:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e430fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741696:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.364733:0:2271:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1781283551.364738:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045a89fd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741504:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.364756:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002fdd0334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741632:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.390598:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045a89fd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741504:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.390628:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002fdd0334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741632:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.390645:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bd3b010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973741440:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.390659:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014b3ab0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741568:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1781283551.390671:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e430fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973741696:192.168.201.129@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1781283552.003160:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283553.025331:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283554.047991:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1781283554.190516:0:72291:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1781283554.190526:0:72291:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 31: open(O_CREAT) two, unlink one, |X| unlink one, close two (test mds_cleanup_orphans) ========================================================== 12:59:12 (1781283552) 00000080:00200000:3.0:1781283554.293073:0:72295:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000035a7fd6e),name=/ 00000002:00010000:3.0:1781283554.293116:0:72295:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1781283554.293267:0:72295:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.293281:0:72295:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.293292:0:72295:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781283554.293325:0:72295:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068a6b57e pname:cluuid:pid:xid:nid:opc:job multiop:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:72295:1867807973741760:192.168.201.129@tcp:101:multiop.0 00000100:00100000:3.0:1781283554.293428:0:72295:0:(client.c:2500:ptlrpc_set_wait()) set 000000006a14ea6c going to sleep for 87 seconds 00000100:00100000:3.0:1781283554.313920:0:72295:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068a6b57e pname:cluuid:pid:xid:nid:opc:job multiop:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:72295:1867807973741760:192.168.201.129@tcp:101:multiop.0 00010000:00010000:3.0:1781283554.313955:0:72295:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.313972:0:72295:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.313984:0:72295:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.313995:0:72295:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314008:0:72295:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314026:0:72295:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314033:0:72295:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1781283554.314044:0:72295:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@0000000068a6b57e x1867807973741760/t0(0) o101->lustre-MDT0000-mdc-ffff89c1066d9800@192.168.201.129@tcp:12/10 lens 576/688 e 0 to 0 dl 1781283642 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'multiop.0' 00000002:00010000:3.0:1781283554.314059:0:72295:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314072:0:72295:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000006ad220d9 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1781283554.314124:0:72295:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 19968 00000080:00010000:3.0:1781283554.314133:0:72295:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000035a7fd6e) for lock 0xab889bdcd86cc0e2 00000080:00010000:3.0:1781283554.314141:0:72295:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000035a7fd6e) 00000080:00010000:3.0:1781283554.314143:0:72295:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xab889bdcd86cc0e2 from it 000000007cb0faca 00010000:00010000:3.0:1781283554.314145:0:72295:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314154:0:72295:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1781283554.314225:0:72295:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000035a7fd6e), inode mode 41ed mask 1 00000080:00200000:3.0:1781283554.314253:0:72295:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000035a7fd6e),name=/ 00000002:00010000:3.0:1781283554.314268:0:72295:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1781283554.314277:0:72295:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314302:0:72295:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1781283554.314310:0:72295:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000035a7fd6e) 00000080:00010000:3.0:1781283554.314313:0:72295:0:(llite_internal.h:1711:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000035a7fd6e) for lock 0xab889bdcd86cc0e2 00000080:00010000:3.0:1781283554.314316:0:72295:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0xab889bdcd86cc0e2 from it 00000000438d45b6 00010000:00010000:3.0:1781283554.314319:0:72295:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314325:0:72295:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1781283554.314334:0:72295:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000035a7fd6e), inode mode 41ed mask 3 00000080:00200000:3.0:1781283554.314339:0:72295:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=f31.replay-single-1, dir=[0x200000007:0x1:0x0](0000000035a7fd6e), file 00000000cd82641e, open_flags 8042, mode 81a4 opened 0 00000080:00200000:3.0:1781283554.314351:0:72295:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f31.replay-single-1, dir=[0x200000007:0x1:0x0](0000000035a7fd6e), intent=open|creat 00000002:00010000:3.0:1781283554.314372:0:72295:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f31.replay-single-1,[0x20000fe02:0x1a:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0100103 00010000:00010000:3.0:1781283554.314385:0:72295:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314444:0:72295:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314452:0:72295:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1781283554.314454:0:72295:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 00000000501c9e35/0xab889bdcd86cc0e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x1a148972d1ee34d1 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314494:0:72295:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283554.314507:0:72295:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1781283554.314520:0:72295:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff89c1066d9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1781283554.314527:0:72295:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000068a6b57e x1867807973741888/t0(0) o101->lustre-MDT0000-mdc-ffff89c1066d9800@192.168.201.129@tcp:12/10 lens 664/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1781283554.314535:0:72295:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781283554.314557:0:72295:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068a6b57e pname:cluuid:pid:xid:nid:opc:job multiop:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:72295:1867807973741888:192.168.201.129@tcp:101:multiop.0 00000100:00100000:3.0:1781283554.314720:0:72295:0:(client.c:2500:ptlrpc_set_wait()) set 000000006a14ea6c going to sleep for 87 seconds 00010000:00010000:3.0:1781283555.071537:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283556.105441:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781283556.480342:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014b3ab0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973742016:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283556.480491:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002fdd0334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973742144:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283556.481228:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e430fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2272:1867807973741952:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283556.481370:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bd3b010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742080:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283556.481402:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045a89fd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742208:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283556.494488:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e430fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2272:1867807973741952:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283556.494520:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bd3b010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742080:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283556.494534:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045a89fd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742208:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283556.494649:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014b3ab0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973742016:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283556.494663:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002fdd0334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973742144:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:0.0:1781283557.119434:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283558.143489:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283559.167910:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283560.193533:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283561.215481:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781283561.610597:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d57185ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2269:1867807973742272:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1781283561.610718:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014eac22a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973742400:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1781283561.610748:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028aa4434 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973742528:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1781283561.611119:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ce70224 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973742336:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1781283561.611170:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182490de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973742464:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1781283561.624095:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ce70224 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973742336:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1781283561.624132:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182490de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973742464:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1781283561.628882:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014eac22a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973742400:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1781283561.628914:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028aa4434 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973742528:192.168.201.129@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1781283561.628976:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d57185ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2269:1867807973742272:192.168.201.129@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1781283562.240571:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283563.264263:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283564.289765:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283565.318451:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283566.335622:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781283566.719560:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002fdd0334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973742592:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283566.729455:0:2271:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1781283566.729507:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014b3ab0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973742656:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283566.732117:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9b2e3bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742784:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283566.732255:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1781283566.732263:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742720:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283566.732291:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742848:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283566.734385:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002fdd0334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973742592:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283566.736949:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014b3ab0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973742656:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283566.740101:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742720:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283566.740124:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742848:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283566.740137:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9b2e3bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742784:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1781283567.364565:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283568.386045:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283569.407657:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283570.431445:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283571.455596:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781283571.841691:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9b2e3bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2272:1867807973742912:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283571.841836:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743040:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283571.841868:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccb719e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743168:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283571.841903:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1781283571.841910:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742976:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283571.841935:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b0ffd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743104:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283571.847234:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9b2e3bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2272:1867807973742912:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283571.855870:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b0ffd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743104:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283571.855897:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743040:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283571.855910:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccb719e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743168:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283571.858171:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973742976:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1781283572.479440:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283573.504976:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283574.529640:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283575.551932:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283576.575491:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781283576.960660:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d972f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2270:1867807973743232:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283576.960821:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001997a614 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743360:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283576.960850:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7380776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743488:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283576.960882:0:2270:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1781283576.960889:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001749d6e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743296:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283576.960909:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7e1f56c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743424:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283576.970205:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7380776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743488:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283576.970243:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001749d6e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743296:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283576.970279:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7e1f56c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743424:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283576.970289:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d972f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2270:1867807973743232:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283576.970299:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001997a614 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973743360:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:0.0:1781283577.599647:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283578.628381:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283579.647518:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283580.671570:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283581.695868:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781283582.080819:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973743552:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283582.080890:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccb719e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743616:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283582.080925:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973743680:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283582.080937:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b0ffd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743744:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283582.080959:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f0c67b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973743808:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283582.090086:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b0ffd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743744:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781283582.090925:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccb719e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2272:1867807973743616:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283582.091690:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973743552:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283582.091707:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973743680:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283582.091719:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f0c67b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973743808:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1781283582.719663:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283583.743413:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283584.767529:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283585.791510:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283586.815654:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781283587.199407:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973743936:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.199502:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ccb719e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973744064:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.199555:0:2271:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1781283587.199561:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f0c67b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973743872:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.199582:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973744000:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.199627:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b0ffd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973744128:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.212323:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f0c67b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2271:1867807973743872:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.212352:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee5b593f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973744000:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.212364:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b0ffd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973744128:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.212375:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db9cbdce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973743936:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781283587.212387:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ccb719e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2271:1867807973744064:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1781283587.839478:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283588.863594:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283589.887858:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781283590.911430:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283591.935475:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781283592.319630:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d972f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744256:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283592.319742:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001749d6e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744384:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283592.319788:0:2270:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1781283592.319793:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001997a614 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2270:1867807973744192:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283592.319814:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7e1f56c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744320:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283592.319837:0:2270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7380776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744448:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283592.323480:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001997a614 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43154bd6-4937-440b-b23f-f37e9a2f1452:2270:1867807973744192:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283592.323519:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7e1f56c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744320:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283592.323529:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d972f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744256:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283592.324073:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7380776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744448:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283592.324087:0:2270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001749d6e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2270:1867807973744384:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:2.0:1781283592.959545:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781283593.984960:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1781283595.003477:0:72295:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068a6b57e pname:cluuid:pid:xid:nid:opc:job multiop:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:72295:1867807973741888:192.168.201.129@tcp:101:multiop.0 00010000:00010000:3.0:1781283595.003501:0:72295:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003516:0:72295:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003523:0:72295:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003529:0:72295:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003537:0:72295:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003543:0:72295:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000042eb37a7 already unused, calling callback (00000000e42df095) 00010000:00010000:3.0:1781283595.003547:0:72295:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003553:0:72295:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003559:0:72295:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003566:0:72295:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1781283595.003570:0:72295:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781283595.003590:0:72295:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff89c1066d9800 lock: 0000000042eb37a7/0xab889bdcd86cc0e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 72295 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1781283595.003614:0:72295:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=17, status=-28 req@0000000068a6b57e x1867807973741888/t0(0) o101->lustre-MDT0000-mdc-ffff89c1066d9800@192.168.201.129@tcp:12/10 lens 664/600 e 0 to 0 dl 1781283642 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'multiop.0' 00000080:00200000:3.0:1781283595.003702:0:72295:0:(namei.c:1412:ll_create_it()) VFS Op:name=f31.replay-single-1, dir=[0x200000007:0x1:0x0](0000000035a7fd6e), intent=open|creat 00010000:00010000:0.0:1781283595.008285:0:44823:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781283596.034066:0:14073:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:2.0:1781283596.265999:0:72439:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1781283596.266005:0:72439:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_31: @@@@@@ FAIL: multiop_bg_pause /mnt/lustre/f31.replay-single-1 failed 00010000:00010000:3.0:1781283597.055682:0:32136:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781283597.440604:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028aa4434 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744576:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283597.440730:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128f5c2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744704:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283597.440767:0:2269:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1781283597.440772:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d57185ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2269:1867807973744512:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283597.440792:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014eac22a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744640:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283597.440811:0:2269:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000973930d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744768:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283597.445404:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000973930d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744768:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781283597.445430:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128f5c2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744704:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283597.447761:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d57185ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43154bd6-4937-440b-b23f-f37e9a2f1452:2269:1867807973744512:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283597.447790:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014eac22a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744640:192.168.201.129@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781283597.447818:0:2269:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028aa4434 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51b7a665-1c13-4be7-aa4c-ab3d947b09f3:2269:1867807973744576:192.168.201.129@tcp:400:kworker/u8:1.0 00010000:00010000:0.0:1781283598.080522:0:14074:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 243 lines, 243 kept, 0 dropped, 0 bad.